Question Generation using Natural Language processing
Question Generation using Natural Language processing
Auto generate assessments in edtech like MCQs, True/False, Fill-in-the-blanks etc using state-of-the-art NLP techniques. New
Created by : Ramsri Golla Lead Data Scientist (NLP & CV)
Let's get started
What you'll learn
- Generate assessments like MCQs, True/False questions etc from any content using state-of-the-art natural language processing techniques.
- Apply recent advancements like BERT, OpenAI GPT-2, and T5 transformers to solve real-world problems in edtech.
- Use NLP libraries like Spacy, NLTK, AllenNLP, HuggingFace transformers, etc.
- Use Google Colab environment to run all these algorithms.
Requirements
- Python, data structures, deep learning and basic familiarity with Pytorch.
Description
This course focuses on using state-of-the-art Natural Language processing techniques to solve the problem of question generation in edtech.
If we pick up any middle school textbook, at the end of every chapter we see assessment questions like MCQs, True/False questions, Fill-in-the-blanks, Match the following, etc. In this course, we will see how we can take any text content and generate these assessment questions using NLP techniques.
This course will be a very practical use case of NLP where we put basic algorithms like word vectors (word2vec, Glove, etc) to recent advancements like BERT, openAI GPT-2, and T5 transformers to real-world use.
We will use NLP libraries like Spacy, NLTK, AllenNLP, HuggingFace transformers, etc.
All the sections will be accompanied by easy to use Google Colab notebooks. You can run Google Colab notebooks for free on the cloud and also train models using free GPUs provided by Google.
Prerequisites:
- This course will focus on the practical use cases of algorithms. A high-level introduction to the algorithms used will be introduced but the focus is not on the mathematics behind the algorithms.
- A high-level understanding of deep learning concepts like forward pass, backpropagation, optimizers, loss functions is expected.
- Strong Python programming skills with basic knowledge of Natural Language processing and Pytorch is assumed.
The course outline :
➤ Generate distractors (wrong choices) for MCQ options
Students will use several approaches like Wordnet, ConceptNet, and Sense2vec to generate distractors for MCQ options.
➤ Generate True or False questions using pre-trained models like sentence BERT, constituency parser, and OpenAI GPT-2
Students will learn to use constituency parser from AllenNLP to split any sentence. They will learn to use GPT-2 to generate sentences with alternate endings and filter them with Sentence BERT.
➤ Generate MCQs from any content by training a T5 transformer model using the HuggingFace library.
Students will understand the T5 transformer algorithm and use SQUAD dataset to train a question generation model using HuggingFace Transformers library and Pytorch Lightning.
➤ Generate Fill in the blanks questions
Students will learn to use Python Keyword extraction library to extract keywords, use flashtext library to do fast keyword matching, and visualize fill-in-the-blanks using HTML ElementTree in Colab
➤ Generate Match the following questions.
Students will learn to use Python Keyword extraction library to extract keywords, use flashtext library to do fast keyword matching, and use BERT to do word sense disambiguation (WSD).
18 Best Data Science on Udemy to Consider
Link : Artificial Intelligence: Optimization Algorithms in Python
Learn how to build optimization algorithms from the ground up!
Rating: 4.5 out of 5 4.5 (34 ratings) 600 students
Created by : Jones Granatyr Professor
Last updated 8/2020 | English
Link :Data Science, Analytics & AI for Business & the Real World™
Use Data Science & Statistics To Solve Business Problems & Gain Insights Into Everyday Problems With 35+ Case Studies Bestseller
Rating: 4.4 out of 5 4.4 (147 ratings) 1,890 students
Created by : Rajeev D. Ratan Data Scientist, Computer Vision Expert & Electrical Engineer
Last updated 1/2021 | English
Link : Deployment of Machine Learning Models in Production | Python
Deploy ML Model with BERT, DistilBERT, FastText NLP Models in Production with Flask, uWSGI, and NGINX at AWS EC2
Rating: 4.5 out of 5 4.5 (149 ratings) 3,273 students
Created by : Laxmi Kant Principal Data Scientist at mBreath and KGPTalkie
Last updated 2/2021 | English
Link : Testing and Monitoring Machine Learning Model Deployments
ML testing strategies, shadow deployments, production model monitoring and more
Rating: 4.5 out of 5 4.5 (168 ratings) 2,461 students
Created by : Christopher Samiullah Machine Learning Engineer
Last updated 10/2020 | English
Link : Applied Time Series Analysis in Python
Use Python and Tensorflow to apply the latest statistical and deep learning techniques for time series analysis New
Rating: 4.6 out of 5 4.6 (18 ratings) 113 students
Created by : Marco Peixeiro Data Scientist
Last updated 2/2021 | English
Link : RA: Data Science and Supply Chain analytics. A-Z with Python
Learn Python, Supply Chain Data Science ,Linear Programming, Forecasting, Pricing and Inventory Management.
Rating: 4.5 out of 5 4.5 (96 ratings) 591 students
Created by Haytham Omar Consultant-Supply chain
Last updated 2/2021 | English
Link : Financial Engineering and Artificial Intelligence in Python
Financial Analysis, Time Series Analysis, Portfolio Optimization, CAPM, Algorithmic Trading, Q-Learning, and MORE! Bestseller
Rating: 4.7 out of 5 4.7 (349 ratings) 2,363 students
Created by : Lazy Programmer Team Artificial Intelligence and Machine Learning Engineer
Lazy Programmer Inc. Artificial intelligence and machine learning engineer
Last updated 2/2021 | English
Link : PyTorch: Deep Learning and Artificial Intelligence
Neural Networks for Computer Vision, Time Series Forecasting, NLP, GANs, Reinforcement Learning, and More! Bestseller
Rating: 4.8 out of 5 4.8 (566 ratings) 3,450 students
Created by : Lazy Programmer Team Artificial Intelligence and Machine Learning Engineer
Last updated 12/2020 | English
Link : Data Science and Machine Learning using Python - A Bootcamp
Link : Deploy Machine Learning & NLP Models with Dockers (DevOps)
Link : 2021 Natural Language Processing in Python for Beginners
Link : Neural Networks in Python from Scratch: Complete guide
Link : Python Data Science with Pandas: Master 12 Advanced Projects
Link : Machine Learning with Imbalanced Data
Link : A Complete Natural Language Processing Beginner Masterclass™
Link : Building Machine Learning Web Apps with Python
Link : Python Interactive Dashboards with Plotly Dash
Link : Face Recognition Web App with Machine Learning in Flask
18 Best Data Science on Udemy to Consider
Post a Comment for "Question Generation using Natural Language processing"