Question: As a Data Scientist write a python script for the below project with an extensive Exploratory Data analysis: Need help with the python script for
As a Data Scientist write a python script for the below project with an extensive Exploratory Data analysis:
Need help with the python script for the below problem statement using Machine Learning models as a data scientist at EasyVisa have to analyze the data provided and provide solutions:
Context
Business communities in the United States are facing high demand for human resources, but one of the constant challenges is identifying and attracting the right talent, which is perhaps the most important element in remaining competitive. Companies in the United States look for hardworking, talented, and qualified individuals both locally as well as abroad.
The Immigration and Nationality Act INA of the US permits foreign workers to come to the United States to work on either a temporary or permanent basis. The act also protects US workers against adverse impacts on their wages or working conditions by ensuring US employers' compliance with statutory requirements when they hire foreign workers to fill workforce shortages. The immigration programs are administered by the Office of Foreign Labor Certification OFLC
OFLC processes job certification applications for employers seeking to bring foreign workers into the United States and grants certifications in those cases where employers can demonstrate that there are not sufficient US workers available to perform the work at wages that meet or exceed the wage paid for the occupation in the area of intended employment.
Objective
In FY the OFLC processed employer applications for positions for temporary and permanent labor certifications. This was a nine percent increase in the overall number of processed applications from the previous year. The process of reviewing every case is becoming a tedious task as the number of applicants is increasing every year.
The increasing number of applicants every year calls for a Machine Learning based solution that can help in shortlisting the candidates having higher chances of VISA approval. OFLC has hired the firm EasyVisa for datadriven solutions. You as a data scientist at EasyVisa have to analyze the data provided and, with the help of a classification model:
Facilitate the process of visa approvals.
Recommend a suitable profile for the applicants for whom the visa should be certified or denied based on the drivers that significantly influence the case status.
Data Description
The data contains the different attributes of the employee and the employer. The detailed data dictionary is given below.
caseid: ID of each visa application
continent: Information of continent the employee
educationofemployee: Information of education of the employee
hasjobexperience: Does the employee has any job experience? Y Yes; N No
requiresjobtraining: Does the employee require any job training? Y Yes; N No
noofemployees: Number of employees in the employer's company
yrofestab: Year in which the employer's company was established
regionofemployment: Information of foreign worker's intended region of employment in the US
prevailingwage: Average wage paid to similarly employed workers in a specific occupation in the area of intended employment. The purpose of the prevailing wage is to ensure that the foreign worker is not underpaid compared to other workers offering the same or similar service in the same area of employment.
unitofwage: Unit of prevailing wage. Values include Hourly, Weekly, Monthly, and Yearly.
fulltimeposition: Is the position of work fulltime? Y FullTime Position; N PartTime Position
casestatus: Flag indicating if the Visa was certified or denied
Kindly make sure that all the required information asked in the rubric is included and do an extensive EDA with as many possibilities.
Include a detailed explanation of the approach taken, inferences, and insights
Include outputs such as graphs, tables, and all other relevant information
Criteria
Exploratory Data Analysis
Problem definition Univariate analysis Bivariate analysis Use appropriate visualizations to identify the patterns and insights Key meaningful observations on individual variables and the relationship between variables
Data Preprocessing
Prepare the data for analysis Feature Engineering Missing value Treatment Outlier Treatment Ensure no data leakage among traintest and validation sets
Model Building Original Data
Choose the appropriate metric for model evaluation Build models from decision trees, bagging and boosting methods Comment on the model performance You can choose NOT to build XGBoost if you are facing issues with the installation
Model Building Oversampled Data
Oversample the train data Build models from decision trees, bagging and boosting methods Comment on the model performance You can choose NOT to build XGBoost if you are facing issues with the installation
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
