Data Engineer

  • Net2Source, Inc. is one of the fastest growing IT Consulting company across USA. N2S is headquartered at NJ, USA with its branch offices in Asia Pacific Region. N2S offers a wide gamut of consulting solutions customized to client needs including staffing, training and technology.
Data Engineer:
Interview: Phone and Face to Face
Duration: 6+ months
Location: NYC, NY
Job Description:
As part of this team, you will work on the collecting, storing, processing, and analyzing huge sets of data. The primary focus will be to develop the construction and maintenance of our data pipeline, ETL processes and data warehouse. Data Engineer will also be responsible for data quality and understanding the data needs our various source data in order to anticipate and scale our systems.
Candidate must be willing to learn, work well independently, be open to feedback, and enthusiastic, with demonstrated technical aptitude, skills and abilities. Support Learning analytics Project that uses student data to know about the Curriculum quality & effectiveness.
Current technology includes (but is not limited to):
? Mulesoft API Management
? Change Data Capture (CDC)
? Data Ingestion to preparation to exploration and consumption using Cloud & Big Data Platform
? Tableau as Business Intelligence (BI) tools
? Dimensional and Relation table structures
? AWS cloud (S3, EC2, EMR, Redshift, etc.)
? Databricks, Snowflake, Attunity, Airflow
Roles & responsibilities may include:
? Integrate data from a variety of data sources (Data warehouse, Data marts) utilizing on-premises or cloud-based data structures;
? Develop and implement streaming, data lake, and analytics big data solutions
? Create integration of data from multiple data sources, knowledge of various ETL techniques and frameworks using Databricks
? Create Applications using Change Data Capture Tools
? Technical Support (includes trouble shooting, monitoring)
? Technical Analyst and Project Management Support
? Application Performance and System Testing Analyst
"Ideal? candidates will have the following experience, knowledge, skills or abilities:
? Utilize ETL processes to build data repositories using Databricks, Python, etc; integrate data into Data Lake using Spark, PySpark, Hive, Kafka Streaming, etc.
? Application development, including Cloud development experience, preferably using AWS ( AWS Services, especially S3, API Gateway, Redshift, Lambda, etc.)
? Must have expertise in the following: Python/R, SQL, Java
? Navigational flow, working with Notebooks, scheduling, integrating with AWS for cloud storage
? Working with different file formats: Hive, Parquet, CSV, JSON, Avro etc. Compression techniques
? Integrating PySpark with different data sources, example: Snowflake, Oracle, Postgres Mysql, etc.
? Experience with web services such as AWS, Redshift, S3, RDS, Athena, Dynamo DB and Aurora. Also, the ability to connect data using web API, REST API
? Knowledge of Business Intelligence Tools, Enterprise Reporting, Report Development, data modeling, data warehouse architecture, data warehousing concepts
? Comfortable with AWS cloud (S3, EC2, EMR, Redshift, etc.)
? Ability to collaborate with colleagues across different schools/locations
? Exceptional analytical, written, oral, and presentation skills with proven track record of delivering actionable insights succinctly
About Net2Source, Inc.
Net2Source is an employer-of-choice for over 1000 consultants across the globe. We recruit top-notch talent for over 40 Fortune and Government clients coast-to-coast across the U. S. We are one of the fastest-growing companies in the U. S. and this may be your opportunity to join us!
Want to read more about Net2Source? , Visit us at www. net2source. com
Srish Tripathi
Business Development Manager, Net2Source Inc.
Board: 201. 340. 8700 Ext 614 Direct: 201. 301. 2809
Email Id: srish@net2source. com Website: www. net2source. com
Address: 317 George St., Suite 220, New Brunswick, NJ 08901

Don't Be Fooled

The fraudster will send a check to the victim who has accepted a job. The check can be for multiple reasons such as signing bonus, supplies, etc. The victim will be instructed to deposit the check and use the money for any of these reasons and then instructed to send the remaining funds to the fraudster. The check will bounce and the victim is left responsible.

More Jobs

Director, Engineer Global Data Centers & Facil...
Long Island City, NY The Estee Lauder Companies
Data Visualization Editor
New York City, NY Dow Jones
Audio Engineer
New York City, NY Dow Jones
Field Engineer Apprentice
New York City, NY General Electric
Field Service Engineer
New York City, NY Thermo Fisher Scientific