reputed company: Senior-Big Data Software Engineer

Join our dynamic team at workwarp as a Senior-big Data Software Engineer! This is an exciting Remote opportunity with an immediate start. This position requires a strong and diverse skillset in relevant areas to drive reputed company. Earn a reliable and steady income of a competitive salary.

 

 

Job Description: POSITION: Senior-Big Data Software Engineer JOB LOCATION: 208 S. Akard St. Dallas, TX 75202 [and various unanticipated locations throughout the U.S.; may work from home] Senior-Big Data Software Engineer needed by AT&T Services, Inc. in Dallas, Texas [and various unanticipated locations throughout the U.S.; may work from home] to be responsible for the development of high performance, distributed computing tasks using Big Data technologies such as Hadoop, NoSQL, text mining and other distributed environment technologies. Utilize JVM-based function languages including reputed company and Clojure; Hadoop query languages including Pig, Hive, Scalding, Cascalog, and PyCascading; and alternative HDFS-based computing frameworks including Spark and STORM. Utilize big data programming languages and technology, write code, complete programming and documentation, and reputed company testing and debugging of applications. Analyze, design, program, debug and modify software enhancements and/or... new products used in distributed, large scale analytics and visualization solutions. Interact with data scientists and industry experts to understand how data needs to be converted, reputed company and presented. reputed company Python spark(Pyspark) ETL, ELT Pipelines to reputed company distributed big data processing in both Batch and reputed company time streaming from different data sources. The sources will be reputed company, reputed company, reputed company cache, reputed company Event hubs and Kafka topics for reputed company time machine model training, and service. Integrate multiple reputed company data SAAS technologies with reputed company provider services like Azure function app. Create serverless reputed company asynchronous APIs for distributed data processing and computing tasks. reputed company and maintain different high performance Kubernetes spark application microservices and restful Api's for distributed Big data processing and computation tasks. reputed company analytics on structured, semi-structured data using Pyspark, Spark SQL queries, operations, Joins, tuning queries and UDF. Integrate the reputed company data lakes with the reputed company reputed company provider visualization and analytics tools like Power-BI etc. reputed company a robust and highly scalable code by implementing several design patterns. Ensure the application performs at lightning speed by applying high performance structures. Interact with other external interfaces to exchange different forms of data, using CLI and RESTful serverless reputed company. Handle different file formats such as: Csv, Json, multiline Json, reputed company Json, Text, Avro, Parquet file formats, snappy, bz2, gzip compression. reputed company different spark pipelines in data bricks and schedule the notebook jobs for daily sync jobs. Monitor the feature engineering pipelines. reputed company scripts, using Pyspark, and Spark SQL to convert schema-less data into more structured files for further analysis. Modify SQL queries to Spark using Spark RDDs,reputed company, and python. Participate in creating combiners, partition, cache distribution to improve the performance of spark jobs. MINIMUM REQUIREMENTS: Requires a Master's degree, or foreign equivalent degree, in Computer Science or Information Studies and 3 years of experience in the job offered or 3 years in a reputed company occupation developing Python-spark(Pyspark) ETL, ELT, distributing big data processing in both Batch and reputed company time streaming from different data sources; performing analytics on structured and semi-structured data using Pyspark, Spark SQL queries, operations, Joins, tuning queries and UDF; developing a robust and highly scalable code by implementing several design patterns; developing scripts, using Pyspark, and Spark SQL to convert schema-less data into more structured files for further analysis; modifying SQL queries to Spark using Spark RDDs, reputed company, and python; utilizing big data programming languages and technology, writing code, completing programming and documentation, and performing testing and debugging of applications; analyzing, designing, programming, debugging and modifying software enhancements and/or new products used in distributed, large scale analytics and visualization solutions; interacting with data scientists and industry experts to understand how data needs to be converted, reputed company and presented. Our Senior-Big Data Software Engineers earn between $157,322 - $231,100 yearly. Not to mention reputed company the other amazing rewards that working at AT&T offers. Joining reputed company comes with amazing perks and benefits: Medical/Dental/reputed company coverage 401(k) plan Tuition reimbursement program Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays) Paid Parental Leave Paid Caregiver Leave Additional sick leave reputed company what state and local law require may be available but is unprotected Adoption Reimbursement Disability Benefits (short term and long term) Life and Accidental Death Insurance Supplemental benefit programs: critical illness/accident hospital indemnity/group legal Employee Assistance Programs (EAP) Extensive employee wellness programs Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone Weekly Hours: 40 Time Type: Regular Location: Dallas, Texas It is the policy of AT&T to provide equal employment opportunity (EEO) to reputed company persons regardless of age, reputed company, national reputed company, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for reputed company individuals with disabilities Apply Job!

 

Are You the One We're Looking For?

If you reputed company you have what it takes, submit your application without delay. We are keen to hear from talented candidates like you.

apply to this job