Software Engineer (Multiple Positions Available)

Job description

DESCRIPTION:
Duties: Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
Leading projects and working as the point of contact for the status and reviewing the code, providing the guidance, interacting with business users to support the Data Driven Lead generation process and communicate with business users on debugging inquiries.
Develops secure high-quality production code, and reviews and debugs code written by others.
Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems.
Ensuring software meets business requirements, functions as expected and delivers value to end users.
Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture.
Leads communities of practice across Software Engineering to drive awareness and use of new and leading- edge technologies.
Mentor and guide junior engineers on Python best practices and re-usable pattern.
Maintain data driven lead creation process that can perform ETL on qualifying lead base on suppression and resting strategy given by the business.
Create delta process on each ETL process that can compare the expected outcome against the actual result.
Design and build Machine learning algorithm out of historical lead data and have it identify ones likely to end up successful.
QUALIFICATIONS:
Minimum education and experience required: Bachelor's degree in Electronic Engineering, Computer Science, Computer Engineering, Computer Information Systems, Management Information Systems, Information Technology, Electrical Engineering, Data Analytics, Data Engineering, or related field of study plus 7 years of experience in the job offered or as Lead Software Engineer, Associate Data Architect Data Lake, Software Development & Engineering, Computer Programmer, Product Developer, Software Development Analyst, Product Development, or related occupation.
Skills Required: This position requires experience with the following: Gathering, designing, developing, and testing at various phases of the software development lifecycle utilizing tools including Python, PySpark and AWS; Working with PySpark, AWS Glue, Athena, RedShift and EMR in order to meet business needs by writing user stories; Developing processes of ETL analysis, batch, and real time analytics on Hadoop using Sqoop, Hive, and Spark; Working with reusable code and component developments including Python and Spark; Using Python best practices including List Comprehension, Generators, writing modular and reusable codes, using map reduce filter functions, using virtual environment for dependency management; Using PySpark best practices avoiding shuffling queries, memory parameter optimizations, and dividing the dataset into partitions; Using tools including Spark, Sqoop, Kafka, Zookeeper, Flink, Oozie, HCatalog, and Hive to obtain data in real time from the external systems; Utilizing Sqoop to extract data from other databases to HDFS and Spark for processing the data helping in distributed processing, Flink for real time data processing including Kinesis and Kafka topics; Utilizing Hcatalog and Hive for HDFS data processing; Utilizing Spark for distributed processing of larger data volumes more than 1 TB and oozie to schedule data processing batch jobs; Implementing Data Pipelines using Python, Spark, PySpark, SparkSQL, Kafka, Cassandra, Hive and Hadoop to distributed File Systems, Data, and analytics solutions including extracting from different sources, processing data, data manipulation, finding correlations, and delivering data to downstream systems; Using tools including SQL, Python, PySpark, SparkSQL in data and analytics solutions to Technological environments encompassing various stages and tools for software deployment, testing and maintenance; User Acceptance testing and production; Using SQL-on-Hadoop technologies Hive, Pig, Impala, SparkSQL, and Presto for executing the data pipelines flow including source extraction from realtime API's or in batch flow via connection to databases, files, cleaning data, computing Data quality checks; Working with Apache and Hadoop ecosystems including HDFS, Hive QL, Spark, PySpark, and optimizing techniques with PySpark SQL for customer and financial data used to generate data driven leads; Working with AWS Services in AWS Kinesis and Kafka for consuming real time data, Kinesis Firehose, S3, AWS Glue for extracting and processing data, EMR, Redshift, Athena for data complex computation pipelines, IAM for Access and Authorization, Cloud Watch for Application logging, Step Functions, Airflow for scheduling application jobs, KMS for data encryption, LakeFormation for Data Governance, Aurora Postgres SQL for Databases; Utilizing Java to enhance customer experiences from the front end screens; Utilizing Mainframe Technology to develop new components, screens, and interfaces to external applications from databases.
Job Location: 450 W 33rd St, New York, NY 10001.
Full-Time.
Salary: $182,100 - $215,000 per year.
Chase is a leading financial services firm, helping nearly half of America's households and small businesses achieve their financial goals through a broad range of financial products.
Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do.
We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location.
Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions.
We also offer a range of benefits and programs to meet employee needs, based on eligibility.
These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more.
Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success.
We are an equal opportunity employer and place a high value on diversity and inclusion at our company.
We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law.
We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.
Visit our FAQs for more information about requesting an accommodation.
Equal Opportunity Employer/Disability/Veterans
Base Pay/Salary
New York,NY $182,100.00 - $215,000.00 / year

Required Skill Profession

Computer Occupations