New features request

[marcelinhov2]

Hey @badluck13 , thanks for the awesome work with this excellent library.

Is it possible to parse more data from the results page?

Tweets should be nice

Images should be nice too

Cards data should be amazing as well

related Q&A should be too good to be true

Thanks my friend.

[marcelinhov2]

Also about the adwords, did you remove it from the parser?

Thanks again.

[badluck13]

@marcelinhov2 hi

So for all that added features, we do not have a plan to parse them at this point, also a knowledge card on a sidebar is a massive undertaking on data modeling and extraction and I'm not sure we will ever try to parse it. Everyone is more than welcome to try and submit this by opening a PR

As for Ads, I just checked tests for Ads are passing, so we should be parsing all ads on the page, do you have a specific page they do not work?

[marcelinhov2]

nvm, you were right. I guess it doesn't show based on my location.

{"currentPage":1,"keyword":"dentist+new+york","organic":[{"domain":"www.209nycdental.com","linkType":"HOME","position":1,"snippet":"209 NYC Dental is the oldest continuing dental practice in New York State. Our legacy is one of respect, excellence, and compassion. Call now or book ...Contact Us. · Our Team · Implant Dentistry in New York · Testimonials","title":"209 NYC Dental: Best Dentist NYC - New York City Dental Office","url":"https://www.209nycdental.com/","sitelinks":[{"href":"https://www.209nycdental.com/contact-us/","title":"Contact Us.","type":"INLINE"},{"href":"https://www.209nycdental.com/our-providers/","title":"Our Team","type":"INLINE"},{"href":"https://www.209nycdental.com/services/implant-dentistry/","title":"Implant Dentistry in New York","type":"INLINE"},{"href":"https://www.209nycdental.com/patient-testimonials-reviews/","title":"Testimonials","type":"INLINE"}]},{"domain":"www.newyorkdentaloffice.com","linkType":"HOME","position":2,"snippet":"New York Dental Office is located at 245 E 63rd St #110, New York, NY. We are currently accepting new patients, and you can schedule an appointment by ...","title":"Dentist in New York, NY | Local Dentist for You & Your Family","url":"https://www.newyorkdentaloffice.com/"},{"domain":"www.zocdoc.com","linkType":"LANDING","position":3,"snippet":"Find best Dentists in New York, New York & make an appointment online instantly! Zocdoc helps you find Dentists in New York and other locations with ...How can I make a same-day appointment with a Dentist in New York?How can I find a New York Dentist who takes my insurance?","title":"Best Dentists Near Me in New York, NY | Zocdoc","url":"https://www.zocdoc.com/dentists/new-york-46063pm"},{"domain":"www.westvillagedentalstudio.com","linkType":"HOME","position":4,"snippet":"West Village Dental Studio is your West Village NYC dentist. Dr. Hemita Klose and team serve the areas of Greenwhich Village, Chelsea, & lower Manhattan.About Us · Contact · General · Cosmetic","title":"West Village Dental Studio - Greenwich Village NYC Dentist","url":"https://www.westvillagedentalstudio.com/","sitelinks":[{"href":"https://www.westvillagedentalstudio.com/about-us/","title":"About Us","type":"INLINE"},{"href":"https://www.westvillagedentalstudio.com/contact-us/","title":"Contact","type":"INLINE"},{"href":"https://www.westvillagedentalstudio.com/family-dentistry/","title":"General","type":"INLINE"},{"href":"https://www.westvillagedentalstudio.com/cosmetic-dentistry/","title":"Cosmetic","type":"INLINE"}]},{"domain":"www.opencare.com","linkType":"LANDING","position":5,"snippet":"Here is the definitive list of New York's dentists as rated by the New York, NY community. These professionals have received great reviews from customers ...","title":"Find the best dentists near you in New York, NY | Opencare.com","url":"https://www.opencare.com/dentists/new-york-ny/"},{"domain":"www.hellotend.com","linkType":"HOME","position":6,"snippet":"We have reimagined the entire dental experience with transparent pricing, modern studios & no judgment ever. ... Meet your new dentist.","title":"Tend | Look Forward to the Dentist | Top Rated Dental Team","url":"https://www.hellotend.com/"},{"domain":"villagedentalnyc.com","linkType":"HOME","position":7,"snippet":"Looking for a dentist in New York, NY? Look no further. Village Dental NYC offers comfortable general and cosmetic dentistry. (646) 736-4309.","title":"New York City Dentist - Village Dental NYC - New York, NY","url":"https://villagedentalnyc.com/"},{"domain":"www.nydentalgroup.com","linkType":"HOME","position":8,"snippet":"At New York Dental Group, we specialize in Dental Implants & General Dentistry to give you the smile you've always wanted. Call us at (607) 777-1340 today!","title":"Dentist In Vestal NY | General Dentistry & Dental Implant Center","url":"https://www.nydentalgroup.com/"},{"domain":"newyorkgeneraldentistry.com","linkType":"HOME","position":9,"snippet":"New York General Dentistry | Trusted General & Cosmetic Dentist in Midtown East Manhattan | High-Quality Manhattan Dental Care | Schedule Online.","title":"Dentist Midtown East NY | Manhattan Dental Care | Inna ...","url":"https://newyorkgeneraldentistry.com/"}],"pagination":[{"page":1,"path":""},{"page":2,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=10&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARA5"},{"page":3,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=20&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARA7"},{"page":4,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=30&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARA9"},{"page":5,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=40&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARA_"},{"page":6,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=50&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARBB"},{"page":7,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=60&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARBD"},{"page":8,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=70&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARBF"},{"page":9,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=80&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARBH"},{"page":10,"path":"/search?q=dentist%2Bnew%2Byork&gl=us&hl=en&ei=C16SYdPoCcOz5OUP7eufeA&start=90&sa=N&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q8tMDegQIARBJ"}],"relatedKeywords":[{"keyword":"best dentist new york","path":"/search?gl=us&hl=en&q=Best+dentist+New+York&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgbEAE"},{"keyword":"dentist new york manhattan","path":"/search?gl=us&hl=en&q=Dentist+New+York+Manhattan&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgsEAE"},{"keyword":"dentist new york salary","path":"/search?gl=us&hl=en&q=Dentist+New+York+salary&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgiEAE"},{"keyword":"new york dentist list","path":"/search?gl=us&hl=en&q=New+York+dentist+list&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAglEAE"},{"keyword":"new york magazine best dentists 2020","path":"/search?gl=us&hl=en&q=New+York+magazine+best+dentists+2020&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgkEAE"},{"keyword":"dentist near me","path":"/search?gl=us&hl=en&q=Dentist+near+me&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgjEAE"},{"keyword":"best cosmetic dentist new york city","path":"/search?gl=us&hl=en&q=Best+cosmetic+dentist+New+York+City&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgnEAE"},{"keyword":"dentist brooklyn","path":"/search?gl=us&hl=en&q=Dentist+Brooklyn&sa=X&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8Q1QJ6BAgcEAE"}],"totalResults":500000000,"timeTaken":0.88,"adwords":{"adwordsTop":[{"domain":"www.hellotend.com","linkType":"HOME","position":1,"sitelinks":[{"href":"https://www.google.com/aclk?sa=l&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAHGgJwdg&ae=2&sig=AOD64_26OAVok_lCyC1y-DHQgcdnShVQAQ&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QqyQoAHoECAMQCA&adurl=","snippet":"Preventative Restorative + Cosmetic Science based compassionate care","title":"Our Services","type":"CARD"},{"href":"https://www.google.com/aclk?sa=l&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAMGgJwdg&ae=2&sig=AOD64_1Q0PSGeeeQGa9jeeTNOSsIoECh3Q&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QqyQoAXoECAMQCQ&adurl=","snippet":"Remaking the dental experience Comprehensive Safety Measures","title":"Why Choose Tend?","type":"CARD"}],"snippet":"New Studios Open in NYC: Rock Center, UES, and West Village. Book Your Appointment Online. Zero Waiting, Transparent Pricing, Comfortable Care & Safe Sanitized Spaces.Preventative Restorative + Cosmetic Science based compassionate careRemaking the dental experience Comprehensive Safety Measures","title":"Tend Dental - Tend New York Dentist","url":"https://www.hellotend.com/"},{"domain":"www.centredent.com","linkType":"HOME","position":2,"sitelinks":[],"snippet":"Comprehensive Exam, Full Mouth X-Rays & Regular Teeth Cleaning For $150. Book Appointment!","title":"Centre Dental New York, NY - Affordable Prices","url":"https://www.centredent.com/"}],"adwordsBottom":[{"domain":"vittadental.com","linkType":"HOME","position":1,"sitelinks":[{"href":"https://www.google.com/aclk?sa=L&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAGGgJwdg&ae=2&sig=AOD64_2eVNJHWYasMxxJ27it-JzqFoLzKA&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoAHoECAQQCQ&adurl=","title":"Dental Services","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=L&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAKGgJwdg&ae=2&sig=AOD64_2cStiV47oO7EXl7A4TpwsNvmLJ9Q&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoAXoECAQQCg&adurl=","title":"Meet Dr Aryan","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=L&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAOGgJwdg&ae=2&sig=AOD64_2Bh7ZyLxsSMxx1rLqMU1zI7UasaQ&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoAnoECAQQCw&adurl=","title":"View Gallery","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=L&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABASGgJwdg&ae=2&sig=AOD64_0axlyLM1tAHhiVAm8YARp1csBoWQ&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoA3oECAQQDA&adurl=","title":"About Us","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=L&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAWGgJwdg&ae=2&sig=AOD64_23q3_eK3y4nBRCnGvq_EPI7GPL8w&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoBHoECAQQDQ&adurl=","title":"Contact Us","type":"INLINE"}],"snippet":"Serving Murray Hill and All New York City. Schedule an Appointment Today. Murray Hill Dentist, Park Avenue Dental Office, Midtown, Dr. Mehdi Aryan. ","title":"All Your Dental Needs - Dental Services","url":"https://vittadental.com/"},{"domain":"www.dntlbar.com","linkType":"HOME","position":2,"sitelinks":[{"href":"https://www.google.com/aclk?sa=l&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAIGgJwdg&ae=2&sig=AOD64_3J91yNInql5ev31ErOQ4fRcZ-nCQ&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoAHoECAoQCQ&adurl=","title":"Our Services","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=l&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABALGgJwdg&ae=2&sig=AOD64_2rnCby43V-MbOaZvFpzo3u73mwyQ&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoAXoECAoQCg&adurl=","title":"Check Your Insurance","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=l&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABAPGgJwdg&ae=2&sig=AOD64_2trQVca60OPrQSCQxcYmOTr7NnuQ&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoAnoECAoQCw&adurl=","title":"Book Now","type":"INLINE"},{"href":"https://www.google.com/aclk?sa=l&ai=DChcSEwj1_IScupr0AhVNPq0GHa89DEUYABATGgJwdg&ae=2&sig=AOD64_39IgwRzHL3NxqyJVV1D9N_YS5dfw&q=&ved=2ahUKEwiTmvebupr0AhXDGbkGHe31Bw8QpigoA3oECAoQDA&adurl=","title":"Locations","type":"INLINE"}],"snippet":"Cleanings & Check Ups, Teeth Whitening, Teeth Straightening, Impants, Veneers & More! Join the Dental Revolution & Start Enjoying Your Dental Visits. Book An Appointment Today. Easy Booking. Friendly Staff. Clear Pricing. Comfy Visits. Quality Care.","title":"Dentist In Manhattan - Dntl Bar: Top NYC Dentists","url":"https://www.dntlbar.com/"},{"domain":"www.drarthuryeh.com","linkType":"HOME","position":3,"sitelinks":[],"snippet":"Providing quality dental care in Montclair, Bloomfield and the surrounding neighborhoods. Pay Bill Online. Explore Services. Meet Our Team. Highlights: Online Bill Payment Option Available, Appointment Requesting Option Available, Using High-Quality Equipment.","title":"Dr. Arthur J. Yeh - General & Cosmetic Dentist","url":"https://www.drarthuryeh.com/"}]},"locals":[]}