Error in DjangoInstrumentor and RequestsInstrumentor

[OmarEltamasehy]

Hi Guys,
I can run the below code and I can receive the spans in very small project,
but when I copied the same code to a big project, unfortunately I can not receive spans only for Django and Requests
so please advice me for recommendations or solutions to try for this issue.
as I used the same code in manage.py or settings.py or wsgi.py and unfortunately the same issue.

from opentelemetry.instrumentation.django import DjangoInstrumentor
from opentelemetry.instrumentation.requests import RequestsInstrumentor
from opentelemetry.instrumentation.psycopg2 import Psycopg2Instrumentor
from opentelemetry.instrumentation.redis import RedisInstrumentor
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry import trace
from opentelemetry.exporter import jaeger
from opentelemetry.sdk.trace.export import BatchExportSpanProcessor

trace.set_tracer_provider(TracerProvider())
tracer = trace.get_tracer(__name__)

jaeger_exporter = jaeger.JaegerSpanExporter(
    service_name="original",
    agent_host_name="localhost",
    agent_port=6831
)


span_processor = BatchExportSpanProcessor(jaeger_exporter)
trace.get_tracer_provider().add_span_processor(span_processor)

DjangoInstrumentor().instrument()
RequestsInstrumentor().instrument()
RedisInstrumentor().instrument()
Psycopg2Instrumentor().instrument()

versions
Django==2.0.13 or Django==3.1.3
opentelemetry-api==0.15b0
opentelemetry-exporter-jaeger==0.15b0
opentelemetry-instrumentation==0.15b0
opentelemetry-instrumentation-redis==0.15b0
opentelemetry-instrumentation-requests==0.15b0
opentelemetry-instrumentation-django==0.15b0
opentelemetry-instrumentation-psycopg2==0.15b0
opentelemetry-sdk==0.15b0

[lzchen]

Please update to the latest versions of each package and see if you still have the same problems.

[OmarEltamasehy]

I updated all opentelemetry packages to the latest versions but unfortunately the same issue.

[OmarEltamasehy]

when I tried to debug the code and I did step into the below code I noticed that
self._is_instrumented returned false and this is unexpected
and result value is null and this is unexpected also

result = self._instrument(**kwargs)
self._is_instrumented = True
return result

[ash-ishh]

Are you getting any error in console?
In my case there was UDP max package size issue but due to my existing logger config 'disable_existing_loggers': True I was not getting any error/warning

[OmarEltamasehy]

I set 'disable_existing_loggers': False and still no errors in the console.

[ash-ishh]

Can you test the above thread no instrumentation hypothesis by adding following snippet

    django_instrumentor = DjangoInstrumentor()
    print(django_instrumentor._is_instrumented)
    django_instrumentor.instrument()
    print(django_instrumentor._is_instrumented)

[OmarEltamasehy]

Currently, 'print(django_instrumentor._is_instrumented)' is returned true but the issue still existed as no trace for Django and Requests to be extracted.

[lzchen]

It's difficult to debug your issue without understanding what "big project" means. Could you provide more context in the architecture that you are using?

[OmarEltamasehy]

I am using django, postgresql, redis, pub/sub and datastore in my project and I executed the same steps that mentioned in opentelemetry docs to apply the tracing.

[OmarEltamasehy]

I hope that my reply to be clear answer for your question, if it is not clear, please tell me if you need more clarification as I can not check which parts that cause this issue.

[lzchen]

From your example code, it is clear that you are using those technologies. What is unclear is what you are doing differently from a simple "copy/paste" example that causes your traces to not appear. You mentioned that a "small project" is working for you? What are you doing differently in the "small project" vs "big project"? Could you be more specific?

[OmarEltamasehy]

Actually no differences between them as I copied the code from settings.py to settings.py
but I faced error in opentelemetry/instrumentation/django/middleware.py
related to "wsgi.url_scheme", it appeared when I tried to insert the below line in MIDDLEWARE in settings.py
'opentelemetry.instrumentation.django.middleware._DjangoMiddleware'

[srikanthccv]

but I faced error in opentelemetry/instrumentation/django/middleware.py
related to "wsgi.url_scheme", it appeared when I tried to insert the below line in MIDDLEWARE in settings.py
'opentelemetry.instrumentation.django.middleware._DjangoMiddleware'

Are you talking about this error from contrib repo open-telemetry/opentelemetry-python-contrib#280? I think this issue and linked issue are very different. Can you elaborate more and provide some context?

[owais]

@OmarEltamasehy it would be great if you could provide a demo project where you can reproduce the issue.

[OmarEltamasehy]

please let me know if there is a concern for Django version with Django Instrumentation as I think that the issue is for Django==2.0.13

[lzchen]

Again, it is difficult to assess your issue without having some sort of demo. If you think the issue is with a specific version of Django, I would try a different version to see if your issue is resolved. Then maybe file a bug for the pinned version, demonstrating your findings.

[OmarEltamasehy]

Kindly check the below git repository as a demo
https://github.com/OmarEltamasehy/opentelemetry-demo

be noted that when I used Django==2.0.13
the below error is appeared
but when I installed Django==3.1.3
opentelemetry.instrumentation.django.middleware worked fine

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.8/wsgiref/handlers.py", line 137, in run
    self.result = application(self.environ, self.start_response)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/contrib/staticfiles/handlers.py", line 66, in __call__
    return self.application(environ, start_response)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/core/handlers/wsgi.py", line 146, in __call__
    response = self.get_response(request)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 81, in get_response
    response = self._middleware_chain(request)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 37, in inner
    response = response_for_exception(request, exc)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 87, in response_for_exception
    response = handle_uncaught_exception(request, get_resolver(get_urlconf()), sys.exc_info())
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 122, in handle_uncaught_exception
    return debug.technical_500_response(request, *exc_info)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/views/debug.py", line 94, in technical_500_response
    html = reporter.get_traceback_html()
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/views/debug.py", line 334, in get_traceback_html
    return t.render(c)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 175, in render
    return self._render(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 167, in _render
    return self.nodelist.render(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 943, in render
    bit = node.render_annotated(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 910, in render_annotated
    return self.render(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/defaulttags.py", line 314, in render
    return nodelist.render(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 943, in render
    bit = node.render_annotated(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 910, in render_annotated
    return self.render(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/defaulttags.py", line 211, in render
    nodelist.append(node.render_annotated(context))
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 910, in render_annotated
    return self.render(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 993, in render
    output = self.filter_expression.resolve(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 676, in resolve
    obj = self.var.resolve(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 802, in resolve
    value = self._resolve_lookup(context)
  File "/home/omar/opentelemetry-demo/venv/lib/python3.8/site-packages/django/template/base.py", line 867, in _resolve_lookup
    getcallargs(current)
  File "/usr/lib/python3.8/inspect.py", line 1336, in getcallargs
    f_name = func.__name__
AttributeError: '_GeneratorContextManager' object has no attribute '__name__'

[owais]

OK. That helps. This is a known issue: open-telemetry/opentelemetry-python-contrib#288

Let's close this discussion and add any further comments there.