Skip to content

Conversation

@ChSonnabend
Copy link
Collaborator

Adding a library for the execution of ONNX models with GPU execution provider and float16 datatype (OrtDataType::Float16_t -> a wrapper around a uint16_t)

@ChSonnabend
Copy link
Collaborator Author

Ping @davidrohr

@github-actions
Copy link
Contributor

REQUEST FOR PRODUCTION RELEASES:
To request your PR to be included in production software, please add the corresponding labels called "async-" to your PR. Add the labels directly (if you have the permissions) or add a comment of the form (note that labels are separated by a ",")

+async-label <label1>, <label2>, !<label3> ...

This will add <label1> and <label2> and removes <label3>.

The following labels are available
async-2023-pbpb-apass3
async-2023-pbpb-apass4
async-2023-pp-apass4
async-2024-pp-apass1
async-2022-pp-apass7
async-2024-pp-cpass0

o2_add_library(ML
SOURCES src/ort_interface.cxx
TARGETVARNAME targetName
PUBLIC_LINK_LIBRARIES O2::Framework ONNXRuntime::ONNXRuntime) No newline at end of file
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

brauchst du hier PUBLIC, oder geht PRIVATE auch?

// or submit itself to any jurisdiction.

/// \file GPUORTFloat16.h
/// \author Christian Sonnabend <christian.sonnabend@cern.ch>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hast du das selbst geschrieben, oder von github kopiert?
In letzten Fall musst du den korrekten Autor angeben, und schauen ob der code unter GPL3 lizensiert ist. Jedenfalls haben wir kein copyright dafür.
Ansonten leg ein 3rdparty Verzeichnis wie Framework/Foundation/3rdparty oder GPU/GPUTracking/display/3rdparty an. Das wird dann auch im CodeChecker ausgenommen: https://github.com/alisw/alidist/blob/1916f6d88d42959097998d9481b517dc1c1ea84d/o2checkcode.sh#L71

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ja, das ist komplett 3rd party von ONNX. Die source geb ich auch im header an, da kopier ich dann vielleicht einfach direkt die file vom ONNX repo und pack die in das Verzeichnis das du oben angegeben hast

#include <thread>

// O2 includes
#include "GPUORTFloat16.h"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wenn du den Datentyp hier nicht benutzt, solltest du den header auch nicht includen.

target_link_libraries(${mergertargetName} PRIVATE OpenMP::OpenMP_CXX)
endif()

o2_add_executable(onnx-interface
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wenn es ein test ist, vielleicht o2_add_test?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Den workflow kann ich für einen PR, der gemerged wird, sowie so weglassen. Das ist nur momentan zum testen und würd ich dann rausnehmen

@davidrohr
Copy link
Collaborator

Ideally, we should not have merge commits. Can you rebase without merge commits. Also, you should squash cleanups.
If you don't intend to keep the history, please ignore, then we'll just squash-merge.

@ChSonnabend
Copy link
Collaborator Author

Ideally, we should not have merge commits. Can you rebase without merge commits. Also, you should squash cleanups. If you don't intend to keep the history, please ignore, then we'll just squash-merge.

I won't need the history afterwards. For now I'm just pushing the recent changes into this branch. I will also soon add the code in the actual clusterization code (although I might open a separate PR for that)

@github-actions
Copy link
Contributor

github-actions bot commented Nov 3, 2024

This PR did not have any update in the last 30 days. Is it still needed? Unless further action in will be closed in 5 days.

@github-actions github-actions bot added the stale label Nov 3, 2024
Please consider the following formatting changes to AliceO2Group#13522
@github-actions github-actions bot closed this Nov 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Development

Successfully merging this pull request may close these issues.

3 participants