Sep 18 21:03:53.858962 ip-10-0-132-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 21:03:53.858973 ip-10-0-132-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 21:03:53.858983 ip-10-0-132-35 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 21:03:53.859184 ip-10-0-132-35 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 21:04:04.055146 ip-10-0-132-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 21:04:04.055161 ip-10-0-132-35 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dabf9dabe638425aa2ac8004b295af1e --
Sep 18 21:06:05.144200 ip-10-0-132-35 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 21:06:08.485082 ip-10-0-132-35 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 21:06:08.485082 ip-10-0-132-35 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 21:06:08.485082 ip-10-0-132-35 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 21:06:08.485082 ip-10-0-132-35 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 21:06:08.485082 ip-10-0-132-35 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 21:06:08.485727 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.485165    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 21:06:08.489385 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489362    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 21:06:08.489385 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489380    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 21:06:08.489385 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489385    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 21:06:08.489385 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489388    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 21:06:08.489385 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489391    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 21:06:08.489385 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489394    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489397    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489402    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489406    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489409    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489412    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489415    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489418    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489421    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489424    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489426    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489429    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489432    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489434    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489437    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489439    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489442    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489444    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489447    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 21:06:08.489607 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489449    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489455    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489457    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489460    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489463    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489465    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489468    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489470    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489472    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489475    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489477    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489479    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489482    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489485    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489488    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489491    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489494    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489496    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489499    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489502    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 21:06:08.490077 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489504    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489508    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489511    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489514    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489516    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489518    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489521    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489524    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489526    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489528    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489531    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489536    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489539    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489542    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489545    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489547    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489550    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489552    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489555    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 21:06:08.490575 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489557    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489560    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489562    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489564    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489567    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489569    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489572    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489574    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489577    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489581    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489583    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489586    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489588    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489591    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489593    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489596    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489598    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489601    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489603    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489605    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 21:06:08.491048 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489609    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489611    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489614    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489616    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489619    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489621    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489624    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489627    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489629    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489632    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489634    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489637    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489639    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489642    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489644    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.489646    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491196    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491204    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491207    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491211    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 21:06:08.491544 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491213    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491216    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491219    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491222    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491224    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491227    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491229    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491232    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491235    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491237    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491239    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491242    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491244    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491247    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491252    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491255    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491257    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491260    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491263    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491265    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 21:06:08.492027 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491268    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491271    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491273    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491276    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491278    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491282    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491286    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491289    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491292    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491294    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491297    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491300    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491302    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491305    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491308    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491310    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491313    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491315    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491318    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 21:06:08.492542 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491320    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491322    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491325    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491328    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491330    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491333    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491335    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491339    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491341    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491345    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491349    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491351    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491354    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491356    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491359    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491361    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491364    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491366    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491368    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 21:06:08.493006 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491371    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491373    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491376    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491378    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491381    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491383    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491386    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491388    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491390    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491393    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491395    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491398    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491400    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491403    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491405    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491408    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491410    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491413    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491415    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491417    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 21:06:08.493469 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491421    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491425    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491428    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491432    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491435    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491437    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491440    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491442    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491445    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491447    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491450    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491453    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491455    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491459    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491462    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491465    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491468    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491822    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491826    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 21:06:08.493958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491829    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491832    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491834    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491837    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491839    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491842    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491845    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491849    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491852    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491854    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491857    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491860    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491862    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491865    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491875    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491878    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491896    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491900    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491903    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 21:06:08.494410 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491906    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491917    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491920    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491923    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491926    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491929    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491932    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491934    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491936    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491939    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491941    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491946    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491949    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491951    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491954    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491956    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491959    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491962    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491964    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491967    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 21:06:08.494855 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491969    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491972    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491975    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491977    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491981    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491985    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491988    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491991    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491994    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.491997    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492001    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492004    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492006    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492009    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492011    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492014    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492016    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492019    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492021    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 21:06:08.495347 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492024    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492026    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492028    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492032    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492036    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492038    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492041    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492043    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492046    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492048    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492051    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492053    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492055    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492058    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492060    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492063    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492065    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492068    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492070    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492072    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 21:06:08.495793 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492075    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492077    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492080    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492083    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492085    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492087    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492090    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492092    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492094    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492097    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492099    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492102    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492104    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492106    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492109    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492111    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492115    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492117    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492120    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492191    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 21:06:08.496277 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492221    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492228    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492232    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492240    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492243    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492247    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492251    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492254    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492257    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492261    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492264    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492267    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492270    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492272    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492275    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492278    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492281    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492285    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492287    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492290    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492293    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492296    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492299    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 21:06:08.496786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492302    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492305    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492308    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492311    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492314    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492318    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492322    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492325    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492329    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492332    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492335    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492338    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492341    2576 flags.go:64] FLAG: --enable-server="true"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492343    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492348    2576 flags.go:64] FLAG: --event-burst="100"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492351    2576 flags.go:64] FLAG: --event-qps="50"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492354    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492357    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492359    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492363    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492366    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492369    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492372    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492375    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492378    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 21:06:08.497337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492381    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492384    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492387    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492390    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492392    2576 flags.go:64] FLAG: --feature-gates=""
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492396    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492399    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492402    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492404    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492407    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492410    2576 flags.go:64] FLAG: --help="false"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492413    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492418    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492422    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492424    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492428    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492431    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492434    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492436    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492439    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492442    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492445    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492448    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492451    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 18 21:06:08.497980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492454    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492456    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492459    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492462    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492465    2576 flags.go:64] FLAG: --lock-file=""
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492468    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492470    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492474    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492479    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492483    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492486    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492488    2576 flags.go:64] FLAG: --logging-format="text"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492491    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492494    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492497    2576 flags.go:64] FLAG: --manifest-url=""
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492500    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492504    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492506    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492510    2576 flags.go:64] FLAG: --max-pods="110"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492513    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492517    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492522    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492525    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492528    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492531    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 21:06:08.498551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492534    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492540    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492544    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492547    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492550    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492553    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492558    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492561    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492564    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492567    2576 flags.go:64] FLAG: --port="10250"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492570    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492573    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd0ebf8cfa97eb1d"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492576    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492578    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492581    2576 flags.go:64] FLAG: --register-node="true"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492584    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492587    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492590    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492593    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492596    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492599    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492602    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492605    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492607    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492610    2576 flags.go:64] FLAG: --runonce="false"
Sep 18 21:06:08.499175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492613    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492616    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492620    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492623    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492627    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492630    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492632    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492635    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492638    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492641    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492643    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492646    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492649    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492652    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492655    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492660    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492662    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492665    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492669    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492671    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492674    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492677    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492680    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492682    2576 flags.go:64] FLAG: --v="2"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492686    2576 flags.go:64] FLAG: --version="false"
Sep 18 21:06:08.499788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492690    2576 flags.go:64] FLAG: --vmodule=""
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492694    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.492697    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492814    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492818    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492821    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492823    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492826    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492829    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492832    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492835    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492840    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492842    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492845    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492848    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492850    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492853    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492855    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492858    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492861    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 21:06:08.500398 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492863    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492866    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492868    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492871    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492873    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492876    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492878    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492893    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492896    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492899    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492901    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492904    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492907    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492910    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492912    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492915    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492918    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492920    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492923    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 21:06:08.500878 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492925    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492928    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492932    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492935    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492940    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492944    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492947    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492950    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492953    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492955    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492958    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492960    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492963    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492965    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492968    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492970    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492973    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492976    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492978    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 21:06:08.501375 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492981    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492984    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492987    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492990    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492992    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492995    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492997    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.492999    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493002    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493006    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493010    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493012    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493016    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493019    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493022    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493026    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493029    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493033    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493035    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493038    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 21:06:08.501817 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493040    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493043    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493045    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493048    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493050    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493053    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493055    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493058    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493060    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493063    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493066    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493068    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493070    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493073    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493076    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493079    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493081    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493083    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493086    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493089    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 21:06:08.502305 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493092    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493094    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493097    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.493099    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.493743    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501032    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501047    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501066    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501072    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501131    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501135    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501138    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501141    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501144    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 21:06:08.502790 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501146    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501149    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501152    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501154    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501156    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501159    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501163    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501167    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501170    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501173    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501175    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501178    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501182    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501185    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501188    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501191    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501194    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501197    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501200    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 21:06:08.503140 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501202    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501205    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501209    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501212    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501215    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501224    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501228    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501230    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501233    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501236    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501239    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501241    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501243    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501246    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501249    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501251    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501254    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501256    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501259    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501262    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 21:06:08.503603 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501264    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501266    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501269    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501271    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501274    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501276    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501279    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501281    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501284    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501286    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501289    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501291    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501294    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501296    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501299    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501301    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501304    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501307    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501315    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501318    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 21:06:08.504087 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501320    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501323    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501325    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501328    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501330    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501333    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501335    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501338    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501340    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501343    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501345    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501348    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501350    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501353    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501355    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501358    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501360    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501363    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501365    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 21:06:08.504627 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501368    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501370    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501372    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501375    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501377    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501380    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501383    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501386    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501389    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501391    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501394    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501396    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501404    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501407    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501409    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 21:06:08.505107 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501412    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501417    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501554    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501558    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501561    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501564    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501567    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501569    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501572    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501574    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501577    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501579    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501582    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501584    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501587    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 21:06:08.505487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501589    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501591    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501594    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501597    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501599    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501602    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501604    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501606    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501609    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501611    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501614    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501617    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501619    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501622    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501624    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501632    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501635    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501637    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501640    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501642    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 21:06:08.505843 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501645    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501647    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501649    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501652    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501654    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501658    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501661    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501664    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501667    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501670    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501673    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501675    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501678    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501680    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501683    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501685    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501688    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501690    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501692    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 21:06:08.506328 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501695    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501697    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501700    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501703    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501707    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501710    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501713    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501717    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501719    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501727    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501731    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501733    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501736    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501739    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501741    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501744    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501746    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501748    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501751    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 21:06:08.506781 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501753    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501756    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501758    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501761    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501763    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501765    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501768    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501771    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501773    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501775    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501778    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501780    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501783    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501785    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501787    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501790    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501793    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501796    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501798    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501801    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 21:06:08.507242 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501803    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501805    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501809    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501818    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501822    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501824    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501827    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:08.501830    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501835    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.501975    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.504091    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.505093    2576 server.go:1019] "Starting client certificate rotation"
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.505211    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 21:06:08.507715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.505246    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 21:06:08.508083 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.507849    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 21:06:08.509293 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.509259    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 21:06:08.525799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.525780    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 18 21:06:08.527315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.527300    2576 log.go:25] "Validated CRI v1 image API"
Sep 18 21:06:08.528087 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.528069    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 21:06:08.531640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.531619    2576 fs.go:135] Filesystem UUIDs: map[3f3491b5-79bf-4ab9-8cbf-662122f14d61:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d137ab20-ef23-4a27-9806-193f27e1e390:/dev/nvme0n1p3]
Sep 18 21:06:08.531721 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.531639    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 21:06:08.538166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.538054    2576 manager.go:216] Machine: {Timestamp:2026-09-18 21:06:08.5375472 +0000 UTC m=+2.000326548 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200955 MemoryCapacity:33164464128 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208accde64f84d245f63f3732aa008 SystemUUID:ec208acc-de64-f84d-245f-63f3732aa008 BootID:dabf9dab-e638-425a-a2ac-8004b295af1e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582230016 Type:vfs Inodes:4048396 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d0:dd:af:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d0:dd:af:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:7f:f7:1d:35:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164464128 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 21:06:08.538166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.538156    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 21:06:08.538287 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.538233    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 21:06:08.539954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.539930    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 21:06:08.540098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.539953    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 21:06:08.540529 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.540512    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 21:06:08.542390 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.542375    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 21:06:08.542451 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.542392    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 21:06:08.542451 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.542400    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 21:06:08.542451 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.542409    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 21:06:08.542535 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.542486    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 21:06:08.545550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545539    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 21:06:08.545691 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545681    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 21:06:08.545734 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545726    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 21:06:08.545762 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545738    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 21:06:08.545762 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545748    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 21:06:08.545762 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545757    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 18 21:06:08.545855 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.545768    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 21:06:08.546152 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.546136    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 21:06:08.546190 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.546164    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 21:06:08.550964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.550939    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 21:06:08.553587 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.553573    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 21:06:08.553645 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.553602    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 21:06:08.554923 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.554910    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 21:06:08.554968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.554928    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 21:06:08.554968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.554935    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 21:06:08.554968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.554939    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 21:06:08.554968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.554947    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 21:06:08.554968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.554953    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 21:06:08.556134 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556120    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 21:06:08.556134 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556134    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 21:06:08.556251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556142    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 21:06:08.556251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556147    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 21:06:08.556251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556167    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 21:06:08.556251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556174    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 21:06:08.556251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556203    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 21:06:08.556251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.556209    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 21:06:08.558898 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.558840    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 21:06:08.558959 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.558908    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 21:06:08.560189 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.560177    2576 server.go:1268] "Started kubelet"
Sep 18 21:06:08.560270 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.560246    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 21:06:08.560318 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.560248    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 21:06:08.560366 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.560354    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 21:06:08.560758 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.560740    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 21:06:08.560932 ip-10-0-132-35 systemd[1]: Started Kubernetes Kubelet.
Sep 18 21:06:08.561497 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.561358    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 21:06:08.587188 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.587161    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h28s7"
Sep 18 21:06:08.588141 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.588117    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 21:06:08.588272 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.588251    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h28s7"
Sep 18 21:06:08.588410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.588391    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 21:06:08.594426 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.593362    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-35.ec2.internal.18d6864d5140bfb7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-35.ec2.internal,UID:ip-10-0-132-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-35.ec2.internal,},FirstTimestamp:2026-09-18 21:06:08.560152503 +0000 UTC m=+2.022931852,LastTimestamp:2026-09-18 21:06:08.560152503 +0000 UTC m=+2.022931852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-35.ec2.internal,}"
Sep 18 21:06:08.595859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.595842    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 21:06:08.595859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.595849    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 21:06:08.596064 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.596037    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:08.596706 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596690    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 21:06:08.596706 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596708    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 21:06:08.596841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596690    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 21:06:08.596841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596781    2576 factory.go:55] Registering systemd factory
Sep 18 21:06:08.596841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596796    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 21:06:08.596841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596804    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 21:06:08.596841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.596797    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 18 21:06:08.597090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.597032    2576 factory.go:153] Registering CRI-O factory
Sep 18 21:06:08.597090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.597048    2576 factory.go:223] Registration of the crio container factory successfully
Sep 18 21:06:08.597169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.597100    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 21:06:08.597169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.597120    2576 factory.go:103] Registering Raw factory
Sep 18 21:06:08.597169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.597135    2576 manager.go:1196] Started watching for new ooms in manager
Sep 18 21:06:08.597744 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.597720    2576 manager.go:349] Starting recovery of all containers
Sep 18 21:06:08.600355 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.600335    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 21:06:08.603094 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.603055    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 21:06:08.606080 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.606059    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-35.ec2.internal\" not found" node="ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.607827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.607814    2576 manager.go:354] Recovery completed
Sep 18 21:06:08.611685 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.611673    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.613461 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.613332    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.613520 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.613476    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.613520 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.613490    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.614085 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614069    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 21:06:08.614085 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614083    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.614184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614083    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 21:06:08.614184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614141    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 21:06:08.614798 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614782    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.614843 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614811    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.614843 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.614821    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.615552 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.615542    2576 policy_none.go:49] "None policy: Start"
Sep 18 21:06:08.615605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.615556    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 21:06:08.615605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.615566    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 21:06:08.616870 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.616859    2576 policy_none.go:47] "Start"
Sep 18 21:06:08.652542 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.652526    2576 manager.go:337] "Starting Device Plugin manager"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.652573    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.652587    2576 server.go:87] "Starting device plugin registration server"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.652835    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.652864    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.652999    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.653069    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.653077    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.653694    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 21:06:08.666837 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.653743    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:08.734153 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.734126    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 21:06:08.734296 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.734186    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 21:06:08.734296 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.734208    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 21:06:08.734296 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.734253    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 21:06:08.736642 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.736584    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 21:06:08.753846 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.753829    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.754724 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.754708    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.754802 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.754738    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.754802 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.754749    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.754802 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.754771    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.763251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.763231    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.763251 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.763253    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-35.ec2.internal\": node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:08.800903 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.800860    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:08.834985 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.834925    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"]
Sep 18 21:06:08.835058 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.835052    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.836460 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.836445    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.836549 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.836472    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.836549 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.836482    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.837724 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.837712    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.837824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.837812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.837862 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.837838    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.839570 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.839550    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.839671 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.839582    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.839671 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.839587    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.839671 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.839599    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.839671 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.839605    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.839671 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.839617    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.841088 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.841074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.841133 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.841099    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 21:06:08.841853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.841829    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 21:06:08.841961 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.841860    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 21:06:08.841961 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.841870    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeHasSufficientPID"
Sep 18 21:06:08.868539 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.868520    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-35.ec2.internal\" not found" node="ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.872893 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.872863    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-35.ec2.internal\" not found" node="ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.901311 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:08.901295    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:08.997391 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.997322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ea788e54b0bcc9e8cb0dd6d7a3cde7f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-35.ec2.internal\" (UID: \"1ea788e54b0bcc9e8cb0dd6d7a3cde7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.997391 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.997352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81374d4672a0752dedca996285801ca5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal\" (UID: \"81374d4672a0752dedca996285801ca5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:08.997391 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:08.997373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81374d4672a0752dedca996285801ca5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal\" (UID: \"81374d4672a0752dedca996285801ca5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.001353 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.001334    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.097500 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.097468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ea788e54b0bcc9e8cb0dd6d7a3cde7f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-35.ec2.internal\" (UID: \"1ea788e54b0bcc9e8cb0dd6d7a3cde7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.097500 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.097499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81374d4672a0752dedca996285801ca5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal\" (UID: \"81374d4672a0752dedca996285801ca5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.097694 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.097528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81374d4672a0752dedca996285801ca5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal\" (UID: \"81374d4672a0752dedca996285801ca5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.097694 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.097570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81374d4672a0752dedca996285801ca5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal\" (UID: \"81374d4672a0752dedca996285801ca5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.097694 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.097586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ea788e54b0bcc9e8cb0dd6d7a3cde7f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-35.ec2.internal\" (UID: \"1ea788e54b0bcc9e8cb0dd6d7a3cde7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.097694 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.097639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81374d4672a0752dedca996285801ca5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal\" (UID: \"81374d4672a0752dedca996285801ca5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.101841 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.101827    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.172879 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.172852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.177941 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.177747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:09.202272 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.202242    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.302825 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.302753    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.403240 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.403210    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.503771 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.503741    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.504848 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.504830    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 21:06:09.505014 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.504989    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 21:06:09.505069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.505008    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 21:06:09.593206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.593132    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:01:08 +0000 UTC" deadline="2028-06-11 12:32:51.52173165 +0000 UTC"
Sep 18 21:06:09.593206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.593160    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15159h26m41.928574272s"
Sep 18 21:06:09.604643 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.604625    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.705235 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.705207    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.805732 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.805704    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:09.814447 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:09.814399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea788e54b0bcc9e8cb0dd6d7a3cde7f.slice/crio-5f1536559808c94adde1e19d3eedc4876f52c4687a9596feaf63903394391a21 WatchSource:0}: Error finding container 5f1536559808c94adde1e19d3eedc4876f52c4687a9596feaf63903394391a21: Status 404 returned error can't find the container with id 5f1536559808c94adde1e19d3eedc4876f52c4687a9596feaf63903394391a21
Sep 18 21:06:09.815188 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:09.815166    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81374d4672a0752dedca996285801ca5.slice/crio-cb539f9c1a5cb6c3f221118377aa4b53c48ca7a24d5181026666ad655908851d WatchSource:0}: Error finding container cb539f9c1a5cb6c3f221118377aa4b53c48ca7a24d5181026666ad655908851d: Status 404 returned error can't find the container with id cb539f9c1a5cb6c3f221118377aa4b53c48ca7a24d5181026666ad655908851d
Sep 18 21:06:09.819855 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.819840    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 21:06:09.855718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:09.855664    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 21:06:09.906167 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:09.906146    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:10.006730 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.006702    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:10.107585 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.107509    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-35.ec2.internal\" not found"
Sep 18 21:06:10.108550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.108535    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 21:06:10.196756 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.196728    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:10.211419 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.211397    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 21:06:10.212311 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.212292    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal"
Sep 18 21:06:10.227386 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.227362    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 21:06:10.513271 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.513201    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 21:06:10.546176 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.546132    2576 apiserver.go:52] "Watching apiserver"
Sep 18 21:06:10.553842 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.553814    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 21:06:10.554289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.554254    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-ktb7j","openshift-network-operator/iptables-alerter-jqtn9","openshift-ovn-kubernetes/ovnkube-node-cvkfm","kube-system/global-pull-secret-syncer-l5vwq","kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal","openshift-cluster-node-tuning-operator/tuned-749mf","openshift-image-registry/node-ca-9bllf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal","openshift-multus/multus-additional-cni-plugins-7m2j2","openshift-multus/network-metrics-daemon-5j7sj","openshift-network-diagnostics/network-check-target-49t7h","kube-system/konnectivity-agent-cs4qk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr","openshift-dns/node-resolver-8f5mc"]
Sep 18 21:06:10.556270 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.555987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:10.556270 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.556071    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:10.557326 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.557226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:10.557326 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.557294    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:10.558343 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.558246    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.559903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.559622    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.560785 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.560591    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.560785 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.560641    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.560785 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.560597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mc7q5\""
Sep 18 21:06:10.561634 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.561614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.563039 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.563018    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 21:06:10.563102 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.563044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.563149 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.563128    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mkx42\""
Sep 18 21:06:10.563404 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.563325    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 21:06:10.564166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.563763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.565468    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.565783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.566234    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jnwtj\""
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.566278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.566390    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.566472    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.567168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.566561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c7cw4\""
Sep 18 21:06:10.567527 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.567248    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.568716 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.568350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.569958 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.569937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.570605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.570492    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 21:06:10.570605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.570498    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.570605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.570515    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.570908    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.570941    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571023    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbkpq\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571145    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571196    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4x6fl\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571235    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 21:06:10.571284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.570942    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.571643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571390    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fstlz\""
Sep 18 21:06:10.571643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571502    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.571643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.571554    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.572437 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.572038    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.572437 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.572104    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:10.572731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.572712    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 21:06:10.573454 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.573302    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w72wr\""
Sep 18 21:06:10.573816 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.573799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.577633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.577612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xmk5m\""
Sep 18 21:06:10.577709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.577640    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 21:06:10.577709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.577674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 21:06:10.577709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.577690    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 21:06:10.577909 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.577841    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 21:06:10.577968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.577950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 21:06:10.578160 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.578144    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 21:06:10.596346 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.596318    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 21:06:10.597964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.597946    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 21:06:10.606329 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-daemon-config\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.606427 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-multus-certs\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.606427 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24082157-d36f-4cf7-8026-b253225d4152-kubelet-config\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.606537 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-etc-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.606594 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-node-log\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.606645 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovn-node-metrics-cert\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.606645 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovnkube-script-lib\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.606740 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-lib-modules\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.606740 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-var-lib-kubelet\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.606740 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-device-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.606740 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d6rn\" (UniqueName: \"kubernetes.io/projected/bf89fb41-e985-491b-b82a-d0f63faf936b-kube-api-access-8d6rn\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.606935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjd2\" (UniqueName: \"kubernetes.io/projected/b796fb3a-f153-4c19-96b8-daaa56085f10-kube-api-access-xxjd2\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.606935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-sys-fs\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.606935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2pmp\" (UniqueName: \"kubernetes.io/projected/817febb1-5403-41f8-ade4-da4a971e15d5-kube-api-access-f2pmp\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.606935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-cnibin\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.606935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-k8s-cni-cncf-io\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-run-netns\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gblrd\" (UniqueName: \"kubernetes.io/projected/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-kube-api-access-gblrd\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.606998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b796fb3a-f153-4c19-96b8-daaa56085f10-tmp-dir\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysctl-d\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-systemd\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtf2n\" (UniqueName: \"kubernetes.io/projected/8237cc3e-b74f-4f96-abff-f229cb52524c-kube-api-access-vtf2n\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lslz\" (UniqueName: \"kubernetes.io/projected/908f8b7e-ee99-4230-a68d-a9802c560b09-kube-api-access-7lslz\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-cni-bin\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.607169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-etc-kubernetes\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-kubelet\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-var-lib-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-run\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-tuned\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-registration-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/072721b7-2162-4803-99b4-3ff1b3abc46f-agent-certs\") pod \"konnectivity-agent-cs4qk\" (UID: \"072721b7-2162-4803-99b4-3ff1b3abc46f\") " pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24082157-d36f-4cf7-8026-b253225d4152-dbus\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-systemd\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-kubernetes\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-tmp\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/817febb1-5403-41f8-ade4-da4a971e15d5-host-slash\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-conf-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/908f8b7e-ee99-4230-a68d-a9802c560b09-serviceca\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-env-overrides\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.607608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b796fb3a-f153-4c19-96b8-daaa56085f10-hosts-file\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-host\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvft\" (UniqueName: \"kubernetes.io/projected/f6961ea0-7e61-439c-af18-639cad7813a8-kube-api-access-9dvft\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-socket-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.607775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf89fb41-e985-491b-b82a-d0f63faf936b-cni-binary-copy\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-modprobe-d\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysconfig\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysctl-conf\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-kubelet\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-slash\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-cni-bin\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovnkube-config\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/072721b7-2162-4803-99b4-3ff1b3abc46f-konnectivity-ca\") pod \"konnectivity-agent-cs4qk\" (UID: \"072721b7-2162-4803-99b4-3ff1b3abc46f\") " pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.608447 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/908f8b7e-ee99-4230-a68d-a9802c560b09-host\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-cni-netd\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcfdt\" (UniqueName: \"kubernetes.io/projected/274fd151-b8df-43ac-8bc4-2c868fc0b90a-kube-api-access-dcfdt\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-cni-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/817febb1-5403-41f8-ade4-da4a971e15d5-iptables-alerter-script\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-system-cni-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-ovn\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-sys\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-system-cni-dir\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-cni-multus\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2mc\" (UniqueName: \"kubernetes.io/projected/218bcd00-2ea4-461f-b17d-d9f562e88ac7-kube-api-access-7c2mc\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.609143 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-hostroot\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-systemd-units\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-log-socket\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-cnibin\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-etc-selinux\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.608987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-socket-dir-parent\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.609911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.609008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-netns\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.610430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.610407    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 21:06:10.638685 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.638659    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q52ds"
Sep 18 21:06:10.646142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.646122    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 21:06:10.647503 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.647485    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q52ds"
Sep 18 21:06:10.710085 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-cni-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/817febb1-5403-41f8-ade4-da4a971e15d5-iptables-alerter-script\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710241    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.710253 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-run-ovn-kubernetes\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-system-cni-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710285    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-cni-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-ovn\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-ovn\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-sys\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-system-cni-dir\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-system-cni-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-sys\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-system-cni-dir\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-cni-multus\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-cni-multus\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2mc\" (UniqueName: \"kubernetes.io/projected/218bcd00-2ea4-461f-b17d-d9f562e88ac7-kube-api-access-7c2mc\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-hostroot\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-systemd-units\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-log-socket\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:10.710640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-cnibin\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-etc-selinux\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-socket-dir-parent\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-netns\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-netns\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-daemon-config\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-multus-certs\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-hostroot\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24082157-d36f-4cf7-8026-b253225d4152-kubelet-config\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710832    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6961ea0-7e61-439c-af18-639cad7813a8-cnibin\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-etc-selinux\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-etc-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/817febb1-5403-41f8-ade4-da4a971e15d5-iptables-alerter-script\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-multus-certs\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-node-log\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.711254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-etc-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-node-log\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovn-node-metrics-cert\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-log-socket\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-systemd-units\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.711004    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-socket-dir-parent\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.710977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovnkube-script-lib\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-lib-modules\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-var-lib-kubelet\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.711105    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:06:11.211085699 +0000 UTC m=+4.673865052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-var-lib-kubelet\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-device-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24082157-d36f-4cf7-8026-b253225d4152-kubelet-config\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d6rn\" (UniqueName: \"kubernetes.io/projected/bf89fb41-e985-491b-b82a-d0f63faf936b-kube-api-access-8d6rn\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-device-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjd2\" (UniqueName: \"kubernetes.io/projected/b796fb3a-f153-4c19-96b8-daaa56085f10-kube-api-access-xxjd2\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.712079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-lib-modules\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-sys-fs\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711241    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-sys-fs\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2pmp\" (UniqueName: \"kubernetes.io/projected/817febb1-5403-41f8-ade4-da4a971e15d5-kube-api-access-f2pmp\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-daemon-config\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-cnibin\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-k8s-cni-cncf-io\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-run-netns\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-cnibin\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gblrd\" (UniqueName: \"kubernetes.io/projected/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-kube-api-access-gblrd\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-run-netns\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-run-k8s-cni-cncf-io\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b796fb3a-f153-4c19-96b8-daaa56085f10-tmp-dir\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.711528    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovnkube-script-lib\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.711581    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:11.211564811 +0000 UTC m=+4.674344150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711613    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 21:06:10.712770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysctl-d\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-systemd\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtf2n\" (UniqueName: \"kubernetes.io/projected/8237cc3e-b74f-4f96-abff-f229cb52524c-kube-api-access-vtf2n\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-systemd\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysctl-d\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lslz\" (UniqueName: \"kubernetes.io/projected/908f8b7e-ee99-4230-a68d-a9802c560b09-kube-api-access-7lslz\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b796fb3a-f153-4c19-96b8-daaa56085f10-tmp-dir\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-cni-bin\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-etc-kubernetes\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-kubelet\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-var-lib-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-etc-kubernetes\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-run\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.711983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-cni-bin\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-var-lib-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-kubelet\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-tuned\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-run\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.713633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-registration-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/072721b7-2162-4803-99b4-3ff1b3abc46f-agent-certs\") pod \"konnectivity-agent-cs4qk\" (UID: \"072721b7-2162-4803-99b4-3ff1b3abc46f\") " pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-registration-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24082157-d36f-4cf7-8026-b253225d4152-dbus\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-systemd\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-kubernetes\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24082157-d36f-4cf7-8026-b253225d4152-dbus\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-tmp\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/817febb1-5403-41f8-ade4-da4a971e15d5-host-slash\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-openvswitch\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-conf-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/908f8b7e-ee99-4230-a68d-a9802c560b09-serviceca\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712299    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-run-systemd\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-kubernetes\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.714506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/817febb1-5403-41f8-ade4-da4a971e15d5-host-slash\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-multus-conf-dir\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-env-overrides\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b796fb3a-f153-4c19-96b8-daaa56085f10-hosts-file\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-host\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvft\" (UniqueName: \"kubernetes.io/projected/f6961ea0-7e61-439c-af18-639cad7813a8-kube-api-access-9dvft\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-socket-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf89fb41-e985-491b-b82a-d0f63faf936b-cni-binary-copy\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-modprobe-d\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysconfig\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysctl-conf\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-kubelet\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-slash\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-cni-bin\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovnkube-config\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/072721b7-2162-4803-99b4-3ff1b3abc46f-konnectivity-ca\") pod \"konnectivity-agent-cs4qk\" (UID: \"072721b7-2162-4803-99b4-3ff1b3abc46f\") " pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/908f8b7e-ee99-4230-a68d-a9802c560b09-host\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-cni-netd\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.712878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcfdt\" (UniqueName: \"kubernetes.io/projected/274fd151-b8df-43ac-8bc4-2c868fc0b90a-kube-api-access-dcfdt\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b796fb3a-f153-4c19-96b8-daaa56085f10-hosts-file\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-host\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8237cc3e-b74f-4f96-abff-f229cb52524c-socket-dir\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6961ea0-7e61-439c-af18-639cad7813a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf89fb41-e985-491b-b82a-d0f63faf936b-cni-binary-copy\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-env-overrides\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-modprobe-d\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.713985    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysconfig\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-sysctl-conf\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf89fb41-e985-491b-b82a-d0f63faf936b-host-var-lib-kubelet\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-slash\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-cni-bin\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/908f8b7e-ee99-4230-a68d-a9802c560b09-serviceca\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.715850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/908f8b7e-ee99-4230-a68d-a9802c560b09-host\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/218bcd00-2ea4-461f-b17d-d9f562e88ac7-host-cni-netd\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovnkube-config\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.714857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/072721b7-2162-4803-99b4-3ff1b3abc46f-konnectivity-ca\") pod \"konnectivity-agent-cs4qk\" (UID: \"072721b7-2162-4803-99b4-3ff1b3abc46f\") " pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.715024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-etc-tuned\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.715029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/218bcd00-2ea4-461f-b17d-d9f562e88ac7-ovn-node-metrics-cert\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.715175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/072721b7-2162-4803-99b4-3ff1b3abc46f-agent-certs\") pod \"konnectivity-agent-cs4qk\" (UID: \"072721b7-2162-4803-99b4-3ff1b3abc46f\") " pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.716423 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.715361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-tmp\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.720044 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.720026    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:10.720044 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.720046    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:10.720182 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.720058    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:10.720182 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:10.720114    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:11.220099213 +0000 UTC m=+4.682878562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:10.722782 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.722757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjd2\" (UniqueName: \"kubernetes.io/projected/b796fb3a-f153-4c19-96b8-daaa56085f10-kube-api-access-xxjd2\") pod \"node-resolver-8f5mc\" (UID: \"b796fb3a-f153-4c19-96b8-daaa56085f10\") " pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.723132 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.723109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2mc\" (UniqueName: \"kubernetes.io/projected/218bcd00-2ea4-461f-b17d-d9f562e88ac7-kube-api-access-7c2mc\") pod \"ovnkube-node-cvkfm\" (UID: \"218bcd00-2ea4-461f-b17d-d9f562e88ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:10.724987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.724963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lslz\" (UniqueName: \"kubernetes.io/projected/908f8b7e-ee99-4230-a68d-a9802c560b09-kube-api-access-7lslz\") pod \"node-ca-9bllf\" (UID: \"908f8b7e-ee99-4230-a68d-a9802c560b09\") " pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.725431 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.725405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtf2n\" (UniqueName: \"kubernetes.io/projected/8237cc3e-b74f-4f96-abff-f229cb52524c-kube-api-access-vtf2n\") pod \"aws-ebs-csi-driver-node-r52lr\" (UID: \"8237cc3e-b74f-4f96-abff-f229cb52524c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.726226 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.726203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gblrd\" (UniqueName: \"kubernetes.io/projected/5fd5e5fc-f776-4b93-af5f-973b4fdbfd20-kube-api-access-gblrd\") pod \"tuned-749mf\" (UID: \"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20\") " pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.726425 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.726391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcfdt\" (UniqueName: \"kubernetes.io/projected/274fd151-b8df-43ac-8bc4-2c868fc0b90a-kube-api-access-dcfdt\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:10.726664 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.726646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2pmp\" (UniqueName: \"kubernetes.io/projected/817febb1-5403-41f8-ade4-da4a971e15d5-kube-api-access-f2pmp\") pod \"iptables-alerter-jqtn9\" (UID: \"817febb1-5403-41f8-ade4-da4a971e15d5\") " pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.726840 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.726817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d6rn\" (UniqueName: \"kubernetes.io/projected/bf89fb41-e985-491b-b82a-d0f63faf936b-kube-api-access-8d6rn\") pod \"multus-ktb7j\" (UID: \"bf89fb41-e985-491b-b82a-d0f63faf936b\") " pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.727370 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.727354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvft\" (UniqueName: \"kubernetes.io/projected/f6961ea0-7e61-439c-af18-639cad7813a8-kube-api-access-9dvft\") pod \"multus-additional-cni-plugins-7m2j2\" (UID: \"f6961ea0-7e61-439c-af18-639cad7813a8\") " pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.741133 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.741085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal" event={"ID":"1ea788e54b0bcc9e8cb0dd6d7a3cde7f","Type":"ContainerStarted","Data":"5f1536559808c94adde1e19d3eedc4876f52c4687a9596feaf63903394391a21"}
Sep 18 21:06:10.742196 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.742173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal" event={"ID":"81374d4672a0752dedca996285801ca5","Type":"ContainerStarted","Data":"cb539f9c1a5cb6c3f221118377aa4b53c48ca7a24d5181026666ad655908851d"}
Sep 18 21:06:10.872971 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.872855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8f5mc"
Sep 18 21:06:10.880902 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.880868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-749mf"
Sep 18 21:06:10.890601 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.890577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:10.896318 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.896296    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bllf"
Sep 18 21:06:10.903103 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.903083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7m2j2"
Sep 18 21:06:10.913079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.913062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jqtn9"
Sep 18 21:06:10.921403 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.921386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr"
Sep 18 21:06:10.929067 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.929046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktb7j"
Sep 18 21:06:10.934029 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:10.934009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:11.216404 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.216308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:11.216404 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.216359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:11.216633 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.216467    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:11.216633 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.216533    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:12.216519892 +0000 UTC m=+5.679299227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:11.216633 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.216467    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:11.216633 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.216576    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:06:12.21656679 +0000 UTC m=+5.679346129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:11.317553 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.317523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:11.317730 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.317708    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:11.317785 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.317736    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:11.317785 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.317746    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:11.317864 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.317796    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:12.317782674 +0000 UTC m=+5.780562021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:11.625151 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:11.625112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb796fb3a_f153_4c19_96b8_daaa56085f10.slice/crio-01e1be144a6409c74abdf378204f8df9cd57be4101a8dd622af5d03b8e958d85 WatchSource:0}: Error finding container 01e1be144a6409c74abdf378204f8df9cd57be4101a8dd622af5d03b8e958d85: Status 404 returned error can't find the container with id 01e1be144a6409c74abdf378204f8df9cd57be4101a8dd622af5d03b8e958d85
Sep 18 21:06:11.627898 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:11.627835    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf89fb41_e985_491b_b82a_d0f63faf936b.slice/crio-accf369cdfd163fa8797845142c61da6367a86cdf7d8710585eea7f2eadb70bb WatchSource:0}: Error finding container accf369cdfd163fa8797845142c61da6367a86cdf7d8710585eea7f2eadb70bb: Status 404 returned error can't find the container with id accf369cdfd163fa8797845142c61da6367a86cdf7d8710585eea7f2eadb70bb
Sep 18 21:06:11.628420 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:11.628381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218bcd00_2ea4_461f_b17d_d9f562e88ac7.slice/crio-15d37f16d23c0b2396cf96999f582c0ceb878f283686d19cc03fa9e190fd0f78 WatchSource:0}: Error finding container 15d37f16d23c0b2396cf96999f582c0ceb878f283686d19cc03fa9e190fd0f78: Status 404 returned error can't find the container with id 15d37f16d23c0b2396cf96999f582c0ceb878f283686d19cc03fa9e190fd0f78
Sep 18 21:06:11.630683 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:11.630657    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072721b7_2162_4803_99b4_3ff1b3abc46f.slice/crio-ab907e19943bca2d43acf8354872788e2facbde1a9c89c6b77caf3b7ecae9a31 WatchSource:0}: Error finding container ab907e19943bca2d43acf8354872788e2facbde1a9c89c6b77caf3b7ecae9a31: Status 404 returned error can't find the container with id ab907e19943bca2d43acf8354872788e2facbde1a9c89c6b77caf3b7ecae9a31
Sep 18 21:06:11.631267 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:11.631247    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6961ea0_7e61_439c_af18_639cad7813a8.slice/crio-56068e628b8cff9887766f7fbd41ad55b27ca8fb24f3d3272eb4046bf94a44ff WatchSource:0}: Error finding container 56068e628b8cff9887766f7fbd41ad55b27ca8fb24f3d3272eb4046bf94a44ff: Status 404 returned error can't find the container with id 56068e628b8cff9887766f7fbd41ad55b27ca8fb24f3d3272eb4046bf94a44ff
Sep 18 21:06:11.632572 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:11.632197    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd5e5fc_f776_4b93_af5f_973b4fdbfd20.slice/crio-f62d91dd39a0bf6020ef3020c3490199bf0ff7839e067401492c97aacb71131c WatchSource:0}: Error finding container f62d91dd39a0bf6020ef3020c3490199bf0ff7839e067401492c97aacb71131c: Status 404 returned error can't find the container with id f62d91dd39a0bf6020ef3020c3490199bf0ff7839e067401492c97aacb71131c
Sep 18 21:06:11.649938 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.649909    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:01:10 +0000 UTC" deadline="2028-04-26 17:58:21.994690165 +0000 UTC"
Sep 18 21:06:11.649938 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.649936    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14060h52m10.344756713s"
Sep 18 21:06:11.734473 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.734424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:11.734625 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:11.734555    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:11.745540 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.745514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr" event={"ID":"8237cc3e-b74f-4f96-abff-f229cb52524c","Type":"ContainerStarted","Data":"873794e0899c2bac312ee1285ead73fee3fa7f4bdeb15d64b9c0a1d8c9c5d61e"}
Sep 18 21:06:11.746634 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.746606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cs4qk" event={"ID":"072721b7-2162-4803-99b4-3ff1b3abc46f","Type":"ContainerStarted","Data":"ab907e19943bca2d43acf8354872788e2facbde1a9c89c6b77caf3b7ecae9a31"}
Sep 18 21:06:11.747757 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.747737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktb7j" event={"ID":"bf89fb41-e985-491b-b82a-d0f63faf936b","Type":"ContainerStarted","Data":"accf369cdfd163fa8797845142c61da6367a86cdf7d8710585eea7f2eadb70bb"}
Sep 18 21:06:11.748797 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.748775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8f5mc" event={"ID":"b796fb3a-f153-4c19-96b8-daaa56085f10","Type":"ContainerStarted","Data":"01e1be144a6409c74abdf378204f8df9cd57be4101a8dd622af5d03b8e958d85"}
Sep 18 21:06:11.750574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.750554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal" event={"ID":"1ea788e54b0bcc9e8cb0dd6d7a3cde7f","Type":"ContainerStarted","Data":"55b29b20a6e795572372f975bf039ba64d0b00ceb257d86bd53fb02699810112"}
Sep 18 21:06:11.751687 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.751654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bllf" event={"ID":"908f8b7e-ee99-4230-a68d-a9802c560b09","Type":"ContainerStarted","Data":"62f4b11dbf3b5227bfa541a98bf857e545e4f72cc3093f7a29750f0942773214"}
Sep 18 21:06:11.752726 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.752708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"15d37f16d23c0b2396cf96999f582c0ceb878f283686d19cc03fa9e190fd0f78"}
Sep 18 21:06:11.753848 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.753823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jqtn9" event={"ID":"817febb1-5403-41f8-ade4-da4a971e15d5","Type":"ContainerStarted","Data":"207bed5b75a60ca28a4fa01fa2186bd984dee4bf10d7dfc7deca98b9d8129a5a"}
Sep 18 21:06:11.755157 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.755136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-749mf" event={"ID":"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20","Type":"ContainerStarted","Data":"f62d91dd39a0bf6020ef3020c3490199bf0ff7839e067401492c97aacb71131c"}
Sep 18 21:06:11.756250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.756228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerStarted","Data":"56068e628b8cff9887766f7fbd41ad55b27ca8fb24f3d3272eb4046bf94a44ff"}
Sep 18 21:06:11.765849 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:11.765813    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-35.ec2.internal" podStartSLOduration=1.765800578 podStartE2EDuration="1.765800578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:11.765602614 +0000 UTC m=+5.228381971" watchObservedRunningTime="2026-09-18 21:06:11.765800578 +0000 UTC m=+5.228579938"
Sep 18 21:06:12.224849 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.224513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:12.224849 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.224812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:12.225084 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.224983    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:12.225084 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.225048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:14.225030503 +0000 UTC m=+7.687809844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:12.225439 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.225422    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:12.225540 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.225481    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:06:14.225457273 +0000 UTC m=+7.688236614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:12.325636 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.325600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:12.325823 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.325807    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:12.325902 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.325832    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:12.325902 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.325844    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:12.326012 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.325938    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:14.325917736 +0000 UTC m=+7.788697085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:12.650661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.650545    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:01:10 +0000 UTC" deadline="2028-03-06 04:08:15.598722698 +0000 UTC"
Sep 18 21:06:12.650661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.650605    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12823h2m2.948121529s"
Sep 18 21:06:12.735441 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.734995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:12.735441 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.735126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:12.735665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.735609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:12.737639 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:12.735715    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:12.761662 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.761628    2576 generic.go:356] "Generic (PLEG): container finished" podID="81374d4672a0752dedca996285801ca5" containerID="df0bae31da56063faa228665f375206cd934a8ca95555c38daab3b17a597ddbf" exitCode=0
Sep 18 21:06:12.762035 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:12.762013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal" event={"ID":"81374d4672a0752dedca996285801ca5","Type":"ContainerDied","Data":"df0bae31da56063faa228665f375206cd934a8ca95555c38daab3b17a597ddbf"}
Sep 18 21:06:13.735402 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:13.735368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:13.735918 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:13.735505    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:13.771795 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:13.771757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal" event={"ID":"81374d4672a0752dedca996285801ca5","Type":"ContainerStarted","Data":"10a216d10aa0c7b455a2c2bd2c1167f1cb26340a7dfdd5d9648d8863cd777fc2"}
Sep 18 21:06:14.242315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:14.242258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:14.242498 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:14.242365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:14.242556 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.242503    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:14.242602 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.242566    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:06:18.242546436 +0000 UTC m=+11.705325773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:14.242851 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.242773    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:14.242851 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.242833    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:18.242817641 +0000 UTC m=+11.705596980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:14.343115 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:14.343076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:14.343295 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.343262    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:14.343295 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.343284    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:14.343295 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.343296    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:14.343422 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.343355    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:18.343337134 +0000 UTC m=+11.806116485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:14.735286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:14.735189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:14.735459 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.735333    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:14.735752 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:14.735708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:14.736343 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:14.735801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:15.735044 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:15.735011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:15.735195 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:15.735148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:16.735269 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:16.735207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:16.735708 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:16.735361    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:16.735708 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:16.735427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:16.735708 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:16.735529    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:17.734843 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:17.734813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:17.735039 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:17.734949    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:18.276251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:18.276208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:18.276702 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:18.276279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:18.276702 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.276420    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:18.276702 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.276487    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:26.276467758 +0000 UTC m=+19.739247093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:18.276702 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.276417    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:18.276702 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.276559    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:06:26.276540373 +0000 UTC m=+19.739319723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:18.378098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:18.377380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:18.378098 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.377589    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:18.378098 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.377611    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:18.378098 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.377623    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:18.378098 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.377684    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:26.37766491 +0000 UTC m=+19.840444264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:18.738950 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:18.738903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:18.739098 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.739036    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:18.739440 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:18.739420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:18.739561 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:18.739526    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:19.735035 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:19.734989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:19.735507 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:19.735125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:20.734978 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:20.734939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:20.735164 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:20.734952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:20.735164 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:20.735082    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:20.735164 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:20.735154    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:21.734482 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:21.734444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:21.734664 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:21.734552    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:22.734744 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:22.734707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:22.734744 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:22.734733    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:22.735257 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:22.734843    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:22.735257 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:22.734980    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:23.734789 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:23.734751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:23.735203 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:23.734876    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:24.734929 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:24.734880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:24.735347 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:24.735046    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:24.735347 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:24.735097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:24.735347 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:24.735211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:25.735124 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:25.735080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:25.735690 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:25.735203    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:26.330945 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:26.330908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:26.330945 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:26.330954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:26.331192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.331052    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:26.331192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.331061    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:26.331192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.331117    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:42.331102035 +0000 UTC m=+35.793881371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:26.331192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.331132    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:06:42.331124758 +0000 UTC m=+35.793904093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:26.432226 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:26.432186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:26.432422 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.432372    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:26.432422 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.432396    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:26.432422 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.432408    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:26.432577 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.432478    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:06:42.43245934 +0000 UTC m=+35.895238690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:26.735051 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:26.734976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:26.735213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:26.734976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:26.735213 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.735111    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:26.735213 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:26.735188    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:27.734986 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:27.734948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:27.735163 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:27.735066    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:28.737778 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.737608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:28.738396 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.737673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:28.738396 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:28.737945    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:28.738396 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:28.737973    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:28.806277 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.806208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cs4qk" event={"ID":"072721b7-2162-4803-99b4-3ff1b3abc46f","Type":"ContainerStarted","Data":"ee16eccf188b6f3af8f8b2d389ce114b64b94f31edee4f5b4209fbbcd841ea88"}
Sep 18 21:06:28.807742 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.807717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktb7j" event={"ID":"bf89fb41-e985-491b-b82a-d0f63faf936b","Type":"ContainerStarted","Data":"4a736b4caafa8ccad9448e02f5265df6e032a9f5dd32c2a5150dc4b26596a3e5"}
Sep 18 21:06:28.809117 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.809094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8f5mc" event={"ID":"b796fb3a-f153-4c19-96b8-daaa56085f10","Type":"ContainerStarted","Data":"901e20e1504610414e662c9235a83315eb3469321beac926fc6d94e08d32dbfe"}
Sep 18 21:06:28.810640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.810619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bllf" event={"ID":"908f8b7e-ee99-4230-a68d-a9802c560b09","Type":"ContainerStarted","Data":"3885d8a981ce880d12164639f9565e202bf9f5e8aeada39015c54c2b216c8940"}
Sep 18 21:06:28.812512 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.812493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"0acb40c6c976fc8205e60d9a776139237e409a6eb2883e097ea10835d668842b"}
Sep 18 21:06:28.812608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.812564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"14075a0e7e34487f01ea48414423c193b7154ad5bd3869307a374c7e45076cb2"}
Sep 18 21:06:28.813874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.813858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-749mf" event={"ID":"5fd5e5fc-f776-4b93-af5f-973b4fdbfd20","Type":"ContainerStarted","Data":"e4c4b77ee9ef84cfb739ddb89b52d99fc2e4ec31038bd9b76c92ea51103753e1"}
Sep 18 21:06:28.815733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.815705    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6961ea0-7e61-439c-af18-639cad7813a8" containerID="87b2005d0b20a6e91e829719e2bd4ec3c4e8c6ad2f630103574f93d3f06f4943" exitCode=0
Sep 18 21:06:28.815820 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.815803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerDied","Data":"87b2005d0b20a6e91e829719e2bd4ec3c4e8c6ad2f630103574f93d3f06f4943"}
Sep 18 21:06:28.819663 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.819413    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr" event={"ID":"8237cc3e-b74f-4f96-abff-f229cb52524c","Type":"ContainerStarted","Data":"56cc4c6f0b94827e8b57e86be03c03547ea9dc3eb24e98971d476facbf1ac851"}
Sep 18 21:06:28.828853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.828807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-35.ec2.internal" podStartSLOduration=18.828794253 podStartE2EDuration="18.828794253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:13.790932515 +0000 UTC m=+7.253711873" watchObservedRunningTime="2026-09-18 21:06:28.828794253 +0000 UTC m=+22.291573609"
Sep 18 21:06:28.829037 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.829015    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cs4qk" podStartSLOduration=11.238472167 podStartE2EDuration="20.829010088s" totalImagesPullingTime="9.590537921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:28.828116607 +0000 UTC m=+22.290895963" watchObservedRunningTime="2026-09-18 21:06:28.829010088 +0000 UTC m=+22.291789444"
Sep 18 21:06:28.849634 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.849580    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8f5mc" podStartSLOduration=4.031908653 podStartE2EDuration="20.849558594s" totalImagesPullingTime="16.817649941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:28.848771564 +0000 UTC m=+22.311550923" watchObservedRunningTime="2026-09-18 21:06:28.849558594 +0000 UTC m=+22.312337951"
Sep 18 21:06:28.865764 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.865723    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bllf" podStartSLOduration=4.056884015 podStartE2EDuration="20.865708236s" totalImagesPullingTime="16.808824221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:28.865435913 +0000 UTC m=+22.328215270" watchObservedRunningTime="2026-09-18 21:06:28.865708236 +0000 UTC m=+22.328487592"
Sep 18 21:06:28.926330 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.926289    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-749mf" podStartSLOduration=4.115720327 podStartE2EDuration="20.926273442s" totalImagesPullingTime="16.810553115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:28.926086939 +0000 UTC m=+22.388866295" watchObservedRunningTime="2026-09-18 21:06:28.926273442 +0000 UTC m=+22.389052798"
Sep 18 21:06:28.951213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:28.951172    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ktb7j" podStartSLOduration=4.098403161 podStartE2EDuration="20.951157494s" totalImagesPullingTime="16.852754333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:28.950606336 +0000 UTC m=+22.413385693" watchObservedRunningTime="2026-09-18 21:06:28.951157494 +0000 UTC m=+22.413936851"
Sep 18 21:06:29.638180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.638150    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 21:06:29.666550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.666449    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T21:06:29.638170272Z","UUID":"6315eaad-ebfb-4d21-975d-a2d4e8715c60","Handler":null,"Name":"","Endpoint":""}
Sep 18 21:06:29.668243 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.668209    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 21:06:29.668243 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.668246    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 21:06:29.735389 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.735347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:29.735573 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:29.735493    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:29.825459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.825428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"61fc8facae1b85ae57db2ff9b32250f9179304d57531c9e8a7b13628820d6326"}
Sep 18 21:06:29.825866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.825520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"5e24ff851d50089f2c6b6d025119df82536a8aa4bdd14de925f57fc19ee47b7d"}
Sep 18 21:06:29.825866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.825567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"cc037a98b674b40ff5af1cbc81110c0891495abb8666b34e38eba15b63c79f47"}
Sep 18 21:06:29.825866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.825609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"844bcb56d275e6391037cc3fb7058852d6225ee07ca634ab78f4319565078905"}
Sep 18 21:06:29.827513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:29.827490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr" event={"ID":"8237cc3e-b74f-4f96-abff-f229cb52524c","Type":"ContainerStarted","Data":"2c865c50530a9de89fd0ac4b13f26e195189306c834811fe5822f282e9fac4bf"}
Sep 18 21:06:30.735350 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:30.735320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:30.735531 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:30.735480    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:30.735621 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:30.735598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:30.735740 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:30.735716    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:30.832190 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:30.832155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jqtn9" event={"ID":"817febb1-5403-41f8-ade4-da4a971e15d5","Type":"ContainerStarted","Data":"89e1edb80ba8f5a76e33a444d7e01bc0183334c50f86cef619dd7e2fc621d37d"}
Sep 18 21:06:30.834576 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:30.834550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr" event={"ID":"8237cc3e-b74f-4f96-abff-f229cb52524c","Type":"ContainerStarted","Data":"bdd4056d9481cad76fcc5429023639731a5b317910d95d3d193a2248533af3eb"}
Sep 18 21:06:30.883036 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:30.882987    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jqtn9" podStartSLOduration=6.073916605 podStartE2EDuration="22.882970058s" totalImagesPullingTime="16.809053453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:30.856061785 +0000 UTC m=+24.318841143" watchObservedRunningTime="2026-09-18 21:06:30.882970058 +0000 UTC m=+24.345749414"
Sep 18 21:06:30.883631 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:30.883591    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r52lr" podStartSLOduration=4.382117131 podStartE2EDuration="22.883576582s" totalImagesPullingTime="18.501459451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:30.88238934 +0000 UTC m=+24.345168696" watchObservedRunningTime="2026-09-18 21:06:30.883576582 +0000 UTC m=+24.346355952"
Sep 18 21:06:31.734502 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:31.734476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:31.734677 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:31.734587    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:31.840168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:31.840128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"c5ed725bf3aeb7f73c086d64456c633904f79f049bd0b026982649abc6088dd7"}
Sep 18 21:06:32.735217 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:32.735178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:32.735397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:32.735178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:32.735397 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:32.735325    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:32.735397 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:32.735350    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:32.851384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:32.851354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:32.851919 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:32.851900    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:33.735388 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.735163    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:33.735518 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:33.735423    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:33.848092 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.848052    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6961ea0-7e61-439c-af18-639cad7813a8" containerID="116e65e2668bcee15befc9645bbfee910caac06b891649ea5377e7e9a1f97eb9" exitCode=0
Sep 18 21:06:33.848249 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.848134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerDied","Data":"116e65e2668bcee15befc9645bbfee910caac06b891649ea5377e7e9a1f97eb9"}
Sep 18 21:06:33.852107 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.852081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" event={"ID":"218bcd00-2ea4-461f-b17d-d9f562e88ac7","Type":"ContainerStarted","Data":"5ef00bfd22044235a2286ac1e723e5c0b6bc7ce187ec56e66e232346b5586ed8"}
Sep 18 21:06:33.852759 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.852372    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:33.852798 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.852761    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cs4qk"
Sep 18 21:06:33.929056 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:33.929012    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm" podStartSLOduration=8.096864174 podStartE2EDuration="24.928995548s" totalImagesPullingTime="16.832131374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:33.927800257 +0000 UTC m=+27.390579613" watchObservedRunningTime="2026-09-18 21:06:33.928995548 +0000 UTC m=+27.391774905"
Sep 18 21:06:34.735310 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.735275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:34.735474 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:34.735381    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:34.735474 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.735431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:34.735580 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:34.735528    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:34.855269 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.855233    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:34.855662 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.855302    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:34.855662 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.855344    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:34.870389 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.870366    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:34.870510 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:34.870483    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:06:35.345002 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.344962    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5j7sj"]
Sep 18 21:06:35.345165 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.345069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:35.345208 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:35.345177    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:35.349688 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.349338    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5vwq"]
Sep 18 21:06:35.349688 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.349499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:35.349688 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:35.349640    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:35.351455 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.350174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49t7h"]
Sep 18 21:06:35.351455 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.350279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:35.351455 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:35.350385    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:35.859254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.859219    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6961ea0-7e61-439c-af18-639cad7813a8" containerID="d76edb99f785ddf9d8a8eb4d9a3fe269279fb21785952e03fdda19afa36cc5a8" exitCode=0
Sep 18 21:06:35.859648 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:35.859303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerDied","Data":"d76edb99f785ddf9d8a8eb4d9a3fe269279fb21785952e03fdda19afa36cc5a8"}
Sep 18 21:06:36.735235 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:36.735204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:36.735453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:36.735202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:36.735453 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:36.735324    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:36.735453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:36.735202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:36.735453 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:36.735373    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:36.735587 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:36.735454    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:37.865867 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:37.865831    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6961ea0-7e61-439c-af18-639cad7813a8" containerID="f2cd05f115f60b62c76b78483232130f369c77aa428d2bb90c8dafc6dfebcd38" exitCode=0
Sep 18 21:06:37.866229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:37.865903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerDied","Data":"f2cd05f115f60b62c76b78483232130f369c77aa428d2bb90c8dafc6dfebcd38"}
Sep 18 21:06:38.736071 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:38.736038    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:38.736251 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:38.736126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:38.736251 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:38.736231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:38.736366 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:38.736344    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:38.736431 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:38.736417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:38.736536 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:38.736515    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:40.735569 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:40.735368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:40.735987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:40.735372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:40.735987 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:40.735648    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vwq" podUID="24082157-d36f-4cf7-8026-b253225d4152"
Sep 18 21:06:40.735987 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:40.735750    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5j7sj" podUID="274fd151-b8df-43ac-8bc4-2c868fc0b90a"
Sep 18 21:06:40.735987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:40.735397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:40.735987 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:40.735847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49t7h" podUID="686cde34-64fa-4f4d-9f48-3db92136b743"
Sep 18 21:06:41.523858 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.523827    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-35.ec2.internal" event="NodeReady"
Sep 18 21:06:41.524045 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.523991    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 21:06:41.637734 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.637704    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cp56w"]
Sep 18 21:06:41.668689 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.668646    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jsgl9"]
Sep 18 21:06:41.668862 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.668762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.673261 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.673236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 21:06:41.673368 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.673288    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d4xcf\""
Sep 18 21:06:41.674967 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.674950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 21:06:41.684610 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.684590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.688581 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.688552    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 21:06:41.688695 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.688599    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 21:06:41.689416 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.689400    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 21:06:41.690264 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.690178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdg2h\""
Sep 18 21:06:41.726866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.726835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cp56w"]
Sep 18 21:06:41.727474 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.727456    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jsgl9"]
Sep 18 21:06:41.734357 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.734330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc0ad977-a226-4180-bf03-2073ead4e8ee-tmp-dir\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.734459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.734384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp268\" (UniqueName: \"kubernetes.io/projected/bc0ad977-a226-4180-bf03-2073ead4e8ee-kube-api-access-dp268\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.734459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.734411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc0ad977-a226-4180-bf03-2073ead4e8ee-config-volume\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.734572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.734475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfldv\" (UniqueName: \"kubernetes.io/projected/e137c6da-eae6-42c9-a221-e0aa00d55d47-kube-api-access-mfldv\") pod \"ingress-canary-jsgl9\" (UID: \"e137c6da-eae6-42c9-a221-e0aa00d55d47\") " pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.734572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.734547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e137c6da-eae6-42c9-a221-e0aa00d55d47-cert\") pod \"ingress-canary-jsgl9\" (UID: \"e137c6da-eae6-42c9-a221-e0aa00d55d47\") " pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.734654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.734580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.835841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.835813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfldv\" (UniqueName: \"kubernetes.io/projected/e137c6da-eae6-42c9-a221-e0aa00d55d47-kube-api-access-mfldv\") pod \"ingress-canary-jsgl9\" (UID: \"e137c6da-eae6-42c9-a221-e0aa00d55d47\") " pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.835859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e137c6da-eae6-42c9-a221-e0aa00d55d47-cert\") pod \"ingress-canary-jsgl9\" (UID: \"e137c6da-eae6-42c9-a221-e0aa00d55d47\") " pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.835901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.835936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc0ad977-a226-4180-bf03-2073ead4e8ee-tmp-dir\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.835954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp268\" (UniqueName: \"kubernetes.io/projected/bc0ad977-a226-4180-bf03-2073ead4e8ee-kube-api-access-dp268\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.835973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc0ad977-a226-4180-bf03-2073ead4e8ee-config-volume\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:41.836057    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:06:41.836267 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:41.836136    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:06:42.336120114 +0000 UTC m=+35.798899449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:06:41.836548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.836413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc0ad977-a226-4180-bf03-2073ead4e8ee-tmp-dir\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.836582 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.836552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc0ad977-a226-4180-bf03-2073ead4e8ee-config-volume\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.839822 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.839799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e137c6da-eae6-42c9-a221-e0aa00d55d47-cert\") pod \"ingress-canary-jsgl9\" (UID: \"e137c6da-eae6-42c9-a221-e0aa00d55d47\") " pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.846705 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.846686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfldv\" (UniqueName: \"kubernetes.io/projected/e137c6da-eae6-42c9-a221-e0aa00d55d47-kube-api-access-mfldv\") pod \"ingress-canary-jsgl9\" (UID: \"e137c6da-eae6-42c9-a221-e0aa00d55d47\") " pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:41.848124 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.848107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp268\" (UniqueName: \"kubernetes.io/projected/bc0ad977-a226-4180-bf03-2073ead4e8ee-kube-api-access-dp268\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:41.995704 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:41.995628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jsgl9"
Sep 18 21:06:42.340318 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.340295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:42.340413 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.340327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:42.340413 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.340366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:42.340479 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.340441    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:06:42.340510 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.340487    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:42.340510 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.340498    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:06:43.340479837 +0000 UTC m=+36.803259177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:06:42.340577 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.340520    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret podName:24082157-d36f-4cf7-8026-b253225d4152 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:14.340511485 +0000 UTC m=+67.803290834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret") pod "global-pull-secret-syncer-l5vwq" (UID: "24082157-d36f-4cf7-8026-b253225d4152") : object "kube-system"/"original-pull-secret" not registered
Sep 18 21:06:42.340577 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.340523    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:42.340656 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.340643    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:07:14.340623133 +0000 UTC m=+67.803402471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 21:06:42.441054 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.441022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:42.441218 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.441200    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 21:06:42.441293 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.441226    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 21:06:42.441293 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.441236    2576 projected.go:196] Error preparing data for projected volume kube-api-access-sk524 for pod openshift-network-diagnostics/network-check-target-49t7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:42.441293 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:42.441285    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524 podName:686cde34-64fa-4f4d-9f48-3db92136b743 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:14.441271323 +0000 UTC m=+67.904050670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sk524" (UniqueName: "kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524") pod "network-check-target-49t7h" (UID: "686cde34-64fa-4f4d-9f48-3db92136b743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 21:06:42.471978 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.471935    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jsgl9"]
Sep 18 21:06:42.475847 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:06:42.475822    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode137c6da_eae6_42c9_a221_e0aa00d55d47.slice/crio-28b5d84967d351205ddd427e21b61bac4bac5e2ba192945d997e014f4d392df9 WatchSource:0}: Error finding container 28b5d84967d351205ddd427e21b61bac4bac5e2ba192945d997e014f4d392df9: Status 404 returned error can't find the container with id 28b5d84967d351205ddd427e21b61bac4bac5e2ba192945d997e014f4d392df9
Sep 18 21:06:42.735474 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.735438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:06:42.735661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.735439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:06:42.735661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.735439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:06:42.738818 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.738790    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6vrc\""
Sep 18 21:06:42.738818 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.738804    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 21:06:42.739006 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.738817    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 21:06:42.739006 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.738848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xrfdl\""
Sep 18 21:06:42.739006 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.738871    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 21:06:42.739006 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.738911    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 21:06:42.878787 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.878583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jsgl9" event={"ID":"e137c6da-eae6-42c9-a221-e0aa00d55d47","Type":"ContainerStarted","Data":"28b5d84967d351205ddd427e21b61bac4bac5e2ba192945d997e014f4d392df9"}
Sep 18 21:06:42.881388 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.881366    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6961ea0-7e61-439c-af18-639cad7813a8" containerID="427d0fe9dadb4a229c3a701de18f77e3aa82bbd25bc0cb9fd9e2840e3c5082ac" exitCode=0
Sep 18 21:06:42.881486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:42.881408    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerDied","Data":"427d0fe9dadb4a229c3a701de18f77e3aa82bbd25bc0cb9fd9e2840e3c5082ac"}
Sep 18 21:06:43.347203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:43.347170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:43.347377 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:43.347324    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:06:43.347446 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:43.347405    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:06:45.347383018 +0000 UTC m=+38.810162368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:06:43.886899 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:43.886854    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6961ea0-7e61-439c-af18-639cad7813a8" containerID="f6e873f896231167ebefb7f624e059d3736975dcc1e71216b1a607708ac0bf5d" exitCode=0
Sep 18 21:06:43.887244 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:43.886925    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerDied","Data":"f6e873f896231167ebefb7f624e059d3736975dcc1e71216b1a607708ac0bf5d"}
Sep 18 21:06:44.893017 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:44.892989    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" event={"ID":"f6961ea0-7e61-439c-af18-639cad7813a8","Type":"ContainerStarted","Data":"c140982dd45abc818a51ada73489c0af1669ab47fb9c1423dad4f446f4492da1"}
Sep 18 21:06:44.923674 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:44.923626    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7m2j2" podStartSLOduration=9.368159712 podStartE2EDuration="36.923611636s" totalImagesPullingTime="27.555451924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:44.922331863 +0000 UTC m=+38.385111217" watchObservedRunningTime="2026-09-18 21:06:44.923611636 +0000 UTC m=+38.386390992"
Sep 18 21:06:45.363152 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:45.363116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:45.363286 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:45.363265    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:06:45.363340 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:45.363332    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:06:49.363317098 +0000 UTC m=+42.826096446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:06:45.896952 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:45.896915    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jsgl9" event={"ID":"e137c6da-eae6-42c9-a221-e0aa00d55d47","Type":"ContainerStarted","Data":"6a8bebbcdbbe10d8a6a3aa0ecf6affdd8054289312d1fb9094e5e381e510b61f"}
Sep 18 21:06:45.915664 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:45.915605    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jsgl9" podStartSLOduration=2.507495245 podStartE2EDuration="4.915588713s" totalImagesPullingTime="2.408093468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:06:45.914236431 +0000 UTC m=+39.377015788" watchObservedRunningTime="2026-09-18 21:06:45.915588713 +0000 UTC m=+39.378368107"
Sep 18 21:06:49.388291 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:49.388241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:49.388673 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:49.388386    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:06:49.388673 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:49.388444    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:06:57.38842685 +0000 UTC m=+50.851206201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:06:57.439668 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:06:57.439626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:06:57.440213 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:57.439783    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:06:57.440213 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:06:57.439865    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:07:13.439845848 +0000 UTC m=+66.902625188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:07:06.871235 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:06.871207    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cvkfm"
Sep 18 21:07:13.448366 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:13.448326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:07:13.448756 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:13.448469    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 21:07:13.448756 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:13.448544    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls podName:bc0ad977-a226-4180-bf03-2073ead4e8ee nodeName:}" failed. No retries permitted until 2026-09-18 21:07:45.4485261 +0000 UTC m=+98.911305454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls") pod "dns-default-cp56w" (UID: "bc0ad977-a226-4180-bf03-2073ead4e8ee") : secret "dns-default-metrics-tls" not found
Sep 18 21:07:14.354722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.354687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:07:14.354722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.354730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:07:14.357328 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.357307    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 21:07:14.357400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.357383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 21:07:14.365256 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:14.365233    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 21:07:14.365338 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:14.365301    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs podName:274fd151-b8df-43ac-8bc4-2c868fc0b90a nodeName:}" failed. No retries permitted until 2026-09-18 21:08:18.36528576 +0000 UTC m=+131.828065096 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs") pod "network-metrics-daemon-5j7sj" (UID: "274fd151-b8df-43ac-8bc4-2c868fc0b90a") : secret "metrics-daemon-secret" not found
Sep 18 21:07:14.368435 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.368413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24082157-d36f-4cf7-8026-b253225d4152-original-pull-secret\") pod \"global-pull-secret-syncer-l5vwq\" (UID: \"24082157-d36f-4cf7-8026-b253225d4152\") " pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:07:14.455220 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.455164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:07:14.458044 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.458026    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 21:07:14.468548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.468529    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 21:07:14.478714 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.478691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk524\" (UniqueName: \"kubernetes.io/projected/686cde34-64fa-4f4d-9f48-3db92136b743-kube-api-access-sk524\") pod \"network-check-target-49t7h\" (UID: \"686cde34-64fa-4f4d-9f48-3db92136b743\") " pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:07:14.553857 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.553827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xrfdl\""
Sep 18 21:07:14.554911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.554896    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vwq"
Sep 18 21:07:14.561484 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.561465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:07:14.825007 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.824978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5vwq"]
Sep 18 21:07:14.828327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.828299    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49t7h"]
Sep 18 21:07:14.828534 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:14.828511    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24082157_d36f_4cf7_8026_b253225d4152.slice/crio-f6951415ca972230b760ffb56a85979f1ea3cb8f1e0084eeb7d79e72d6dca70b WatchSource:0}: Error finding container f6951415ca972230b760ffb56a85979f1ea3cb8f1e0084eeb7d79e72d6dca70b: Status 404 returned error can't find the container with id f6951415ca972230b760ffb56a85979f1ea3cb8f1e0084eeb7d79e72d6dca70b
Sep 18 21:07:14.831010 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:14.830989    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686cde34_64fa_4f4d_9f48_3db92136b743.slice/crio-ff1d0f6e3f8b6ee28c20c7e6f36beef39aabca451ae93a729284755221d25587 WatchSource:0}: Error finding container ff1d0f6e3f8b6ee28c20c7e6f36beef39aabca451ae93a729284755221d25587: Status 404 returned error can't find the container with id ff1d0f6e3f8b6ee28c20c7e6f36beef39aabca451ae93a729284755221d25587
Sep 18 21:07:14.964010 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.963924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49t7h" event={"ID":"686cde34-64fa-4f4d-9f48-3db92136b743","Type":"ContainerStarted","Data":"ff1d0f6e3f8b6ee28c20c7e6f36beef39aabca451ae93a729284755221d25587"}
Sep 18 21:07:14.964926 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:14.964905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5vwq" event={"ID":"24082157-d36f-4cf7-8026-b253225d4152","Type":"ContainerStarted","Data":"f6951415ca972230b760ffb56a85979f1ea3cb8f1e0084eeb7d79e72d6dca70b"}
Sep 18 21:07:16.319866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.319830    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"]
Sep 18 21:07:16.321831 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.321805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.324580 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.324219    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"]
Sep 18 21:07:16.325126 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.324973    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 18 21:07:16.325833 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.325482    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bpl2f\""
Sep 18 21:07:16.325833 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.325694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 18 21:07:16.326013 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.325862    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 18 21:07:16.326069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.326048    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 18 21:07:16.326356 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.326338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"
Sep 18 21:07:16.328854 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.328817    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 18 21:07:16.329230 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.329203    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2ssnq\""
Sep 18 21:07:16.329435 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.329412    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 18 21:07:16.333129 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.332377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"]
Sep 18 21:07:16.340335 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.340313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"]
Sep 18 21:07:16.472624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.472522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-serving-cert\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.472624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.472575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-config\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.472843 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.472662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8gbt\" (UniqueName: \"kubernetes.io/projected/dfe498fb-6015-4a54-8ab1-8cd42b38a672-kube-api-access-w8gbt\") pod \"volume-data-source-validator-5c4db8bdf9-8jqcn\" (UID: \"dfe498fb-6015-4a54-8ab1-8cd42b38a672\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"
Sep 18 21:07:16.472843 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.472707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bs7j\" (UniqueName: \"kubernetes.io/projected/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-kube-api-access-5bs7j\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.538522 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.538486    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f75549b6d-nxsnx"]
Sep 18 21:07:16.540472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.540425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.543021 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.542993    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 21:07:16.543151 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.543049    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 21:07:16.543151 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.543051    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4szv9\""
Sep 18 21:07:16.543276 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.542995    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 21:07:16.543382 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.543351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 21:07:16.543552 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.543533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 21:07:16.543629 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.543554    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 21:07:16.558541 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.558508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f75549b6d-nxsnx"]
Sep 18 21:07:16.573452 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.573380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-serving-cert\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.573452 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.573429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-config\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.573614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.573473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8gbt\" (UniqueName: \"kubernetes.io/projected/dfe498fb-6015-4a54-8ab1-8cd42b38a672-kube-api-access-w8gbt\") pod \"volume-data-source-validator-5c4db8bdf9-8jqcn\" (UID: \"dfe498fb-6015-4a54-8ab1-8cd42b38a672\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"
Sep 18 21:07:16.573614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.573539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bs7j\" (UniqueName: \"kubernetes.io/projected/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-kube-api-access-5bs7j\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.574371 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.574326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-config\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.576165 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.576144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-serving-cert\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.582733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.582704    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bs7j\" (UniqueName: \"kubernetes.io/projected/c4aced95-7f7d-4d65-ab23-f93bdab00fdb-kube-api-access-5bs7j\") pod \"service-ca-operator-57cdc4b768-jf725\" (UID: \"c4aced95-7f7d-4d65-ab23-f93bdab00fdb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.582855 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.582836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8gbt\" (UniqueName: \"kubernetes.io/projected/dfe498fb-6015-4a54-8ab1-8cd42b38a672-kube-api-access-w8gbt\") pod \"volume-data-source-validator-5c4db8bdf9-8jqcn\" (UID: \"dfe498fb-6015-4a54-8ab1-8cd42b38a672\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"
Sep 18 21:07:16.635762 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.635713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"
Sep 18 21:07:16.643133 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.643099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"
Sep 18 21:07:16.674603 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.674578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.674731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.674646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcxdd\" (UniqueName: \"kubernetes.io/projected/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-kube-api-access-fcxdd\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.674731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.674689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-stats-auth\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.674731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.674725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-default-certificate\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.674908 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.674752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.775815 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.775783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-default-certificate\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.775993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.775824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.775993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.775869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.775993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.775931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxdd\" (UniqueName: \"kubernetes.io/projected/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-kube-api-access-fcxdd\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.775993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.775968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-stats-auth\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.776192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:16.776029    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 21:07:16.776192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:16.776088    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:17.276067075 +0000 UTC m=+70.738846427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : configmap references non-existent config key: service-ca.crt
Sep 18 21:07:16.776192 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:16.776117    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:17.276105048 +0000 UTC m=+70.738884400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : secret "router-metrics-certs-default" not found
Sep 18 21:07:16.778968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.778946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-default-certificate\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.779078 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.779017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-stats-auth\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:16.786121 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:16.786079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcxdd\" (UniqueName: \"kubernetes.io/projected/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-kube-api-access-fcxdd\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:17.278898 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:17.278854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:17.279077 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:17.278917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:17.279077 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:17.279023    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 21:07:17.279077 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:17.279045    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:18.279029271 +0000 UTC m=+71.741808607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : configmap references non-existent config key: service-ca.crt
Sep 18 21:07:17.279213 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:17.279090    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:18.279071305 +0000 UTC m=+71.741850648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : secret "router-metrics-certs-default" not found
Sep 18 21:07:18.286459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:18.286412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:18.286936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:18.286477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:18.286936 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:18.286575    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 21:07:18.286936 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:18.286643    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:20.2866206 +0000 UTC m=+73.749399953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : configmap references non-existent config key: service-ca.crt
Sep 18 21:07:18.286936 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:18.286673    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:20.286661953 +0000 UTC m=+73.749441318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : secret "router-metrics-certs-default" not found
Sep 18 21:07:19.256653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.256570    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn"]
Sep 18 21:07:19.262174 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.262054    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725"]
Sep 18 21:07:19.266379 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:19.266255    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4aced95_7f7d_4d65_ab23_f93bdab00fdb.slice/crio-8f3ea3add57e10fee0e15500cef18616ad69266afab63d26d01c3fd0a67702a2 WatchSource:0}: Error finding container 8f3ea3add57e10fee0e15500cef18616ad69266afab63d26d01c3fd0a67702a2: Status 404 returned error can't find the container with id 8f3ea3add57e10fee0e15500cef18616ad69266afab63d26d01c3fd0a67702a2
Sep 18 21:07:19.981727 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.981685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725" event={"ID":"c4aced95-7f7d-4d65-ab23-f93bdab00fdb","Type":"ContainerStarted","Data":"8f3ea3add57e10fee0e15500cef18616ad69266afab63d26d01c3fd0a67702a2"}
Sep 18 21:07:19.983090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.983059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn" event={"ID":"dfe498fb-6015-4a54-8ab1-8cd42b38a672","Type":"ContainerStarted","Data":"4851ab3525400723d62dc6a18b25d9d322dfdc968b0090289ccf8b8c16f395ea"}
Sep 18 21:07:19.984862 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.984824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49t7h" event={"ID":"686cde34-64fa-4f4d-9f48-3db92136b743","Type":"ContainerStarted","Data":"293c6281ff3951621dec7325e5e333f049575d6da5cf43c848fc286166932469"}
Sep 18 21:07:19.985062 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.985040    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:07:19.986878 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:19.986856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5vwq" event={"ID":"24082157-d36f-4cf7-8026-b253225d4152","Type":"ContainerStarted","Data":"489557f41e19c8df5e38204a5eb17b4d7d8f62f0b6aa16aacbfd6c626362cca0"}
Sep 18 21:07:20.002857 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:20.002801    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-49t7h" podStartSLOduration=67.843598232 podStartE2EDuration="1m12.002788119s" totalImagesPullingTime="4.159189887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:20.001990151 +0000 UTC m=+73.464769533" watchObservedRunningTime="2026-09-18 21:07:20.002788119 +0000 UTC m=+73.465567475"
Sep 18 21:07:20.023927 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:20.023858    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l5vwq" podStartSLOduration=66.849804158 podStartE2EDuration="1m11.023842424s" totalImagesPullingTime="4.174038266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:20.022617211 +0000 UTC m=+73.485396567" watchObservedRunningTime="2026-09-18 21:07:20.023842424 +0000 UTC m=+73.486621782"
Sep 18 21:07:20.301852 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:20.301766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:20.301852 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:20.301819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:20.302096 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:20.301956    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 21:07:20.302096 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:20.302043    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:24.302020215 +0000 UTC m=+77.764799563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : secret "router-metrics-certs-default" not found
Sep 18 21:07:20.302096 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:20.302063    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:24.302052471 +0000 UTC m=+77.764831812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : configmap references non-existent config key: service-ca.crt
Sep 18 21:07:20.991256 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:20.991221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn" event={"ID":"dfe498fb-6015-4a54-8ab1-8cd42b38a672","Type":"ContainerStarted","Data":"260dba527e4128500294cf7eaa76e3aba45d5b8e526c2c85bbad95825a154b91"}
Sep 18 21:07:21.015664 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.015584    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-8jqcn" podStartSLOduration=3.5125544399999997 podStartE2EDuration="5.015567934s" totalImagesPullingTime="1.503013494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:21.015492388 +0000 UTC m=+74.478271766" watchObservedRunningTime="2026-09-18 21:07:21.015567934 +0000 UTC m=+74.478347290"
Sep 18 21:07:21.604663 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.604632    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w8tpw"]
Sep 18 21:07:21.607736 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.607716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.610210 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.610190    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 21:07:21.610321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.610212    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 21:07:21.610321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.610192    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lfhrj\""
Sep 18 21:07:21.611116 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.611098    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 21:07:21.611335 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.611321    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 21:07:21.621306 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.621287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8tpw"]
Sep 18 21:07:21.713337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.713280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.713337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.713311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvj2g\" (UniqueName: \"kubernetes.io/projected/aba8cc54-d4fb-439c-93df-89c220467462-kube-api-access-dvj2g\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.713459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.713342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aba8cc54-d4fb-439c-93df-89c220467462-crio-socket\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.713459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.713399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.713459 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.713433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aba8cc54-d4fb-439c-93df-89c220467462-data-volume\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.813794 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.813769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.813859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.813799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aba8cc54-d4fb-439c-93df-89c220467462-data-volume\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.813933 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.813877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.813933 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:21.813916    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 21:07:21.813994 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.813945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvj2g\" (UniqueName: \"kubernetes.io/projected/aba8cc54-d4fb-439c-93df-89c220467462-kube-api-access-dvj2g\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.813994 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:21.813982    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:22.313963089 +0000 UTC m=+75.776742439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : configmap "kube-rbac-proxy" not found
Sep 18 21:07:21.814090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.814031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aba8cc54-d4fb-439c-93df-89c220467462-crio-socket\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.814090 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:21.814076    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:21.814161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.814105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aba8cc54-d4fb-439c-93df-89c220467462-crio-socket\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.814161 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:21.814138    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:22.314121863 +0000 UTC m=+75.776901205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:21.814237 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.814185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aba8cc54-d4fb-439c-93df-89c220467462-data-volume\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.825572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.825553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvj2g\" (UniqueName: \"kubernetes.io/projected/aba8cc54-d4fb-439c-93df-89c220467462-kube-api-access-dvj2g\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:21.995532 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:21.995459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725" event={"ID":"c4aced95-7f7d-4d65-ab23-f93bdab00fdb","Type":"ContainerStarted","Data":"f7faaee7fc86549eae443986570ec96047824b0c62ed3e903c1dcdad1bcda57e"}
Sep 18 21:07:22.012574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:22.012527    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725" podStartSLOduration=3.851906278 podStartE2EDuration="6.012509088s" totalImagesPullingTime="2.16060281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:22.012301797 +0000 UTC m=+75.475081153" watchObservedRunningTime="2026-09-18 21:07:22.012509088 +0000 UTC m=+75.475288446"
Sep 18 21:07:22.318128 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:22.318051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:22.318128 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:22.318117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:22.318294 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:22.318157    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 21:07:22.318294 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:22.318198    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:22.318294 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:22.318222    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:23.31820541 +0000 UTC m=+76.780984767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : configmap "kube-rbac-proxy" not found
Sep 18 21:07:22.318294 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:22.318236    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:23.318229765 +0000 UTC m=+76.781009100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:23.326345 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:23.326307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:23.326742 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:23.326382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:23.326742 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:23.326456    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:23.326742 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:23.326524    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:25.326510166 +0000 UTC m=+78.789289501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:23.326742 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:23.326456    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 21:07:23.326742 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:23.326591    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:25.326580401 +0000 UTC m=+78.789359753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : configmap "kube-rbac-proxy" not found
Sep 18 21:07:24.323851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:24.323752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8f5mc_b796fb3a-f153-4c19-96b8-daaa56085f10/dns-node-resolver/0.log"
Sep 18 21:07:24.332052 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:24.332026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:24.332415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:24.332135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:24.332415 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:24.332170    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:32.332155009 +0000 UTC m=+85.794934344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : configmap references non-existent config key: service-ca.crt
Sep 18 21:07:24.332415 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:24.332243    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 21:07:24.332415 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:24.332301    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:32.332284406 +0000 UTC m=+85.795063745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : secret "router-metrics-certs-default" not found
Sep 18 21:07:25.120419 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.120392    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bllf_908f8b7e-ee99-4230-a68d-a9802c560b09/node-ca/0.log"
Sep 18 21:07:25.338865 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.338830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:25.339249 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.338932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:25.339249 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:25.338960    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 21:07:25.339249 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:25.339021    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:29.339006726 +0000 UTC m=+82.801786066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : configmap "kube-rbac-proxy" not found
Sep 18 21:07:25.339249 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:25.339069    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:25.339249 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:25.339120    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:29.339108126 +0000 UTC m=+82.801887461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:25.488283 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.488208    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-wstvw"]
Sep 18 21:07:25.491075 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.491060    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.496554 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.496524    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-56pzq\""
Sep 18 21:07:25.496554 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.496533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 21:07:25.496554 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.496523    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 21:07:25.497767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.497751    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 21:07:25.497877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.497859    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 21:07:25.507917 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.507897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-wstvw"]
Sep 18 21:07:25.641556 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.641526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eec0209-1e12-4d77-b260-c96cc461e1fb-signing-cabundle\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.641556 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.641557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4hs\" (UniqueName: \"kubernetes.io/projected/3eec0209-1e12-4d77-b260-c96cc461e1fb-kube-api-access-vs4hs\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.641749 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.641596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eec0209-1e12-4d77-b260-c96cc461e1fb-signing-key\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.742896 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.742811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eec0209-1e12-4d77-b260-c96cc461e1fb-signing-cabundle\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.742896 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.742841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4hs\" (UniqueName: \"kubernetes.io/projected/3eec0209-1e12-4d77-b260-c96cc461e1fb-kube-api-access-vs4hs\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.742896 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.742880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eec0209-1e12-4d77-b260-c96cc461e1fb-signing-key\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.743546 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.743526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3eec0209-1e12-4d77-b260-c96cc461e1fb-signing-cabundle\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.745250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.745228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3eec0209-1e12-4d77-b260-c96cc461e1fb-signing-key\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.752820 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.752798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4hs\" (UniqueName: \"kubernetes.io/projected/3eec0209-1e12-4d77-b260-c96cc461e1fb-kube-api-access-vs4hs\") pod \"service-ca-55f6fc7b86-wstvw\" (UID: \"3eec0209-1e12-4d77-b260-c96cc461e1fb\") " pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:25.799928 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:25.799898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw"
Sep 18 21:07:26.075276 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:26.075211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-wstvw"]
Sep 18 21:07:26.077991 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:26.077962    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eec0209_1e12_4d77_b260_c96cc461e1fb.slice/crio-79bf03743f70398e63b0c65ff7b3b265bc925c10cf8f26f91eeb50e62b9c723f WatchSource:0}: Error finding container 79bf03743f70398e63b0c65ff7b3b265bc925c10cf8f26f91eeb50e62b9c723f: Status 404 returned error can't find the container with id 79bf03743f70398e63b0c65ff7b3b265bc925c10cf8f26f91eeb50e62b9c723f
Sep 18 21:07:26.321155 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:26.321114    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsgl9_e137c6da-eae6-42c9-a221-e0aa00d55d47/serve-healthcheck-canary/0.log"
Sep 18 21:07:27.012400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:27.012188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw" event={"ID":"3eec0209-1e12-4d77-b260-c96cc461e1fb","Type":"ContainerStarted","Data":"88368312c604e01c07eb75cd744352fb93c8a62631d7a4be03a88dacd4eb5d41"}
Sep 18 21:07:27.012400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:27.012246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw" event={"ID":"3eec0209-1e12-4d77-b260-c96cc461e1fb","Type":"ContainerStarted","Data":"79bf03743f70398e63b0c65ff7b3b265bc925c10cf8f26f91eeb50e62b9c723f"}
Sep 18 21:07:27.040811 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:27.040758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-wstvw" podStartSLOduration=2.040738863 podStartE2EDuration="2.040738863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:27.039695893 +0000 UTC m=+80.502475249" watchObservedRunningTime="2026-09-18 21:07:27.040738863 +0000 UTC m=+80.503518221"
Sep 18 21:07:29.372988 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:29.372956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:29.373450 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:29.373018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:29.373450 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:29.373085    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 21:07:29.373450 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:29.373105    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:29.373450 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:29.373135    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:37.373123173 +0000 UTC m=+90.835902508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : configmap "kube-rbac-proxy" not found
Sep 18 21:07:29.373450 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:29.373155    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls podName:aba8cc54-d4fb-439c-93df-89c220467462 nodeName:}" failed. No retries permitted until 2026-09-18 21:07:37.373143016 +0000 UTC m=+90.835922351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8tpw" (UID: "aba8cc54-d4fb-439c-93df-89c220467462") : secret "insights-runtime-extractor-tls" not found
Sep 18 21:07:32.396610 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:32.396573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:32.396988 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:32.396655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:32.396988 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:07:32.396827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle podName:2e9988a4-d39e-42e9-b9c8-ed88ceccd49e nodeName:}" failed. No retries permitted until 2026-09-18 21:07:48.396809214 +0000 UTC m=+101.859588549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle") pod "router-default-5f75549b6d-nxsnx" (UID: "2e9988a4-d39e-42e9-b9c8-ed88ceccd49e") : configmap references non-existent config key: service-ca.crt
Sep 18 21:07:32.398979 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:32.398961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-metrics-certs\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:37.430696 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:37.430665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:37.431104 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:37.430718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:37.431226 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:37.431209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aba8cc54-d4fb-439c-93df-89c220467462-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:37.433013 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:37.432993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aba8cc54-d4fb-439c-93df-89c220467462-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8tpw\" (UID: \"aba8cc54-d4fb-439c-93df-89c220467462\") " pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:37.517425 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:37.517399    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8tpw"
Sep 18 21:07:37.815914 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:37.815822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8tpw"]
Sep 18 21:07:37.818959 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:37.818932    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba8cc54_d4fb_439c_93df_89c220467462.slice/crio-15fca897e8b56d84fadf2f800520a420c9f39bc3d20a8772624f056b54c2c9c6 WatchSource:0}: Error finding container 15fca897e8b56d84fadf2f800520a420c9f39bc3d20a8772624f056b54c2c9c6: Status 404 returned error can't find the container with id 15fca897e8b56d84fadf2f800520a420c9f39bc3d20a8772624f056b54c2c9c6
Sep 18 21:07:38.052048 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:38.052009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8tpw" event={"ID":"aba8cc54-d4fb-439c-93df-89c220467462","Type":"ContainerStarted","Data":"079aa448de0f73786411041fb5ea21b9a380f72876efd12cb10b835653a1432c"}
Sep 18 21:07:38.052213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:38.052095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8tpw" event={"ID":"aba8cc54-d4fb-439c-93df-89c220467462","Type":"ContainerStarted","Data":"15fca897e8b56d84fadf2f800520a420c9f39bc3d20a8772624f056b54c2c9c6"}
Sep 18 21:07:39.057551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:39.057510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8tpw" event={"ID":"aba8cc54-d4fb-439c-93df-89c220467462","Type":"ContainerStarted","Data":"29ac4be35936a97dcd9cc9f9732d19fe4aabb315d8805d7a72d2bda54b71d835"}
Sep 18 21:07:40.062223 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:40.062188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8tpw" event={"ID":"aba8cc54-d4fb-439c-93df-89c220467462","Type":"ContainerStarted","Data":"0365f7272b1ab21ee06f3b3314c49a6cfcc894f2d167f810d8a4ea744e50c647"}
Sep 18 21:07:40.084981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:40.084937    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w8tpw" podStartSLOduration=17.163419588 podStartE2EDuration="19.084922983s" totalImagesPullingTime="1.921503395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:07:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:40.084408787 +0000 UTC m=+93.547188143" watchObservedRunningTime="2026-09-18 21:07:40.084922983 +0000 UTC m=+93.547702339"
Sep 18 21:07:45.489751 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:45.489713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:07:45.491937 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:45.491907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0ad977-a226-4180-bf03-2073ead4e8ee-metrics-tls\") pod \"dns-default-cp56w\" (UID: \"bc0ad977-a226-4180-bf03-2073ead4e8ee\") " pod="openshift-dns/dns-default-cp56w"
Sep 18 21:07:45.583351 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:45.583326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d4xcf\""
Sep 18 21:07:45.590504 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:45.590488    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cp56w"
Sep 18 21:07:45.879665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:45.879633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cp56w"]
Sep 18 21:07:45.887691 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:45.887667    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0ad977_a226_4180_bf03_2073ead4e8ee.slice/crio-24060dff9bd7bd60d09c269dc4a7093a91d8bebf74c7dfb130e04fd7be8cc6d5 WatchSource:0}: Error finding container 24060dff9bd7bd60d09c269dc4a7093a91d8bebf74c7dfb130e04fd7be8cc6d5: Status 404 returned error can't find the container with id 24060dff9bd7bd60d09c269dc4a7093a91d8bebf74c7dfb130e04fd7be8cc6d5
Sep 18 21:07:46.080332 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:46.080301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cp56w" event={"ID":"bc0ad977-a226-4180-bf03-2073ead4e8ee","Type":"ContainerStarted","Data":"24060dff9bd7bd60d09c269dc4a7093a91d8bebf74c7dfb130e04fd7be8cc6d5"}
Sep 18 21:07:47.443647 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.443600    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"]
Sep 18 21:07:47.446991 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.446968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.463904 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.456226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rp9bh\""
Sep 18 21:07:47.463904 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.456477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 21:07:47.463904 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.456648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 21:07:47.463904 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.456814    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 21:07:47.463904 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.457101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 18 21:07:47.506179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.506145    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"]
Sep 18 21:07:47.507484 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.507461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6caf17f-58db-490b-81e8-ec96e11bce37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759cb88cdd-b2tr8\" (UID: \"c6caf17f-58db-490b-81e8-ec96e11bce37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.507591 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.507509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs87j\" (UniqueName: \"kubernetes.io/projected/c6caf17f-58db-490b-81e8-ec96e11bce37-kube-api-access-vs87j\") pod \"managed-serviceaccount-addon-agent-759cb88cdd-b2tr8\" (UID: \"c6caf17f-58db-490b-81e8-ec96e11bce37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.593399 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.593366    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"]
Sep 18 21:07:47.596410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.596390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.606134 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.606113    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 18 21:07:47.606212 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.606140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 18 21:07:47.606270 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.606254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 18 21:07:47.606510 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.606497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 18 21:07:47.608782 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.608767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6caf17f-58db-490b-81e8-ec96e11bce37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759cb88cdd-b2tr8\" (UID: \"c6caf17f-58db-490b-81e8-ec96e11bce37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.608827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.608804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs87j\" (UniqueName: \"kubernetes.io/projected/c6caf17f-58db-490b-81e8-ec96e11bce37-kube-api-access-vs87j\") pod \"managed-serviceaccount-addon-agent-759cb88cdd-b2tr8\" (UID: \"c6caf17f-58db-490b-81e8-ec96e11bce37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.611120 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.611102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6caf17f-58db-490b-81e8-ec96e11bce37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759cb88cdd-b2tr8\" (UID: \"c6caf17f-58db-490b-81e8-ec96e11bce37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.644696 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.644671    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"]
Sep 18 21:07:47.669931 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.669904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs87j\" (UniqueName: \"kubernetes.io/projected/c6caf17f-58db-490b-81e8-ec96e11bce37-kube-api-access-vs87j\") pod \"managed-serviceaccount-addon-agent-759cb88cdd-b2tr8\" (UID: \"c6caf17f-58db-490b-81e8-ec96e11bce37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.710122 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.710095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.710244 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.710130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-hub\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.710244 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.710160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.710312 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.710249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksrh7\" (UniqueName: \"kubernetes.io/projected/964172f7-3145-4099-8630-7f7518afa001-kube-api-access-ksrh7\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.710312 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.710279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-ca\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.710420 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.710317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/964172f7-3145-4099-8630-7f7518afa001-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.780085 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.780057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"
Sep 18 21:07:47.811098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.811063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-hub\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.811245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.811134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.811245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.811197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksrh7\" (UniqueName: \"kubernetes.io/projected/964172f7-3145-4099-8630-7f7518afa001-kube-api-access-ksrh7\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.811245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.811230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-ca\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.811407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.811275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/964172f7-3145-4099-8630-7f7518afa001-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.811407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.811304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.812094 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.812067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/964172f7-3145-4099-8630-7f7518afa001-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.813899 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.813866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-ca\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.814217 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.814197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.814265 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.814217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-hub\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.814311 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.814291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/964172f7-3145-4099-8630-7f7518afa001-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.853450 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.853385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksrh7\" (UniqueName: \"kubernetes.io/projected/964172f7-3145-4099-8630-7f7518afa001-kube-api-access-ksrh7\") pod \"cluster-proxy-proxy-agent-54d764bd68-9nkg7\" (UID: \"964172f7-3145-4099-8630-7f7518afa001\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:47.904631 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:47.904599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"
Sep 18 21:07:48.054244 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.054216    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8"]
Sep 18 21:07:48.056958 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:48.056934    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6caf17f_58db_490b_81e8_ec96e11bce37.slice/crio-8ed1445a8d06cec8f822c14a228fa22e979cc1d3a6f64e6119bde49cb11d342a WatchSource:0}: Error finding container 8ed1445a8d06cec8f822c14a228fa22e979cc1d3a6f64e6119bde49cb11d342a: Status 404 returned error can't find the container with id 8ed1445a8d06cec8f822c14a228fa22e979cc1d3a6f64e6119bde49cb11d342a
Sep 18 21:07:48.088766 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.088731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cp56w" event={"ID":"bc0ad977-a226-4180-bf03-2073ead4e8ee","Type":"ContainerStarted","Data":"e0bc967a15a437f3d4855e95ad3877199b3902f1280f870d9451cbb104544e2f"}
Sep 18 21:07:48.088899 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.088793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cp56w" event={"ID":"bc0ad977-a226-4180-bf03-2073ead4e8ee","Type":"ContainerStarted","Data":"47a87a97f45e359c7634e61f2e43ca453feaf5d26572275928416e15ce565716"}
Sep 18 21:07:48.088966 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.088941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cp56w"
Sep 18 21:07:48.089920 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.089877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8" event={"ID":"c6caf17f-58db-490b-81e8-ec96e11bce37","Type":"ContainerStarted","Data":"8ed1445a8d06cec8f822c14a228fa22e979cc1d3a6f64e6119bde49cb11d342a"}
Sep 18 21:07:48.119844 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.119762    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cp56w" podStartSLOduration=65.660293254 podStartE2EDuration="1m7.119747038s" totalImagesPullingTime="1.459453784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:48.118159273 +0000 UTC m=+101.580938640" watchObservedRunningTime="2026-09-18 21:07:48.119747038 +0000 UTC m=+101.582526452"
Sep 18 21:07:48.180491 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.180469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7"]
Sep 18 21:07:48.181511 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:48.181488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod964172f7_3145_4099_8630_7f7518afa001.slice/crio-e55a62603d812ef42c4f7b3f12b7cf89bbef9a3297c77d42e665fe42bdce3f21 WatchSource:0}: Error finding container e55a62603d812ef42c4f7b3f12b7cf89bbef9a3297c77d42e665fe42bdce3f21: Status 404 returned error can't find the container with id e55a62603d812ef42c4f7b3f12b7cf89bbef9a3297c77d42e665fe42bdce3f21
Sep 18 21:07:48.416582 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.416505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:48.417108 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.417090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e9988a4-d39e-42e9-b9c8-ed88ceccd49e-service-ca-bundle\") pod \"router-default-5f75549b6d-nxsnx\" (UID: \"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e\") " pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:48.652224 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.652180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:48.950142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:48.950096    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f75549b6d-nxsnx"]
Sep 18 21:07:48.952822 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:07:48.952783    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9988a4_d39e_42e9_b9c8_ed88ceccd49e.slice/crio-1d02ea3f3681d65e7aed79fbe21f4cea9b8af93a41d4d712b5a5f00933d9167b WatchSource:0}: Error finding container 1d02ea3f3681d65e7aed79fbe21f4cea9b8af93a41d4d712b5a5f00933d9167b: Status 404 returned error can't find the container with id 1d02ea3f3681d65e7aed79fbe21f4cea9b8af93a41d4d712b5a5f00933d9167b
Sep 18 21:07:49.097261 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:49.097230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f75549b6d-nxsnx" event={"ID":"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e","Type":"ContainerStarted","Data":"110f1bc32aa22a4f9023ad08babb1dd377f0722892132d8cdeb67de85f8d81d2"}
Sep 18 21:07:49.097448 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:49.097286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f75549b6d-nxsnx" event={"ID":"2e9988a4-d39e-42e9-b9c8-ed88ceccd49e","Type":"ContainerStarted","Data":"1d02ea3f3681d65e7aed79fbe21f4cea9b8af93a41d4d712b5a5f00933d9167b"}
Sep 18 21:07:49.098757 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:49.098725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7" event={"ID":"964172f7-3145-4099-8630-7f7518afa001","Type":"ContainerStarted","Data":"e55a62603d812ef42c4f7b3f12b7cf89bbef9a3297c77d42e665fe42bdce3f21"}
Sep 18 21:07:49.123848 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:49.123449    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f75549b6d-nxsnx" podStartSLOduration=33.12342967 podStartE2EDuration="33.12342967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:49.122176094 +0000 UTC m=+102.584955451" watchObservedRunningTime="2026-09-18 21:07:49.12342967 +0000 UTC m=+102.586209031"
Sep 18 21:07:49.652837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:49.652801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:49.656173 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:49.655983    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:50.102284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:50.102228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:50.103640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:50.103619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f75549b6d-nxsnx"
Sep 18 21:07:50.993687 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:50.993661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-49t7h"
Sep 18 21:07:53.115248 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:53.115211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7" event={"ID":"964172f7-3145-4099-8630-7f7518afa001","Type":"ContainerStarted","Data":"3a95f40f9e13d907d107b1081495ffc89239ab0ec8f4da57ec2f6a5c8850bc2e"}
Sep 18 21:07:53.115628 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:53.115264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7" event={"ID":"964172f7-3145-4099-8630-7f7518afa001","Type":"ContainerStarted","Data":"7637e147cfc0f02bbab9b7cad37f80678ed824eac1cd25be5fcae5641538410f"}
Sep 18 21:07:53.115628 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:53.115283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7" event={"ID":"964172f7-3145-4099-8630-7f7518afa001","Type":"ContainerStarted","Data":"076c976e6986b8a8874189783b8dabe4284ffe3e11b6ed2dd897f243537e7636"}
Sep 18 21:07:53.116693 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:53.116668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8" event={"ID":"c6caf17f-58db-490b-81e8-ec96e11bce37","Type":"ContainerStarted","Data":"9f2fa5cad33a1f8b733e217184c267bf38b0923dc0e5b3a212d09384812beb3c"}
Sep 18 21:07:53.145581 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:53.145527    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d764bd68-9nkg7" podStartSLOduration=1.79816679 podStartE2EDuration="6.145512304s" totalImagesPullingTime="4.347345514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:53.144985087 +0000 UTC m=+106.607764436" watchObservedRunningTime="2026-09-18 21:07:53.145512304 +0000 UTC m=+106.608291660"
Sep 18 21:07:53.176656 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:53.176604    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cb88cdd-b2tr8" podStartSLOduration=2.134379123 podStartE2EDuration="6.176589178s" totalImagesPullingTime="4.042210055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:07:53.176244463 +0000 UTC m=+106.639023810" watchObservedRunningTime="2026-09-18 21:07:53.176589178 +0000 UTC m=+106.639368534"
Sep 18 21:07:58.100924 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:07:58.100874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cp56w"
Sep 18 21:08:10.572691 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.572656    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k84s9"]
Sep 18 21:08:10.578469 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.578449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.581186 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.581161    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 21:08:10.581285 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.581190    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 21:08:10.582203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.582184    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 21:08:10.582290 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.582185    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 21:08:10.582290 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.582187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 21:08:10.582290 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.582190    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cktl2\""
Sep 18 21:08:10.582290 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.582262    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 21:08:10.685285 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-tls\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-sys\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-textfile\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-root\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50417478-fa32-4eb6-9366-fed81a11e123-metrics-client-ca\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-wtmp\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-accelerators-collector-config\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.685705 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.685504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmp6b\" (UniqueName: \"kubernetes.io/projected/50417478-fa32-4eb6-9366-fed81a11e123-kube-api-access-pmp6b\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-sys\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-textfile\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-root\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50417478-fa32-4eb6-9366-fed81a11e123-metrics-client-ca\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-sys\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-wtmp\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-root\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-accelerators-collector-config\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmp6b\" (UniqueName: \"kubernetes.io/projected/50417478-fa32-4eb6-9366-fed81a11e123-kube-api-access-pmp6b\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-wtmp\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-tls\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.786851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.786681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-textfile\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.787119 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.787097    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50417478-fa32-4eb6-9366-fed81a11e123-metrics-client-ca\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.787176 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.787101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-accelerators-collector-config\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.788779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.788753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.788868 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.788856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50417478-fa32-4eb6-9366-fed81a11e123-node-exporter-tls\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.795237 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.795213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmp6b\" (UniqueName: \"kubernetes.io/projected/50417478-fa32-4eb6-9366-fed81a11e123-kube-api-access-pmp6b\") pod \"node-exporter-k84s9\" (UID: \"50417478-fa32-4eb6-9366-fed81a11e123\") " pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.887609 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:10.887574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k84s9"
Sep 18 21:08:10.899526 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:08:10.899503    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50417478_fa32_4eb6_9366_fed81a11e123.slice/crio-f4de8ca6dfb89659ffd834059e45913d7edfeb1301ca7544a03536b782f5565a WatchSource:0}: Error finding container f4de8ca6dfb89659ffd834059e45913d7edfeb1301ca7544a03536b782f5565a: Status 404 returned error can't find the container with id f4de8ca6dfb89659ffd834059e45913d7edfeb1301ca7544a03536b782f5565a
Sep 18 21:08:11.175975 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:11.175899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k84s9" event={"ID":"50417478-fa32-4eb6-9366-fed81a11e123","Type":"ContainerStarted","Data":"f4de8ca6dfb89659ffd834059e45913d7edfeb1301ca7544a03536b782f5565a"}
Sep 18 21:08:12.181316 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:12.181245    2576 generic.go:356] "Generic (PLEG): container finished" podID="50417478-fa32-4eb6-9366-fed81a11e123" containerID="3b27bb9379b86105ac3b9ca340c234ff0cccee78ec5ed0fb2a0b715e3e0bf270" exitCode=0
Sep 18 21:08:12.181316 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:12.181302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k84s9" event={"ID":"50417478-fa32-4eb6-9366-fed81a11e123","Type":"ContainerDied","Data":"3b27bb9379b86105ac3b9ca340c234ff0cccee78ec5ed0fb2a0b715e3e0bf270"}
Sep 18 21:08:13.186552 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:13.186518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k84s9" event={"ID":"50417478-fa32-4eb6-9366-fed81a11e123","Type":"ContainerStarted","Data":"c07900887fbb833ceb1a27096da9ee249f28de5f37c0377fce78985a78d0bad5"}
Sep 18 21:08:13.186974 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:13.186570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k84s9" event={"ID":"50417478-fa32-4eb6-9366-fed81a11e123","Type":"ContainerStarted","Data":"77b7953af9ba16d82548d0abe21610dd0b4b48404ec5573ec360e52fdd5a75b2"}
Sep 18 21:08:13.207830 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:13.207783    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k84s9" podStartSLOduration=2.151164859 podStartE2EDuration="3.207769327s" totalImagesPullingTime="998.220309ms" totalInitContainerRuntime="58.384159ms" isStatefulPod=true podCreationTimestamp="2026-09-18 21:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:13.207140277 +0000 UTC m=+126.669919633" watchObservedRunningTime="2026-09-18 21:08:13.207769327 +0000 UTC m=+126.670548684"
Sep 18 21:08:18.447999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:18.447961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:08:18.450314 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:18.450283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/274fd151-b8df-43ac-8bc4-2c868fc0b90a-metrics-certs\") pod \"network-metrics-daemon-5j7sj\" (UID: \"274fd151-b8df-43ac-8bc4-2c868fc0b90a\") " pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:08:18.749993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:18.749915    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6vrc\""
Sep 18 21:08:18.756497 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:18.756477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5j7sj"
Sep 18 21:08:19.031915 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:19.031866    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5j7sj"]
Sep 18 21:08:19.033466 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:08:19.033440    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274fd151_b8df_43ac_8bc4_2c868fc0b90a.slice/crio-2247e003124bf87dd24f4b131ceeda5c8daea402d178a845270c120ca10ef4a6 WatchSource:0}: Error finding container 2247e003124bf87dd24f4b131ceeda5c8daea402d178a845270c120ca10ef4a6: Status 404 returned error can't find the container with id 2247e003124bf87dd24f4b131ceeda5c8daea402d178a845270c120ca10ef4a6
Sep 18 21:08:19.206898 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:19.206861    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5j7sj" event={"ID":"274fd151-b8df-43ac-8bc4-2c868fc0b90a","Type":"ContainerStarted","Data":"2247e003124bf87dd24f4b131ceeda5c8daea402d178a845270c120ca10ef4a6"}
Sep 18 21:08:20.212908 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:20.212796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5j7sj" event={"ID":"274fd151-b8df-43ac-8bc4-2c868fc0b90a","Type":"ContainerStarted","Data":"76a60e5fd403fd072338a7f2b278f272773cf3fc8145994f0deac379c698de83"}
Sep 18 21:08:20.212908 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:20.212847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5j7sj" event={"ID":"274fd151-b8df-43ac-8bc4-2c868fc0b90a","Type":"ContainerStarted","Data":"17093cd25e37082fd682d561b97efe48bc8f6dd404a16374a257ecc8e4bc620e"}
Sep 18 21:08:20.234159 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:20.234102    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5j7sj" podStartSLOduration=131.420734583 podStartE2EDuration="2m12.234084367s" totalImagesPullingTime="813.349784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:08:20.232607596 +0000 UTC m=+133.695386954" watchObservedRunningTime="2026-09-18 21:08:20.234084367 +0000 UTC m=+133.696863724"
Sep 18 21:08:52.323304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:52.323208    2576 generic.go:356] "Generic (PLEG): container finished" podID="c4aced95-7f7d-4d65-ab23-f93bdab00fdb" containerID="f7faaee7fc86549eae443986570ec96047824b0c62ed3e903c1dcdad1bcda57e" exitCode=0
Sep 18 21:08:52.323304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:52.323290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725" event={"ID":"c4aced95-7f7d-4d65-ab23-f93bdab00fdb","Type":"ContainerDied","Data":"f7faaee7fc86549eae443986570ec96047824b0c62ed3e903c1dcdad1bcda57e"}
Sep 18 21:08:52.323737 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:52.323585    2576 scope.go:117] "RemoveContainer" containerID="f7faaee7fc86549eae443986570ec96047824b0c62ed3e903c1dcdad1bcda57e"
Sep 18 21:08:53.330010 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:08:53.329977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jf725" event={"ID":"c4aced95-7f7d-4d65-ab23-f93bdab00fdb","Type":"ContainerStarted","Data":"74e26781b3cd9e1ac37435d38f9b4a6a96692e821e541e1838f37e4f6f1b6d64"}
Sep 18 21:11:08.607505 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:08.607470    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 21:11:45.614175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.614143    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"]
Sep 18 21:11:45.616983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.616968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.619689 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.619667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 21:11:45.619805 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.619732    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 21:11:45.620859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.620841    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 18 21:11:45.620969 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.620907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n42m6\""
Sep 18 21:11:45.620969 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.620921    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 18 21:11:45.621063 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.620924    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 18 21:11:45.630355 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.630335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"]
Sep 18 21:11:45.687445 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.687403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plxn6\" (UniqueName: \"kubernetes.io/projected/a11c0c67-f7c3-4a31-b7d6-31307137c759-kube-api-access-plxn6\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.687550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.687471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a11c0c67-f7c3-4a31-b7d6-31307137c759-cert\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.687550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.687511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a11c0c67-f7c3-4a31-b7d6-31307137c759-manager-config\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.687550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.687532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a11c0c67-f7c3-4a31-b7d6-31307137c759-metrics-cert\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.788248 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.788211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a11c0c67-f7c3-4a31-b7d6-31307137c759-cert\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.788248 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.788256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a11c0c67-f7c3-4a31-b7d6-31307137c759-manager-config\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.788462 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.788274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a11c0c67-f7c3-4a31-b7d6-31307137c759-metrics-cert\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.788462 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.788325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxn6\" (UniqueName: \"kubernetes.io/projected/a11c0c67-f7c3-4a31-b7d6-31307137c759-kube-api-access-plxn6\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.788874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.788854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a11c0c67-f7c3-4a31-b7d6-31307137c759-manager-config\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.790606 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.790586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a11c0c67-f7c3-4a31-b7d6-31307137c759-metrics-cert\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.790744 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.790728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a11c0c67-f7c3-4a31-b7d6-31307137c759-cert\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.797686 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.797663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plxn6\" (UniqueName: \"kubernetes.io/projected/a11c0c67-f7c3-4a31-b7d6-31307137c759-kube-api-access-plxn6\") pod \"lws-controller-manager-5d975f5588-t9g7n\" (UID: \"a11c0c67-f7c3-4a31-b7d6-31307137c759\") " pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:45.925656 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:45.925589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:46.195380 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:46.195338    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"]
Sep 18 21:11:46.197901 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:11:46.197860    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11c0c67_f7c3_4a31_b7d6_31307137c759.slice/crio-0bb85512b3b665c303d8e5aabcbe28265bc3566f8a735fecf4dfbdb94d0ed8f9 WatchSource:0}: Error finding container 0bb85512b3b665c303d8e5aabcbe28265bc3566f8a735fecf4dfbdb94d0ed8f9: Status 404 returned error can't find the container with id 0bb85512b3b665c303d8e5aabcbe28265bc3566f8a735fecf4dfbdb94d0ed8f9
Sep 18 21:11:46.199682 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:46.199668    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 21:11:46.912472 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:46.912442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n" event={"ID":"a11c0c67-f7c3-4a31-b7d6-31307137c759","Type":"ContainerStarted","Data":"0bb85512b3b665c303d8e5aabcbe28265bc3566f8a735fecf4dfbdb94d0ed8f9"}
Sep 18 21:11:48.212333 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.212297    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"]
Sep 18 21:11:48.215354 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.215331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.217868 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.217845    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 21:11:48.218008 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.217847    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 21:11:48.218008 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.217880    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 21:11:48.218242 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.218227    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6hf49\""
Sep 18 21:11:48.218333 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.218251    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 21:11:48.244180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.244156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"]
Sep 18 21:11:48.310276 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.310240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/078bb7f5-0022-4579-9677-11866ed36e0d-tmp\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.310436 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.310317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/078bb7f5-0022-4579-9677-11866ed36e0d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.310436 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.310354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2tbh\" (UniqueName: \"kubernetes.io/projected/078bb7f5-0022-4579-9677-11866ed36e0d-kube-api-access-h2tbh\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.310557 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.310431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/078bb7f5-0022-4579-9677-11866ed36e0d-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.310557 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.310476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/078bb7f5-0022-4579-9677-11866ed36e0d-manifests\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.411233 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.411190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/078bb7f5-0022-4579-9677-11866ed36e0d-tmp\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.411410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.411249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/078bb7f5-0022-4579-9677-11866ed36e0d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.411410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.411311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2tbh\" (UniqueName: \"kubernetes.io/projected/078bb7f5-0022-4579-9677-11866ed36e0d-kube-api-access-h2tbh\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.411410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.411361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/078bb7f5-0022-4579-9677-11866ed36e0d-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.411410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.411397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/078bb7f5-0022-4579-9677-11866ed36e0d-manifests\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.411741 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.411709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/078bb7f5-0022-4579-9677-11866ed36e0d-manifests\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.413726 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.413679    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/078bb7f5-0022-4579-9677-11866ed36e0d-tmp\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.414209 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.414188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/078bb7f5-0022-4579-9677-11866ed36e0d-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.414306 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.414203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/078bb7f5-0022-4579-9677-11866ed36e0d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.421367 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.421346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2tbh\" (UniqueName: \"kubernetes.io/projected/078bb7f5-0022-4579-9677-11866ed36e0d-kube-api-access-h2tbh\") pod \"opendatahub-operator-controller-manager-75f94bc69c-kk28z\" (UID: \"078bb7f5-0022-4579-9677-11866ed36e0d\") " pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:48.527464 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:48.527374    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:49.503425 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:49.503373    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"]
Sep 18 21:11:49.506125 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:11:49.506090    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078bb7f5_0022_4579_9677_11866ed36e0d.slice/crio-b5dac0b9f18f35ac997b06f9929e4dc1a204bceb0974c06b1ad0b9a31dbff950 WatchSource:0}: Error finding container b5dac0b9f18f35ac997b06f9929e4dc1a204bceb0974c06b1ad0b9a31dbff950: Status 404 returned error can't find the container with id b5dac0b9f18f35ac997b06f9929e4dc1a204bceb0974c06b1ad0b9a31dbff950
Sep 18 21:11:49.925505 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:49.925460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n" event={"ID":"a11c0c67-f7c3-4a31-b7d6-31307137c759","Type":"ContainerStarted","Data":"a89bc911b4c49f88fe461a247f285f837459c30a8b47aa0d99539ed9dc3b3c8f"}
Sep 18 21:11:49.925702 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:49.925593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:11:49.927260 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:49.927210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z" event={"ID":"078bb7f5-0022-4579-9677-11866ed36e0d","Type":"ContainerStarted","Data":"b5dac0b9f18f35ac997b06f9929e4dc1a204bceb0974c06b1ad0b9a31dbff950"}
Sep 18 21:11:49.947126 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:49.947077    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n" podStartSLOduration=1.850259366 podStartE2EDuration="4.947062091s" totalImagesPullingTime="3.096802725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:11:49.945871753 +0000 UTC m=+343.408651111" watchObservedRunningTime="2026-09-18 21:11:49.947062091 +0000 UTC m=+343.409841477"
Sep 18 21:11:52.939304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:52.939271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z" event={"ID":"078bb7f5-0022-4579-9677-11866ed36e0d","Type":"ContainerStarted","Data":"f70c311acd07e2d8b6925cfe66cf6c6f54bef00c76bf2e18ee6d3ec2b85f9d4b"}
Sep 18 21:11:53.944357 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:53.944318    2576 generic.go:356] "Generic (PLEG): container finished" podID="078bb7f5-0022-4579-9677-11866ed36e0d" containerID="f70c311acd07e2d8b6925cfe66cf6c6f54bef00c76bf2e18ee6d3ec2b85f9d4b" exitCode=0
Sep 18 21:11:53.944748 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:53.944390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z" event={"ID":"078bb7f5-0022-4579-9677-11866ed36e0d","Type":"ContainerDied","Data":"f70c311acd07e2d8b6925cfe66cf6c6f54bef00c76bf2e18ee6d3ec2b85f9d4b"}
Sep 18 21:11:54.949249 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:54.949212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z" event={"ID":"078bb7f5-0022-4579-9677-11866ed36e0d","Type":"ContainerStarted","Data":"09d947f3bee50389883e96c5294b83c332b995d203a17b3e38b2d536e3be416b"}
Sep 18 21:11:54.949681 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:54.949332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:11:54.971546 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:11:54.971494    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z" podStartSLOduration=2.968054484 podStartE2EDuration="6.97148072s" totalImagesPullingTime="2.982072888s" totalInitContainerRuntime="1.021353348s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:11:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:11:54.970610067 +0000 UTC m=+348.433389424" watchObservedRunningTime="2026-09-18 21:11:54.97148072 +0000 UTC m=+348.434260077"
Sep 18 21:12:00.933386 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:00.933355    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d975f5588-t9g7n"
Sep 18 21:12:05.959279 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:05.959250    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75f94bc69c-kk28z"
Sep 18 21:12:18.877527 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:18.877496    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b89p4"]
Sep 18 21:12:18.889572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:18.889550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:18.890665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:18.890637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b89p4"]
Sep 18 21:12:18.892069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:18.892049    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 18 21:12:18.892162 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:18.892056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v6hcs\""
Sep 18 21:12:19.023960 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.023931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkgk9\" (UniqueName: \"kubernetes.io/projected/1d15df4e-84b2-4956-b864-e1463fd6af22-kube-api-access-wkgk9\") pod \"odh-model-controller-7998c67dc4-b89p4\" (UID: \"1d15df4e-84b2-4956-b864-e1463fd6af22\") " pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.024110 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.023974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d15df4e-84b2-4956-b864-e1463fd6af22-cert\") pod \"odh-model-controller-7998c67dc4-b89p4\" (UID: \"1d15df4e-84b2-4956-b864-e1463fd6af22\") " pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.125016 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.124988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkgk9\" (UniqueName: \"kubernetes.io/projected/1d15df4e-84b2-4956-b864-e1463fd6af22-kube-api-access-wkgk9\") pod \"odh-model-controller-7998c67dc4-b89p4\" (UID: \"1d15df4e-84b2-4956-b864-e1463fd6af22\") " pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.125158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.125024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d15df4e-84b2-4956-b864-e1463fd6af22-cert\") pod \"odh-model-controller-7998c67dc4-b89p4\" (UID: \"1d15df4e-84b2-4956-b864-e1463fd6af22\") " pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.127371 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.127354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d15df4e-84b2-4956-b864-e1463fd6af22-cert\") pod \"odh-model-controller-7998c67dc4-b89p4\" (UID: \"1d15df4e-84b2-4956-b864-e1463fd6af22\") " pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.134294 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.134243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkgk9\" (UniqueName: \"kubernetes.io/projected/1d15df4e-84b2-4956-b864-e1463fd6af22-kube-api-access-wkgk9\") pod \"odh-model-controller-7998c67dc4-b89p4\" (UID: \"1d15df4e-84b2-4956-b864-e1463fd6af22\") " pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.200185 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.200159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:19.478622 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.478535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b89p4"]
Sep 18 21:12:19.481811 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.481790    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gqd27"]
Sep 18 21:12:19.482957 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:12:19.482935    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d15df4e_84b2_4956_b864_e1463fd6af22.slice/crio-40e82c80bc697ce01c3db4761a627758f62b81628bd6163fd0609b87f829e4c2 WatchSource:0}: Error finding container 40e82c80bc697ce01c3db4761a627758f62b81628bd6163fd0609b87f829e4c2: Status 404 returned error can't find the container with id 40e82c80bc697ce01c3db4761a627758f62b81628bd6163fd0609b87f829e4c2
Sep 18 21:12:19.484422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.484404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.487457 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.487435    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 18 21:12:19.502716 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.502671    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gqd27"]
Sep 18 21:12:19.629187 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.629152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05419066-c709-452e-b1c6-8ce023b52954-tls-certs\") pod \"model-serving-api-54d89bd5fc-gqd27\" (UID: \"05419066-c709-452e-b1c6-8ce023b52954\") " pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.629349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.629200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879fr\" (UniqueName: \"kubernetes.io/projected/05419066-c709-452e-b1c6-8ce023b52954-kube-api-access-879fr\") pod \"model-serving-api-54d89bd5fc-gqd27\" (UID: \"05419066-c709-452e-b1c6-8ce023b52954\") " pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.729605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.729529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05419066-c709-452e-b1c6-8ce023b52954-tls-certs\") pod \"model-serving-api-54d89bd5fc-gqd27\" (UID: \"05419066-c709-452e-b1c6-8ce023b52954\") " pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.729605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.729576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879fr\" (UniqueName: \"kubernetes.io/projected/05419066-c709-452e-b1c6-8ce023b52954-kube-api-access-879fr\") pod \"model-serving-api-54d89bd5fc-gqd27\" (UID: \"05419066-c709-452e-b1c6-8ce023b52954\") " pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.731936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.731910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05419066-c709-452e-b1c6-8ce023b52954-tls-certs\") pod \"model-serving-api-54d89bd5fc-gqd27\" (UID: \"05419066-c709-452e-b1c6-8ce023b52954\") " pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.738400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.738383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-879fr\" (UniqueName: \"kubernetes.io/projected/05419066-c709-452e-b1c6-8ce023b52954-kube-api-access-879fr\") pod \"model-serving-api-54d89bd5fc-gqd27\" (UID: \"05419066-c709-452e-b1c6-8ce023b52954\") " pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:19.797955 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:19.797923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:20.038241 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:20.038153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4" event={"ID":"1d15df4e-84b2-4956-b864-e1463fd6af22","Type":"ContainerStarted","Data":"40e82c80bc697ce01c3db4761a627758f62b81628bd6163fd0609b87f829e4c2"}
Sep 18 21:12:20.065819 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:20.065787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gqd27"]
Sep 18 21:12:20.068833 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:12:20.068809    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05419066_c709_452e_b1c6_8ce023b52954.slice/crio-6c7074eac725b86f02641cb461646fe0ff0b54d2ea38169e3fcd21a86cd9e6c4 WatchSource:0}: Error finding container 6c7074eac725b86f02641cb461646fe0ff0b54d2ea38169e3fcd21a86cd9e6c4: Status 404 returned error can't find the container with id 6c7074eac725b86f02641cb461646fe0ff0b54d2ea38169e3fcd21a86cd9e6c4
Sep 18 21:12:21.045641 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:21.045595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27" event={"ID":"05419066-c709-452e-b1c6-8ce023b52954","Type":"ContainerStarted","Data":"6c7074eac725b86f02641cb461646fe0ff0b54d2ea38169e3fcd21a86cd9e6c4"}
Sep 18 21:12:24.060996 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:24.060963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4" event={"ID":"1d15df4e-84b2-4956-b864-e1463fd6af22","Type":"ContainerStarted","Data":"012f6ddf2982913be4c6fb940466d4fc733dccd0a03a2c31b09445611baacc0e"}
Sep 18 21:12:24.061486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:24.061155    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:24.062520 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:24.062497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27" event={"ID":"05419066-c709-452e-b1c6-8ce023b52954","Type":"ContainerStarted","Data":"ada2c68a51ee0cabc56f5506a44c8cd59378d9044276e062c75c5fbdae79ef75"}
Sep 18 21:12:24.062629 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:24.062539    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:12:24.083289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:24.083249    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4" podStartSLOduration=2.222133643 podStartE2EDuration="6.083235935s" totalImagesPullingTime="3.861102292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:12:24.082143042 +0000 UTC m=+377.544922420" watchObservedRunningTime="2026-09-18 21:12:24.083235935 +0000 UTC m=+377.546015291"
Sep 18 21:12:24.114845 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:24.114804    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27" podStartSLOduration=1.8390718019999999 podStartE2EDuration="5.1147918s" totalImagesPullingTime="3.275719998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:12:24.11381366 +0000 UTC m=+377.576593018" watchObservedRunningTime="2026-09-18 21:12:24.1147918 +0000 UTC m=+377.577571157"
Sep 18 21:12:25.567385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.567356    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"]
Sep 18 21:12:25.570206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.570186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.574338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.574317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 21:12:25.574442 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.574321    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 21:12:25.574442 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.574346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jqqqw\""
Sep 18 21:12:25.574560 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.574537    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 21:12:25.574735 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.574722    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 21:12:25.590002 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.589980    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"]
Sep 18 21:12:25.670106 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.670247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0094264d-0993-44e3-970c-07d4b81ee407-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.670247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0094264d-0993-44e3-970c-07d4b81ee407-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.670247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0094264d-0993-44e3-970c-07d4b81ee407-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.670247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.670384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl8kk\" (UniqueName: \"kubernetes.io/projected/0094264d-0993-44e3-970c-07d4b81ee407-kube-api-access-vl8kk\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.670384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.670313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771301 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771449 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0094264d-0993-44e3-970c-07d4b81ee407-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771449 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0094264d-0993-44e3-970c-07d4b81ee407-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771449 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0094264d-0993-44e3-970c-07d4b81ee407-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771449 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771449 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl8kk\" (UniqueName: \"kubernetes.io/projected/0094264d-0993-44e3-970c-07d4b81ee407-kube-api-access-vl8kk\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.771714 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.771463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.772221 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.772195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0094264d-0993-44e3-970c-07d4b81ee407-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.773648 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.773628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.773739 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.773709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0094264d-0993-44e3-970c-07d4b81ee407-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.773739 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.773720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.773810 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.773758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0094264d-0993-44e3-970c-07d4b81ee407-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.785992 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.785969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0094264d-0993-44e3-970c-07d4b81ee407-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.788545 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.788520    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl8kk\" (UniqueName: \"kubernetes.io/projected/0094264d-0993-44e3-970c-07d4b81ee407-kube-api-access-vl8kk\") pod \"istiod-openshift-gateway-5677ccb49b-5vgzv\" (UID: \"0094264d-0993-44e3-970c-07d4b81ee407\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:25.879382 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:25.879357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:26.184131 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:26.184102    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"]
Sep 18 21:12:26.185473 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:12:26.185447    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0094264d_0993_44e3_970c_07d4b81ee407.slice/crio-f5e6e7152becc9559725c25c1750f2ebf18038bee1533daae5f9e4de6fd493f1 WatchSource:0}: Error finding container f5e6e7152becc9559725c25c1750f2ebf18038bee1533daae5f9e4de6fd493f1: Status 404 returned error can't find the container with id f5e6e7152becc9559725c25c1750f2ebf18038bee1533daae5f9e4de6fd493f1
Sep 18 21:12:27.075363 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:27.075329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv" event={"ID":"0094264d-0993-44e3-970c-07d4b81ee407","Type":"ContainerStarted","Data":"f5e6e7152becc9559725c25c1750f2ebf18038bee1533daae5f9e4de6fd493f1"}
Sep 18 21:12:28.373608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:28.373569    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 18 21:12:28.373898 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:28.373634    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 18 21:12:29.085466 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:29.085423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv" event={"ID":"0094264d-0993-44e3-970c-07d4b81ee407","Type":"ContainerStarted","Data":"29277dc4ea56ddd71b59089252a467935eb9e8b5d65c5e2ae311a3f26ccafc0d"}
Sep 18 21:12:29.085665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:29.085637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:29.087406 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:29.087381    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-5vgzv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 21:12:29.087485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:29.087434    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv" podUID="0094264d-0993-44e3-970c-07d4b81ee407" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:12:29.125841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:29.125786    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv" podStartSLOduration=1.939865672 podStartE2EDuration="4.125768833s" totalImagesPullingTime="2.185903161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:12:29.125344555 +0000 UTC m=+382.588123914" watchObservedRunningTime="2026-09-18 21:12:29.125768833 +0000 UTC m=+382.588548191"
Sep 18 21:12:30.090183 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:30.090153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv"
Sep 18 21:12:35.067750 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:35.067717    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-b89p4"
Sep 18 21:12:35.069789 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:12:35.069766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gqd27"
Sep 18 21:14:56.747777 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.747698    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:14:56.750952 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.750931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:56.758358 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.758340    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 21:14:56.759540 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.759522    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 21:14:56.759634 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.759562    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sj6pb\""
Sep 18 21:14:56.770139 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.770123    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 21:14:56.782712 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.782693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:14:56.839870 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.839842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpd6d\" (UniqueName: \"kubernetes.io/projected/e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d-kube-api-access-vpd6d\") pod \"limitador-limitador-84994f7ffc-f64kw\" (UID: \"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:56.839987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.839877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d-config-file\") pod \"limitador-limitador-84994f7ffc-f64kw\" (UID: \"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:56.845271 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.845249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:14:56.940815 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.940795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpd6d\" (UniqueName: \"kubernetes.io/projected/e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d-kube-api-access-vpd6d\") pod \"limitador-limitador-84994f7ffc-f64kw\" (UID: \"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:56.940910 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.940820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d-config-file\") pod \"limitador-limitador-84994f7ffc-f64kw\" (UID: \"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:56.941358 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.941342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d-config-file\") pod \"limitador-limitador-84994f7ffc-f64kw\" (UID: \"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:56.951605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:56.951582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpd6d\" (UniqueName: \"kubernetes.io/projected/e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d-kube-api-access-vpd6d\") pod \"limitador-limitador-84994f7ffc-f64kw\" (UID: \"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:57.059853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:57.059806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:14:57.349957 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:57.349922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:14:57.356342 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:14:57.356316    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05f9495_b6c3_400b_ba7d_7ef9c5d30f2d.slice/crio-22ad35a1e2fdbfaf18a61011c67e3e101d90fbfbc52a713066477bcc636ec432 WatchSource:0}: Error finding container 22ad35a1e2fdbfaf18a61011c67e3e101d90fbfbc52a713066477bcc636ec432: Status 404 returned error can't find the container with id 22ad35a1e2fdbfaf18a61011c67e3e101d90fbfbc52a713066477bcc636ec432
Sep 18 21:14:57.617913 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:14:57.617834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw" event={"ID":"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d","Type":"ContainerStarted","Data":"22ad35a1e2fdbfaf18a61011c67e3e101d90fbfbc52a713066477bcc636ec432"}
Sep 18 21:15:00.634444 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:15:00.634411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw" event={"ID":"e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d","Type":"ContainerStarted","Data":"3002f2d4ab13514313bad2c0afeeb5b4d5cb287331270bd8751d60cd5e58befa"}
Sep 18 21:15:00.634796 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:15:00.634513    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:15:00.666711 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:15:00.666666    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw" podStartSLOduration=2.416722862 podStartE2EDuration="4.666652837s" totalImagesPullingTime="2.249929975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:15:00.665678977 +0000 UTC m=+534.128458333" watchObservedRunningTime="2026-09-18 21:15:00.666652837 +0000 UTC m=+534.129432259"
Sep 18 21:15:11.640145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:15:11.640118    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-f64kw"
Sep 18 21:16:13.144704 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:16:13.144670    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:16:35.706765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:16:35.706692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:16:43.493762 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:16:43.493727    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:16:59.990774 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:16:59.990745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:17:11.993014 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:11.992982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:17:22.598375 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:22.598342    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:17:37.889314 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.889284    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"]
Sep 18 21:17:37.892341 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.892320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:37.898838 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.898490    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 21:17:37.898838 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.898490    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 21:17:37.899536 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.899519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gv5wt\""
Sep 18 21:17:37.899637 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.899586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 18 21:17:37.948141 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.948117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"]
Sep 18 21:17:37.968664 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.968638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:37.968779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.968673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b6j7\" (UniqueName: \"kubernetes.io/projected/fb2660ed-f6d3-4eb2-8f68-266922629f56-kube-api-access-7b6j7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:37.968779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.968718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:37.968779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.968745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb2660ed-f6d3-4eb2-8f68-266922629f56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:37.968943 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.968830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:37.968943 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:37.968875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.069616 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.069590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.069616 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.069617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb2660ed-f6d3-4eb2-8f68-266922629f56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.069784 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.069650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.069784 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.069672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.069784 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.069761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.069784 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.069778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b6j7\" (UniqueName: \"kubernetes.io/projected/fb2660ed-f6d3-4eb2-8f68-266922629f56-kube-api-access-7b6j7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.070109 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.070090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.070172 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.070124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.070208 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.070172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.071779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.071762    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb2660ed-f6d3-4eb2-8f68-266922629f56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.072037 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.072021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb2660ed-f6d3-4eb2-8f68-266922629f56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.094607 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.094582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b6j7\" (UniqueName: \"kubernetes.io/projected/fb2660ed-f6d3-4eb2-8f68-266922629f56-kube-api-access-7b6j7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sfhfc\" (UID: \"fb2660ed-f6d3-4eb2-8f68-266922629f56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.201749 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.201702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:38.488102 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.488037    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"]
Sep 18 21:17:38.491354 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:17:38.491329    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2660ed_f6d3_4eb2_8f68_266922629f56.slice/crio-962e2177d19d491e3bef2a53256f11bcd7a6020967f9911b4aaf37bce4ff3908 WatchSource:0}: Error finding container 962e2177d19d491e3bef2a53256f11bcd7a6020967f9911b4aaf37bce4ff3908: Status 404 returned error can't find the container with id 962e2177d19d491e3bef2a53256f11bcd7a6020967f9911b4aaf37bce4ff3908
Sep 18 21:17:38.492544 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:38.492528    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 21:17:39.250800 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:39.250750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc" event={"ID":"fb2660ed-f6d3-4eb2-8f68-266922629f56","Type":"ContainerStarted","Data":"962e2177d19d491e3bef2a53256f11bcd7a6020967f9911b4aaf37bce4ff3908"}
Sep 18 21:17:39.967996 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:39.967969    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:17:40.255709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:40.255648    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc" event={"ID":"fb2660ed-f6d3-4eb2-8f68-266922629f56","Type":"ContainerStarted","Data":"51d779a2ef7cc092aad5a3815f3a7e288149201ffe2aa292505fb56d99888fc7"}
Sep 18 21:17:40.296224 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:40.296184    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc" podStartSLOduration=2.345687615 podStartE2EDuration="3.296170494s" totalImagesPullingTime="950.482879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:17:40.291011364 +0000 UTC m=+693.753790721" watchObservedRunningTime="2026-09-18 21:17:40.296170494 +0000 UTC m=+693.758949852"
Sep 18 21:17:48.202206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:48.202170    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:48.202608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:48.202245    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:48.214310 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:48.214287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:48.296343 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:48.296318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sfhfc"
Sep 18 21:17:59.816744 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:17:59.816669    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:19:38.923035 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:38.922965    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7879-de7e73"]
Sep 18 21:19:38.924788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:38.924771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:38.927400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:38.927377    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zrg6b\""
Sep 18 21:19:38.932189 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:38.932170    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-de7e73"]
Sep 18 21:19:39.012902 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.012864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8rk\" (UniqueName: \"kubernetes.io/projected/86cde547-5b39-4fa9-9ee3-2cee316537d9-kube-api-access-rc8rk\") pod \"test-curl-7879-de7e73\" (UID: \"86cde547-5b39-4fa9-9ee3-2cee316537d9\") " pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:39.113295 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.113271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8rk\" (UniqueName: \"kubernetes.io/projected/86cde547-5b39-4fa9-9ee3-2cee316537d9-kube-api-access-rc8rk\") pod \"test-curl-7879-de7e73\" (UID: \"86cde547-5b39-4fa9-9ee3-2cee316537d9\") " pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:39.124364 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.124339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8rk\" (UniqueName: \"kubernetes.io/projected/86cde547-5b39-4fa9-9ee3-2cee316537d9-kube-api-access-rc8rk\") pod \"test-curl-7879-de7e73\" (UID: \"86cde547-5b39-4fa9-9ee3-2cee316537d9\") " pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:39.223880 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.223823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:19:39.234271 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.234251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:39.510223 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.510156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-de7e73"]
Sep 18 21:19:39.513754 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:39.513729    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86cde547_5b39_4fa9_9ee3_2cee316537d9.slice/crio-f99403793d6bb48c726a4b3945f566661a2a00acf858218424bf59557e1a1386 WatchSource:0}: Error finding container f99403793d6bb48c726a4b3945f566661a2a00acf858218424bf59557e1a1386: Status 404 returned error can't find the container with id f99403793d6bb48c726a4b3945f566661a2a00acf858218424bf59557e1a1386
Sep 18 21:19:39.727284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:39.727254    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-de7e73" event={"ID":"86cde547-5b39-4fa9-9ee3-2cee316537d9","Type":"ContainerStarted","Data":"f99403793d6bb48c726a4b3945f566661a2a00acf858218424bf59557e1a1386"}
Sep 18 21:19:40.732793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:40.732757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-de7e73" event={"ID":"86cde547-5b39-4fa9-9ee3-2cee316537d9","Type":"ContainerStarted","Data":"2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744"}
Sep 18 21:19:40.759019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:40.758974    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7879-de7e73" podStartSLOduration=2.019289939 podStartE2EDuration="2.758959161s" totalImagesPullingTime="739.669222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:40.757490758 +0000 UTC m=+814.220270117" watchObservedRunningTime="2026-09-18 21:19:40.758959161 +0000 UTC m=+814.221738518"
Sep 18 21:19:41.513380 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.513305    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7879-de7e73"]
Sep 18 21:19:41.522805 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.522774    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7879-de7e73"]
Sep 18 21:19:41.661833 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.661805    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7879-0ecc1e"]
Sep 18 21:19:41.662129 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.662114    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86cde547-5b39-4fa9-9ee3-2cee316537d9" containerName="test-curl-7879-de7e73"
Sep 18 21:19:41.662174 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.662130    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86cde547-5b39-4fa9-9ee3-2cee316537d9" containerName="test-curl-7879-de7e73"
Sep 18 21:19:41.662206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.662179    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86cde547-5b39-4fa9-9ee3-2cee316537d9" containerName="test-curl-7879-de7e73"
Sep 18 21:19:41.664060 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.664046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:41.676334 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.676312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-0ecc1e"]
Sep 18 21:19:41.732934 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.732912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gmpx\" (UniqueName: \"kubernetes.io/projected/6ceea917-441b-49eb-a766-409bbfef8444-kube-api-access-4gmpx\") pod \"test-curl-7879-0ecc1e\" (UID: \"6ceea917-441b-49eb-a766-409bbfef8444\") " pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:41.736015 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:41.735996    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7879-de7e73" container="test-curl-7879-de7e73"
Sep 18 21:19:41.833851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.833831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gmpx\" (UniqueName: \"kubernetes.io/projected/6ceea917-441b-49eb-a766-409bbfef8444-kube-api-access-4gmpx\") pod \"test-curl-7879-0ecc1e\" (UID: \"6ceea917-441b-49eb-a766-409bbfef8444\") " pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:41.855293 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.855270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gmpx\" (UniqueName: \"kubernetes.io/projected/6ceea917-441b-49eb-a766-409bbfef8444-kube-api-access-4gmpx\") pod \"test-curl-7879-0ecc1e\" (UID: \"6ceea917-441b-49eb-a766-409bbfef8444\") " pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:41.972568 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:41.972544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:42.270525 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:42.270500    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-0ecc1e"]
Sep 18 21:19:42.271159 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:42.271133    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ceea917_441b_49eb_a766_409bbfef8444.slice/crio-7e255fc197ff80fb857084e2af297d4d13d47a6d9368a759b5dd3a00e81e8d55 WatchSource:0}: Error finding container 7e255fc197ff80fb857084e2af297d4d13d47a6d9368a759b5dd3a00e81e8d55: Status 404 returned error can't find the container with id 7e255fc197ff80fb857084e2af297d4d13d47a6d9368a759b5dd3a00e81e8d55
Sep 18 21:19:42.741049 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:42.741018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-0ecc1e" event={"ID":"6ceea917-441b-49eb-a766-409bbfef8444","Type":"ContainerStarted","Data":"d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70"}
Sep 18 21:19:42.741394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:42.741061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-0ecc1e" event={"ID":"6ceea917-441b-49eb-a766-409bbfef8444","Type":"ContainerStarted","Data":"7e255fc197ff80fb857084e2af297d4d13d47a6d9368a759b5dd3a00e81e8d55"}
Sep 18 21:19:42.741394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:42.741086    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7879-de7e73" podUID="86cde547-5b39-4fa9-9ee3-2cee316537d9" containerName="test-curl-7879-de7e73" containerID="cri-o://2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744" gracePeriod=2
Sep 18 21:19:42.770689 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:42.770645    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7879-0ecc1e" podStartSLOduration=1.770632024 podStartE2EDuration="1.770632024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:42.770095244 +0000 UTC m=+816.232874602" watchObservedRunningTime="2026-09-18 21:19:42.770632024 +0000 UTC m=+816.233411380"
Sep 18 21:19:43.683410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:43.683339    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7879-0ecc1e"]
Sep 18 21:19:43.704758 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:43.704735    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7879-0ecc1e"]
Sep 18 21:19:43.746069 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:43.746043    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7879-0ecc1e" container="test-curl-7879-0ecc1e"
Sep 18 21:19:44.174338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.174306    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"]
Sep 18 21:19:44.174659 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.174631    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ceea917-441b-49eb-a766-409bbfef8444" containerName="test-curl-7879-0ecc1e"
Sep 18 21:19:44.174659 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.174650    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ceea917-441b-49eb-a766-409bbfef8444" containerName="test-curl-7879-0ecc1e"
Sep 18 21:19:44.174791 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.174739    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ceea917-441b-49eb-a766-409bbfef8444" containerName="test-curl-7879-0ecc1e"
Sep 18 21:19:44.176467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.176447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.182092 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.180299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-116f55\""
Sep 18 21:19:44.225985 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.225963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"]
Sep 18 21:19:44.255028 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.255003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wchzj\" (UniqueName: \"kubernetes.io/projected/7bae7052-019d-450d-9085-bf854a58fa3f-kube-api-access-wchzj\") pod \"payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.255138 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.255062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bae7052-019d-450d-9085-bf854a58fa3f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.349564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.349532    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"]
Sep 18 21:19:44.351912 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.351879    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.355500 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.355471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wchzj\" (UniqueName: \"kubernetes.io/projected/7bae7052-019d-450d-9085-bf854a58fa3f-kube-api-access-wchzj\") pod \"payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.355627 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.355614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bae7052-019d-450d-9085-bf854a58fa3f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.356250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.356229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bae7052-019d-450d-9085-bf854a58fa3f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.361213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.361199    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-116f55-dockercfg-bqcsl\""
Sep 18 21:19:44.382404 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.382385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wchzj\" (UniqueName: \"kubernetes.io/projected/7bae7052-019d-450d-9085-bf854a58fa3f-kube-api-access-wchzj\") pod \"payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.423644 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.423614    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"]
Sep 18 21:19:44.456804 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.456748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f8x5\" (UniqueName: \"kubernetes.io/projected/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-kube-api-access-6f8x5\") pod \"payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") " pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.456804 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.456789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") " pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.490727 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.490702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:44.558223 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.558188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") " pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.558330 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.558313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f8x5\" (UniqueName: \"kubernetes.io/projected/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-kube-api-access-6f8x5\") pod \"payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") " pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.559009 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.558989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") " pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.708562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.708498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f8x5\" (UniqueName: \"kubernetes.io/projected/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-kube-api-access-6f8x5\") pod \"payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") " pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.750495 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.750458    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7879-0ecc1e" podUID="6ceea917-441b-49eb-a766-409bbfef8444" containerName="test-curl-7879-0ecc1e" containerID="cri-o://d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70" gracePeriod=2
Sep 18 21:19:44.826528 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.826495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"]
Sep 18 21:19:44.829317 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:44.829283    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bae7052_019d_450d_9085_bf854a58fa3f.slice/crio-bd6c534dc328ac02a2c748e864178c07d2aee4696b891accbf6e0d603473f7f5 WatchSource:0}: Error finding container bd6c534dc328ac02a2c748e864178c07d2aee4696b891accbf6e0d603473f7f5: Status 404 returned error can't find the container with id bd6c534dc328ac02a2c748e864178c07d2aee4696b891accbf6e0d603473f7f5
Sep 18 21:19:44.928881 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.928853    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:44.961137 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.961080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:44.963795 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.963769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc8rk\" (UniqueName: \"kubernetes.io/projected/86cde547-5b39-4fa9-9ee3-2cee316537d9-kube-api-access-rc8rk\") pod \"86cde547-5b39-4fa9-9ee3-2cee316537d9\" (UID: \"86cde547-5b39-4fa9-9ee3-2cee316537d9\") "
Sep 18 21:19:44.966080 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:44.966044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86cde547-5b39-4fa9-9ee3-2cee316537d9-kube-api-access-rc8rk" (OuterVolumeSpecName: "kube-api-access-rc8rk") pod "86cde547-5b39-4fa9-9ee3-2cee316537d9" (UID: "86cde547-5b39-4fa9-9ee3-2cee316537d9"). InnerVolumeSpecName "kube-api-access-rc8rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:19:45.064688 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.064655    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc8rk\" (UniqueName: \"kubernetes.io/projected/86cde547-5b39-4fa9-9ee3-2cee316537d9-kube-api-access-rc8rk\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:19:45.316210 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.316143    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"]
Sep 18 21:19:45.348339 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:45.348309    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46b350a_e646_4411_ba8b_1ca6f1bab8b2.slice/crio-c3f78ae46c874d65cf4cd7a1d72f8921f0889c775847171341ba52b4bfafe351 WatchSource:0}: Error finding container c3f78ae46c874d65cf4cd7a1d72f8921f0889c775847171341ba52b4bfafe351: Status 404 returned error can't find the container with id c3f78ae46c874d65cf4cd7a1d72f8921f0889c775847171341ba52b4bfafe351
Sep 18 21:19:45.756653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.756611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr" event={"ID":"a46b350a-e646-4411-ba8b-1ca6f1bab8b2","Type":"ContainerStarted","Data":"c3f78ae46c874d65cf4cd7a1d72f8921f0889c775847171341ba52b4bfafe351"}
Sep 18 21:19:45.758321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.758254    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw" event={"ID":"7bae7052-019d-450d-9085-bf854a58fa3f","Type":"ContainerStarted","Data":"bd6c534dc328ac02a2c748e864178c07d2aee4696b891accbf6e0d603473f7f5"}
Sep 18 21:19:45.760099 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.760062    2576 generic.go:356] "Generic (PLEG): container finished" podID="86cde547-5b39-4fa9-9ee3-2cee316537d9" containerID="2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744" exitCode=137
Sep 18 21:19:45.760207 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.760116    2576 scope.go:117] "RemoveContainer" containerID="2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744"
Sep 18 21:19:45.760207 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.760130    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:45.771961 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.771934    2576 scope.go:117] "RemoveContainer" containerID="2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744"
Sep 18 21:19:45.772998 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:45.772971    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744\": container with ID starting with 2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744 not found: ID does not exist" containerID="2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744"
Sep 18 21:19:45.773097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:45.773008    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744"} err="failed to get container status \"2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744\": rpc error: code = NotFound desc = could not find container \"2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744\": container with ID starting with 2440ba8da96524968b582eefa183e767403d47dba2ae1b5783db88d5cb1a8744 not found: ID does not exist"
Sep 18 21:19:45.776336 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:45.776306    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-de7e73\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="86cde547-5b39-4fa9-9ee3-2cee316537d9" pod="opendatahub/test-curl-7879-de7e73"
Sep 18 21:19:46.740556 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:46.740526    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86cde547-5b39-4fa9-9ee3-2cee316537d9" path="/var/lib/kubelet/pods/86cde547-5b39-4fa9-9ee3-2cee316537d9/volumes"
Sep 18 21:19:47.354008 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.353985    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:47.487105 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.487026    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gmpx\" (UniqueName: \"kubernetes.io/projected/6ceea917-441b-49eb-a766-409bbfef8444-kube-api-access-4gmpx\") pod \"6ceea917-441b-49eb-a766-409bbfef8444\" (UID: \"6ceea917-441b-49eb-a766-409bbfef8444\") "
Sep 18 21:19:47.488980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.488953    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ceea917-441b-49eb-a766-409bbfef8444-kube-api-access-4gmpx" (OuterVolumeSpecName: "kube-api-access-4gmpx") pod "6ceea917-441b-49eb-a766-409bbfef8444" (UID: "6ceea917-441b-49eb-a766-409bbfef8444"). InnerVolumeSpecName "kube-api-access-4gmpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:19:47.587829 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.587802    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gmpx\" (UniqueName: \"kubernetes.io/projected/6ceea917-441b-49eb-a766-409bbfef8444-kube-api-access-4gmpx\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:19:47.773157 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.773076    2576 generic.go:356] "Generic (PLEG): container finished" podID="6ceea917-441b-49eb-a766-409bbfef8444" containerID="d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70" exitCode=137
Sep 18 21:19:47.773157 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.773122    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:47.773364 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.773174    2576 scope.go:117] "RemoveContainer" containerID="d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70"
Sep 18 21:19:47.775084 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.775025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr" event={"ID":"a46b350a-e646-4411-ba8b-1ca6f1bab8b2","Type":"ContainerStarted","Data":"0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9"}
Sep 18 21:19:47.777092 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.777034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw" event={"ID":"7bae7052-019d-450d-9085-bf854a58fa3f","Type":"ContainerStarted","Data":"3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8"}
Sep 18 21:19:47.777221 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.777177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:47.783424 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.783408    2576 scope.go:117] "RemoveContainer" containerID="d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70"
Sep 18 21:19:47.783694 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:47.783678    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70\": container with ID starting with d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70 not found: ID does not exist" containerID="d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70"
Sep 18 21:19:47.783747 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.783701    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70"} err="failed to get container status \"d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70\": rpc error: code = NotFound desc = could not find container \"d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70\": container with ID starting with d7b2ee02e3c8103d22dd4c66c320e4c2315587f959949a15892d831c5a522d70 not found: ID does not exist"
Sep 18 21:19:47.804943 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.804875    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr" podStartSLOduration=1.913258251 podStartE2EDuration="3.804862463s" totalImagesPullingTime="1.891604212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:47.803686442 +0000 UTC m=+821.266465799" watchObservedRunningTime="2026-09-18 21:19:47.804862463 +0000 UTC m=+821.267641819"
Sep 18 21:19:47.812194 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:47.812167    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-0ecc1e\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="6ceea917-441b-49eb-a766-409bbfef8444" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:47.874922 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:47.874860    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw" podStartSLOduration=1.467256347 podStartE2EDuration="3.874843611s" totalImagesPullingTime="2.407587264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:47.872701664 +0000 UTC m=+821.335481021" watchObservedRunningTime="2026-09-18 21:19:47.874843611 +0000 UTC m=+821.337622990"
Sep 18 21:19:48.088974 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.088941    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"]
Sep 18 21:19:48.091766 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.091741    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.096059 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.096038    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-6ad49b\""
Sep 18 21:19:48.096158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.096126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-6ad49b-dockercfg-rkx6z\""
Sep 18 21:19:48.113381 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.113357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"]
Sep 18 21:19:48.137290 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.137258    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"]
Sep 18 21:19:48.147224 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.142326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.147224 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:48.146779    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-0ecc1e\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="6ceea917-441b-49eb-a766-409bbfef8444" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:48.149418 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:48.149390    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-0ecc1e\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="6ceea917-441b-49eb-a766-409bbfef8444" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:48.156078 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.155620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"]
Sep 18 21:19:48.193175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.193144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efce641-0555-4c50-a8ea-0c27bf84f72f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.193348 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.193205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6xrv\" (UniqueName: \"kubernetes.io/projected/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-kube-api-access-d6xrv\") pod \"payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.193348 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.193261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5g65\" (UniqueName: \"kubernetes.io/projected/1efce641-0555-4c50-a8ea-0c27bf84f72f-kube-api-access-d5g65\") pod \"payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.193348 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.193290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.293954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.293913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6xrv\" (UniqueName: \"kubernetes.io/projected/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-kube-api-access-d6xrv\") pod \"payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.294140 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.293968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5g65\" (UniqueName: \"kubernetes.io/projected/1efce641-0555-4c50-a8ea-0c27bf84f72f-kube-api-access-d5g65\") pod \"payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.294140 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.293988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.294140 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.294051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efce641-0555-4c50-a8ea-0c27bf84f72f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.294759 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.294739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.294816 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.294754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efce641-0555-4c50-a8ea-0c27bf84f72f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.305192 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.305160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6xrv\" (UniqueName: \"kubernetes.io/projected/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-kube-api-access-d6xrv\") pod \"payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.305867 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.305846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5g65\" (UniqueName: \"kubernetes.io/projected/1efce641-0555-4c50-a8ea-0c27bf84f72f-kube-api-access-d5g65\") pod \"payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.401033 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.400959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.460072 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.460032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:48.679557 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.679534    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"]
Sep 18 21:19:48.681136 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:48.681109    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efce641_0555_4c50_a8ea_0c27bf84f72f.slice/crio-b91815f661d959c050044596d072a56ea39ad8de835a813e27c48961c3041f40 WatchSource:0}: Error finding container b91815f661d959c050044596d072a56ea39ad8de835a813e27c48961c3041f40: Status 404 returned error can't find the container with id b91815f661d959c050044596d072a56ea39ad8de835a813e27c48961c3041f40
Sep 18 21:19:48.742718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.742689    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ceea917-441b-49eb-a766-409bbfef8444" path="/var/lib/kubelet/pods/6ceea917-441b-49eb-a766-409bbfef8444/volumes"
Sep 18 21:19:48.742807 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:19:48.742731    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-0ecc1e\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="6ceea917-441b-49eb-a766-409bbfef8444" pod="opendatahub/test-curl-7879-0ecc1e"
Sep 18 21:19:48.764007 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.763978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"]
Sep 18 21:19:48.767361 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:48.767331    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4ab885_0bce_4046_8c46_7fdebbe70f9b.slice/crio-83e027a433d6f5504bdfe5462615359e7ea682d11f289bccc5c661e18feace83 WatchSource:0}: Error finding container 83e027a433d6f5504bdfe5462615359e7ea682d11f289bccc5c661e18feace83: Status 404 returned error can't find the container with id 83e027a433d6f5504bdfe5462615359e7ea682d11f289bccc5c661e18feace83
Sep 18 21:19:48.784841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.784816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g" event={"ID":"1efce641-0555-4c50-a8ea-0c27bf84f72f","Type":"ContainerStarted","Data":"4ca952a1b197682833d048e75088b571b4f5a6d48fdcc41b57a04957ce3c4a94"}
Sep 18 21:19:48.784939 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.784865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g" event={"ID":"1efce641-0555-4c50-a8ea-0c27bf84f72f","Type":"ContainerStarted","Data":"b91815f661d959c050044596d072a56ea39ad8de835a813e27c48961c3041f40"}
Sep 18 21:19:48.784939 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.784922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:19:48.786087 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.786059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7" event={"ID":"7d4ab885-0bce-4046-8c46-7fdebbe70f9b","Type":"ContainerStarted","Data":"83e027a433d6f5504bdfe5462615359e7ea682d11f289bccc5c661e18feace83"}
Sep 18 21:19:48.787422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.787368    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:48.811110 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:48.811069    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g" podStartSLOduration=0.811050965 podStartE2EDuration="811.050965ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:48.808789565 +0000 UTC m=+822.271568922" watchObservedRunningTime="2026-09-18 21:19:48.811050965 +0000 UTC m=+822.273830326"
Sep 18 21:19:49.753557 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.753516    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"]
Sep 18 21:19:49.756422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.756403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:49.763732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.763712    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a7d035\""
Sep 18 21:19:49.792510 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.792414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"]
Sep 18 21:19:49.794669 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.794639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7" event={"ID":"7d4ab885-0bce-4046-8c46-7fdebbe70f9b","Type":"ContainerStarted","Data":"a6d6536d9d239fb14c6d6abeb4c3ac649f91ddcf158402470e4ba5fd65f399cd"}
Sep 18 21:19:49.805839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.805816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:49.805960 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.805856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpf47\" (UniqueName: \"kubernetes.io/projected/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-kube-api-access-fpf47\") pod \"payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:49.812275 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.812254    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"]
Sep 18 21:19:49.814316 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.814303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:49.817381 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.817363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a7d035-dockercfg-p8zxf\""
Sep 18 21:19:49.839622 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.839597    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"]
Sep 18 21:19:49.883739 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.883684    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7" podStartSLOduration=1.8836652329999999 podStartE2EDuration="1.883665233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:49.882867622 +0000 UTC m=+823.345646982" watchObservedRunningTime="2026-09-18 21:19:49.883665233 +0000 UTC m=+823.346444594"
Sep 18 21:19:49.906787 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.906760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a9634c-8c01-40d8-9a57-eca0d1c32500-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:49.906987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.906955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:49.907093 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.907073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpf47\" (UniqueName: \"kubernetes.io/projected/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-kube-api-access-fpf47\") pod \"payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:49.907167 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.907136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95wk9\" (UniqueName: \"kubernetes.io/projected/02a9634c-8c01-40d8-9a57-eca0d1c32500-kube-api-access-95wk9\") pod \"payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:49.907763 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.907747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:49.927149 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:49.927119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpf47\" (UniqueName: \"kubernetes.io/projected/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-kube-api-access-fpf47\") pod \"payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:50.008058 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.007987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95wk9\" (UniqueName: \"kubernetes.io/projected/02a9634c-8c01-40d8-9a57-eca0d1c32500-kube-api-access-95wk9\") pod \"payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:50.008058 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.008037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a9634c-8c01-40d8-9a57-eca0d1c32500-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:50.008658 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.008641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a9634c-8c01-40d8-9a57-eca0d1c32500-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:50.031898 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.031860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95wk9\" (UniqueName: \"kubernetes.io/projected/02a9634c-8c01-40d8-9a57-eca0d1c32500-kube-api-access-95wk9\") pod \"payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:50.070480 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.070453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:50.124656 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.124101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:50.352047 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.352019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"]
Sep 18 21:19:50.353569 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:50.353542    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4f5785_28c6_4631_aa3d_1ba5cd4018f8.slice/crio-d3c1658daaea5b41d3e3e588eed63ea422c008f17b8ce8f87636fba2c8ba2b33 WatchSource:0}: Error finding container d3c1658daaea5b41d3e3e588eed63ea422c008f17b8ce8f87636fba2c8ba2b33: Status 404 returned error can't find the container with id d3c1658daaea5b41d3e3e588eed63ea422c008f17b8ce8f87636fba2c8ba2b33
Sep 18 21:19:50.409442 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.409419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"]
Sep 18 21:19:50.411491 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:50.411465    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a9634c_8c01_40d8_9a57_eca0d1c32500.slice/crio-da9e2dd3c931601c2de96a7f85a170152cd80ed40b80dfb73320c5adf56cd2bd WatchSource:0}: Error finding container da9e2dd3c931601c2de96a7f85a170152cd80ed40b80dfb73320c5adf56cd2bd: Status 404 returned error can't find the container with id da9e2dd3c931601c2de96a7f85a170152cd80ed40b80dfb73320c5adf56cd2bd
Sep 18 21:19:50.800325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.800244    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv" event={"ID":"02a9634c-8c01-40d8-9a57-eca0d1c32500","Type":"ContainerStarted","Data":"4a6caefb64a8cbcfd5b80c8a3ff0951d31a75d6e96c349d243bcd0f57cb3d0f1"}
Sep 18 21:19:50.800325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.800306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:19:50.800767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.800335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv" event={"ID":"02a9634c-8c01-40d8-9a57-eca0d1c32500","Type":"ContainerStarted","Data":"da9e2dd3c931601c2de96a7f85a170152cd80ed40b80dfb73320c5adf56cd2bd"}
Sep 18 21:19:50.801879 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.801854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv" event={"ID":"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8","Type":"ContainerStarted","Data":"f6ed06485da7625c0f16406aa61301d0f4c95719041a74985b7db7dcbfe98ae2"}
Sep 18 21:19:50.802075 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.802046    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:19:50.802182 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.802094    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:19:50.802182 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.802123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv" event={"ID":"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8","Type":"ContainerStarted","Data":"d3c1658daaea5b41d3e3e588eed63ea422c008f17b8ce8f87636fba2c8ba2b33"}
Sep 18 21:19:50.856704 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.856649    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv" podStartSLOduration=1.856624999 podStartE2EDuration="1.856624999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:50.856268762 +0000 UTC m=+824.319048128" watchObservedRunningTime="2026-09-18 21:19:50.856624999 +0000 UTC m=+824.319404357"
Sep 18 21:19:50.891062 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:50.891010    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv" podStartSLOduration=1.890997542 podStartE2EDuration="1.890997542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:50.890020509 +0000 UTC m=+824.352799865" watchObservedRunningTime="2026-09-18 21:19:50.890997542 +0000 UTC m=+824.353776899"
Sep 18 21:19:53.052578 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:53.052546    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:19:56.469858 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.469831    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"]
Sep 18 21:19:56.472129 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.472111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.475835 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.475813    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-21df59\""
Sep 18 21:19:56.476162 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.476146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-21df59-dockercfg-r7jkw\""
Sep 18 21:19:56.493985 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.493959    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"]
Sep 18 21:19:56.564247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.564209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c7d31d-4e3f-4019-947b-4fb944087d71-plugins-config-volume\") pod \"payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") " pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.564368 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.564352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t77nf\" (UniqueName: \"kubernetes.io/projected/91c7d31d-4e3f-4019-947b-4fb944087d71-kube-api-access-t77nf\") pod \"payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") " pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.665084 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.665058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t77nf\" (UniqueName: \"kubernetes.io/projected/91c7d31d-4e3f-4019-947b-4fb944087d71-kube-api-access-t77nf\") pod \"payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") " pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.665213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.665094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c7d31d-4e3f-4019-947b-4fb944087d71-plugins-config-volume\") pod \"payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") " pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.665718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.665701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c7d31d-4e3f-4019-947b-4fb944087d71-plugins-config-volume\") pod \"payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") " pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.694844 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.694814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t77nf\" (UniqueName: \"kubernetes.io/projected/91c7d31d-4e3f-4019-947b-4fb944087d71-kube-api-access-t77nf\") pod \"payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") " pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:56.782809 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:56.782760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:57.116586 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:57.116564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"]
Sep 18 21:19:57.118870 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:19:57.118836    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c7d31d_4e3f_4019_947b_4fb944087d71.slice/crio-0901b2b7462ffcb3050092c243b3707fac5ab2a1e2d269856725cc35e7cf8d3b WatchSource:0}: Error finding container 0901b2b7462ffcb3050092c243b3707fac5ab2a1e2d269856725cc35e7cf8d3b: Status 404 returned error can't find the container with id 0901b2b7462ffcb3050092c243b3707fac5ab2a1e2d269856725cc35e7cf8d3b
Sep 18 21:19:57.836138 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:57.836099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n" event={"ID":"91c7d31d-4e3f-4019-947b-4fb944087d71","Type":"ContainerStarted","Data":"513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc"}
Sep 18 21:19:57.836484 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:57.836160    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:19:57.836484 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:57.836180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n" event={"ID":"91c7d31d-4e3f-4019-947b-4fb944087d71","Type":"ContainerStarted","Data":"0901b2b7462ffcb3050092c243b3707fac5ab2a1e2d269856725cc35e7cf8d3b"}
Sep 18 21:19:57.871405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:57.871362    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n" podStartSLOduration=1.87134753 podStartE2EDuration="1.87134753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:19:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:19:57.870110272 +0000 UTC m=+831.332889648" watchObservedRunningTime="2026-09-18 21:19:57.87134753 +0000 UTC m=+831.334126887"
Sep 18 21:19:58.788991 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:58.788964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:19:59.797079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:59.797049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:19:59.797534 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:19:59.797129    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:20:01.808703 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:01.808669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:20:01.809086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:01.808742    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:20:01.809086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:01.808787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:20:05.811111 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.811077    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"]
Sep 18 21:20:05.813250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.813234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:05.816584 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.816563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ef01a1fd\""
Sep 18 21:20:05.817174 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.817154    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ef01a1fd-dockercfg-9wmzs\""
Sep 18 21:20:05.844127 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.844097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"]
Sep 18 21:20:05.947833 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.947805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pspp\" (UniqueName: \"kubernetes.io/projected/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-kube-api-access-8pspp\") pod \"payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:05.947954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:05.947842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.048965 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.048936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pspp\" (UniqueName: \"kubernetes.io/projected/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-kube-api-access-8pspp\") pod \"payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.049091 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.048976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.049591 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.049575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.058152 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.058129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pspp\" (UniqueName: \"kubernetes.io/projected/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-kube-api-access-8pspp\") pod \"payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.122601 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.122577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.420199 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.420087    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"]
Sep 18 21:20:06.422234 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:20:06.422204    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ee1ff0_2577_46a7_b68d_e1113fe3640a.slice/crio-aba4f49dc9b706360658e4dffa089af8d1a82c5dab16000283ad21cd140c000b WatchSource:0}: Error finding container aba4f49dc9b706360658e4dffa089af8d1a82c5dab16000283ad21cd140c000b: Status 404 returned error can't find the container with id aba4f49dc9b706360658e4dffa089af8d1a82c5dab16000283ad21cd140c000b
Sep 18 21:20:06.877940 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.877908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn" event={"ID":"e0ee1ff0-2577-46a7-b68d-e1113fe3640a","Type":"ContainerStarted","Data":"42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7"}
Sep 18 21:20:06.878286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.877957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn" event={"ID":"e0ee1ff0-2577-46a7-b68d-e1113fe3640a","Type":"ContainerStarted","Data":"aba4f49dc9b706360658e4dffa089af8d1a82c5dab16000283ad21cd140c000b"}
Sep 18 21:20:06.878286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.878008    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:06.929463 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:06.929407    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn" podStartSLOduration=1.9293871949999999 podStartE2EDuration="1.929387195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:20:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:20:06.928558388 +0000 UTC m=+840.391337745" watchObservedRunningTime="2026-09-18 21:20:06.929387195 +0000 UTC m=+840.392166555"
Sep 18 21:20:08.841961 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:08.841935    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:20:10.588317 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.588288    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"]
Sep 18 21:20:10.591529 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.591510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.597586 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.597350    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1f86a8-dockercfg-x2wdh\""
Sep 18 21:20:10.597586 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.597459    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1f86a8\""
Sep 18 21:20:10.613535 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.613511    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"]
Sep 18 21:20:10.683546 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.683521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9zs4\" (UniqueName: \"kubernetes.io/projected/74b3e6ae-89f1-402a-8565-3f6d40fba088-kube-api-access-q9zs4\") pod \"payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.683660 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.683566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74b3e6ae-89f1-402a-8565-3f6d40fba088-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.784873 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.784841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74b3e6ae-89f1-402a-8565-3f6d40fba088-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.785025 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.784922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9zs4\" (UniqueName: \"kubernetes.io/projected/74b3e6ae-89f1-402a-8565-3f6d40fba088-kube-api-access-q9zs4\") pod \"payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.785561 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.785539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74b3e6ae-89f1-402a-8565-3f6d40fba088-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.801175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.801146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9zs4\" (UniqueName: \"kubernetes.io/projected/74b3e6ae-89f1-402a-8565-3f6d40fba088-kube-api-access-q9zs4\") pod \"payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:10.901045 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:10.900969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:11.211755 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:11.211725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"]
Sep 18 21:20:11.214537 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:20:11.214501    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b3e6ae_89f1_402a_8565_3f6d40fba088.slice/crio-e7cdd121eb92ac80cad2736ca9aead886f2a1fdfe3bb364ed6b65aeb4fc50d99 WatchSource:0}: Error finding container e7cdd121eb92ac80cad2736ca9aead886f2a1fdfe3bb364ed6b65aeb4fc50d99: Status 404 returned error can't find the container with id e7cdd121eb92ac80cad2736ca9aead886f2a1fdfe3bb364ed6b65aeb4fc50d99
Sep 18 21:20:11.902532 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:11.902497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk" event={"ID":"74b3e6ae-89f1-402a-8565-3f6d40fba088","Type":"ContainerStarted","Data":"15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497"}
Sep 18 21:20:11.902532 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:11.902540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk" event={"ID":"74b3e6ae-89f1-402a-8565-3f6d40fba088","Type":"ContainerStarted","Data":"e7cdd121eb92ac80cad2736ca9aead886f2a1fdfe3bb364ed6b65aeb4fc50d99"}
Sep 18 21:20:11.903011 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:11.902571    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:11.927466 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:11.927415    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk" podStartSLOduration=1.927397711 podStartE2EDuration="1.927397711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:20:11.924572355 +0000 UTC m=+845.387351712" watchObservedRunningTime="2026-09-18 21:20:11.927397711 +0000 UTC m=+845.390177067"
Sep 18 21:20:16.786300 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:16.786268    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"]
Sep 18 21:20:16.788801 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:16.788782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:16.792518 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:16.792496    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:20:16.792627 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:16.792576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:20:16.814899 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:16.814870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"]
Sep 18 21:20:16.934796 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:16.934764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c84f05-d8a6-49af-9831-dd592f0de49b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv\" (UID: \"39c84f05-d8a6-49af-9831-dd592f0de49b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:17.036078 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:17.036050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c84f05-d8a6-49af-9831-dd592f0de49b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv\" (UID: \"39c84f05-d8a6-49af-9831-dd592f0de49b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:17.036623 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:17.036582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c84f05-d8a6-49af-9831-dd592f0de49b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv\" (UID: \"39c84f05-d8a6-49af-9831-dd592f0de49b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:17.098219 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:17.098197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:17.409191 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:17.409167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"]
Sep 18 21:20:17.410805 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:20:17.410774    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c84f05_d8a6_49af_9831_dd592f0de49b.slice/crio-1112757526b27eab20654966f066c1071a3d68ce599ad2bfe54d3a7dbc83efb3 WatchSource:0}: Error finding container 1112757526b27eab20654966f066c1071a3d68ce599ad2bfe54d3a7dbc83efb3: Status 404 returned error can't find the container with id 1112757526b27eab20654966f066c1071a3d68ce599ad2bfe54d3a7dbc83efb3
Sep 18 21:20:17.884993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:17.884968    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:17.936038 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:17.936007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv" event={"ID":"39c84f05-d8a6-49af-9831-dd592f0de49b","Type":"ContainerStarted","Data":"1112757526b27eab20654966f066c1071a3d68ce599ad2bfe54d3a7dbc83efb3"}
Sep 18 21:20:19.547126 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:19.547095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:20:20.951783 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:20.951748    2576 generic.go:356] "Generic (PLEG): container finished" podID="39c84f05-d8a6-49af-9831-dd592f0de49b" containerID="57322c3ab007891f96186ec19df9b405c2ee9539d4f2f3d99dee6a8235d75e29" exitCode=0
Sep 18 21:20:20.952202 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:20.951792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv" event={"ID":"39c84f05-d8a6-49af-9831-dd592f0de49b","Type":"ContainerDied","Data":"57322c3ab007891f96186ec19df9b405c2ee9539d4f2f3d99dee6a8235d75e29"}
Sep 18 21:20:22.084981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.084958    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:22.178609 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.178582    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c84f05-d8a6-49af-9831-dd592f0de49b-maas-api-service-ca\") pod \"39c84f05-d8a6-49af-9831-dd592f0de49b\" (UID: \"39c84f05-d8a6-49af-9831-dd592f0de49b\") "
Sep 18 21:20:22.178924 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.178872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39c84f05-d8a6-49af-9831-dd592f0de49b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39c84f05-d8a6-49af-9831-dd592f0de49b" (UID: "39c84f05-d8a6-49af-9831-dd592f0de49b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:20:22.279877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.279815    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c84f05-d8a6-49af-9831-dd592f0de49b-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:20:22.908858 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.908812    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:20:22.962520 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.962497    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"
Sep 18 21:20:22.962520 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.962510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv" event={"ID":"39c84f05-d8a6-49af-9831-dd592f0de49b","Type":"ContainerDied","Data":"1112757526b27eab20654966f066c1071a3d68ce599ad2bfe54d3a7dbc83efb3"}
Sep 18 21:20:22.962704 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:22.962557    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1112757526b27eab20654966f066c1071a3d68ce599ad2bfe54d3a7dbc83efb3"
Sep 18 21:20:27.467994 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.467963    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"]
Sep 18 21:20:27.468401 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.468176    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn" podUID="e0ee1ff0-2577-46a7-b68d-e1113fe3640a" containerName="payload-pre-processing" containerID="cri-o://42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7" gracePeriod=30
Sep 18 21:20:27.720171 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.720115    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:27.821689 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.821656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pspp\" (UniqueName: \"kubernetes.io/projected/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-kube-api-access-8pspp\") pod \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") "
Sep 18 21:20:27.821866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.821704    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-plugins-config-volume\") pod \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\" (UID: \"e0ee1ff0-2577-46a7-b68d-e1113fe3640a\") "
Sep 18 21:20:27.822125 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.822097    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0ee1ff0-2577-46a7-b68d-e1113fe3640a" (UID: "e0ee1ff0-2577-46a7-b68d-e1113fe3640a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:20:27.823399 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.823373    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"]
Sep 18 21:20:27.823988 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.823968    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-kube-api-access-8pspp" (OuterVolumeSpecName: "kube-api-access-8pspp") pod "e0ee1ff0-2577-46a7-b68d-e1113fe3640a" (UID: "e0ee1ff0-2577-46a7-b68d-e1113fe3640a"). InnerVolumeSpecName "kube-api-access-8pspp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:20:27.830943 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.830921    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef01a1fd-fwqmv"]
Sep 18 21:20:27.922786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.922758    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pspp\" (UniqueName: \"kubernetes.io/projected/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-kube-api-access-8pspp\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:20:27.922786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.922783    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ee1ff0-2577-46a7-b68d-e1113fe3640a-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:20:27.987088 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.987017    2576 generic.go:356] "Generic (PLEG): container finished" podID="e0ee1ff0-2577-46a7-b68d-e1113fe3640a" containerID="42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7" exitCode=0
Sep 18 21:20:27.987088 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.987061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn" event={"ID":"e0ee1ff0-2577-46a7-b68d-e1113fe3640a","Type":"ContainerDied","Data":"42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7"}
Sep 18 21:20:27.987088 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.987077    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"
Sep 18 21:20:27.987300 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.987107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn" event={"ID":"e0ee1ff0-2577-46a7-b68d-e1113fe3640a","Type":"ContainerDied","Data":"aba4f49dc9b706360658e4dffa089af8d1a82c5dab16000283ad21cd140c000b"}
Sep 18 21:20:27.987300 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.987127    2576 scope.go:117] "RemoveContainer" containerID="42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7"
Sep 18 21:20:27.995936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.995917    2576 scope.go:117] "RemoveContainer" containerID="42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7"
Sep 18 21:20:27.996243 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:20:27.996217    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7\": container with ID starting with 42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7 not found: ID does not exist" containerID="42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7"
Sep 18 21:20:27.996328 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:27.996253    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7"} err="failed to get container status \"42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7\": rpc error: code = NotFound desc = could not find container \"42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7\": container with ID starting with 42fcd14a67b421a415f836494a28c30b329e6677eeb134fc6342cb0d99eba1d7 not found: ID does not exist"
Sep 18 21:20:28.058413 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:28.058388    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"]
Sep 18 21:20:28.068431 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:28.068410    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn"]
Sep 18 21:20:28.740877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:28.740845    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39c84f05-d8a6-49af-9831-dd592f0de49b" path="/var/lib/kubelet/pods/39c84f05-d8a6-49af-9831-dd592f0de49b/volumes"
Sep 18 21:20:28.741228 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:28.741199    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ee1ff0-2577-46a7-b68d-e1113fe3640a" path="/var/lib/kubelet/pods/e0ee1ff0-2577-46a7-b68d-e1113fe3640a/volumes"
Sep 18 21:20:37.166797 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.166765    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"]
Sep 18 21:20:37.167166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.167127    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39c84f05-d8a6-49af-9831-dd592f0de49b" containerName="revoke-keys"
Sep 18 21:20:37.167166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.167142    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="39c84f05-d8a6-49af-9831-dd592f0de49b" containerName="revoke-keys"
Sep 18 21:20:37.167166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.167163    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ee1ff0-2577-46a7-b68d-e1113fe3640a" containerName="payload-pre-processing"
Sep 18 21:20:37.167166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.167168    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ee1ff0-2577-46a7-b68d-e1113fe3640a" containerName="payload-pre-processing"
Sep 18 21:20:37.167282 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.167224    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="39c84f05-d8a6-49af-9831-dd592f0de49b" containerName="revoke-keys"
Sep 18 21:20:37.167282 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.167233    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ee1ff0-2577-46a7-b68d-e1113fe3640a" containerName="payload-pre-processing"
Sep 18 21:20:37.171481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.171463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.178453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.178436    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-7e01a72f\""
Sep 18 21:20:37.179304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.179285    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-7e01a72f-dockercfg-rpm9b\""
Sep 18 21:20:37.205704 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.205678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"]
Sep 18 21:20:37.298793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.298763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbn8j\" (UniqueName: \"kubernetes.io/projected/b1616950-5112-40c8-a92b-a8f16d5889e4-kube-api-access-zbn8j\") pod \"payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.298935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.298820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1616950-5112-40c8-a92b-a8f16d5889e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.341122 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.341092    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"]
Sep 18 21:20:37.344331 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.344315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.369504 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.369485    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"]
Sep 18 21:20:37.399827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.399803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbn8j\" (UniqueName: \"kubernetes.io/projected/b1616950-5112-40c8-a92b-a8f16d5889e4-kube-api-access-zbn8j\") pod \"payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.399970 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.399874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1616950-5112-40c8-a92b-a8f16d5889e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.399970 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.399931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc5c66c-eed3-4876-9806-eb25078d9e35-plugins-config-volume\") pod \"payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.400080 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.399988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbqf2\" (UniqueName: \"kubernetes.io/projected/2dc5c66c-eed3-4876-9806-eb25078d9e35-kube-api-access-gbqf2\") pod \"payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.400557 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.400538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1616950-5112-40c8-a92b-a8f16d5889e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.427955 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.427907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbn8j\" (UniqueName: \"kubernetes.io/projected/b1616950-5112-40c8-a92b-a8f16d5889e4-kube-api-access-zbn8j\") pod \"payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.481465 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.481441    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:37.500745 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.500713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc5c66c-eed3-4876-9806-eb25078d9e35-plugins-config-volume\") pod \"payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.500926 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.500783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbqf2\" (UniqueName: \"kubernetes.io/projected/2dc5c66c-eed3-4876-9806-eb25078d9e35-kube-api-access-gbqf2\") pod \"payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.501612 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.501587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc5c66c-eed3-4876-9806-eb25078d9e35-plugins-config-volume\") pod \"payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.514655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.514635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbqf2\" (UniqueName: \"kubernetes.io/projected/2dc5c66c-eed3-4876-9806-eb25078d9e35-kube-api-access-gbqf2\") pod \"payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.653485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.653457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:37.763592 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.763351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"]
Sep 18 21:20:37.965854 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:37.965832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"]
Sep 18 21:20:37.967770 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:20:37.967742    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc5c66c_eed3_4876_9806_eb25078d9e35.slice/crio-8c3a4d7f7c5537c2b42296be7ddce9c9b92247d671a5702cd4564ccf757e3cd4 WatchSource:0}: Error finding container 8c3a4d7f7c5537c2b42296be7ddce9c9b92247d671a5702cd4564ccf757e3cd4: Status 404 returned error can't find the container with id 8c3a4d7f7c5537c2b42296be7ddce9c9b92247d671a5702cd4564ccf757e3cd4
Sep 18 21:20:38.034906 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.034857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk" event={"ID":"2dc5c66c-eed3-4876-9806-eb25078d9e35","Type":"ContainerStarted","Data":"cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80"}
Sep 18 21:20:38.035020 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.034965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk" event={"ID":"2dc5c66c-eed3-4876-9806-eb25078d9e35","Type":"ContainerStarted","Data":"8c3a4d7f7c5537c2b42296be7ddce9c9b92247d671a5702cd4564ccf757e3cd4"}
Sep 18 21:20:38.035020 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.034997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:20:38.036483 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.036461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz" event={"ID":"b1616950-5112-40c8-a92b-a8f16d5889e4","Type":"ContainerStarted","Data":"bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046"}
Sep 18 21:20:38.036585 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.036498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz" event={"ID":"b1616950-5112-40c8-a92b-a8f16d5889e4","Type":"ContainerStarted","Data":"77511439dee5e897a8cc312a102fa569229e2502b0831b51a2bd334fee440159"}
Sep 18 21:20:38.036585 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.036559    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:38.066936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.066862    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk" podStartSLOduration=1.066847904 podStartE2EDuration="1.066847904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:20:38.066567322 +0000 UTC m=+871.529346678" watchObservedRunningTime="2026-09-18 21:20:38.066847904 +0000 UTC m=+871.529627278"
Sep 18 21:20:38.134576 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:38.134521    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz" podStartSLOduration=1.134500095 podStartE2EDuration="1.134500095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:20:38.133899813 +0000 UTC m=+871.596679170" watchObservedRunningTime="2026-09-18 21:20:38.134500095 +0000 UTC m=+871.597279452"
Sep 18 21:20:45.803407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:45.803372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:20:49.042959 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:49.042930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:20:49.043315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:20:49.042992    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:21:05.810981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:05.810893    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:21:08.242171 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.242140    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"]
Sep 18 21:21:08.245544 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.245522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:08.252117 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.252101    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:21:08.254973 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.254957    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:21:08.266949 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.266928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"]
Sep 18 21:21:08.329651 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.329625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9a53bd4-39d1-4c7f-b62a-e171b8b65056-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h\" (UID: \"b9a53bd4-39d1-4c7f-b62a-e171b8b65056\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:08.430925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.430900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9a53bd4-39d1-4c7f-b62a-e171b8b65056-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h\" (UID: \"b9a53bd4-39d1-4c7f-b62a-e171b8b65056\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:08.431506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.431489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9a53bd4-39d1-4c7f-b62a-e171b8b65056-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h\" (UID: \"b9a53bd4-39d1-4c7f-b62a-e171b8b65056\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:08.554870 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.554811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:08.858663 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:08.858640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"]
Sep 18 21:21:08.860901 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:21:08.860864    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a53bd4_39d1_4c7f_b62a_e171b8b65056.slice/crio-c5a57b67943fbf77ad41b467865c5c31ebbb204ce7fba9bf5e699fa5b163a73f WatchSource:0}: Error finding container c5a57b67943fbf77ad41b467865c5c31ebbb204ce7fba9bf5e699fa5b163a73f: Status 404 returned error can't find the container with id c5a57b67943fbf77ad41b467865c5c31ebbb204ce7fba9bf5e699fa5b163a73f
Sep 18 21:21:09.173772 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:09.173691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h" event={"ID":"b9a53bd4-39d1-4c7f-b62a-e171b8b65056","Type":"ContainerStarted","Data":"e604f9cd8f5aa44e79ae0538668bc406a9ef1361ee078d1366b432bdc68700c3"}
Sep 18 21:21:09.173772 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:09.173748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h" event={"ID":"b9a53bd4-39d1-4c7f-b62a-e171b8b65056","Type":"ContainerStarted","Data":"c5a57b67943fbf77ad41b467865c5c31ebbb204ce7fba9bf5e699fa5b163a73f"}
Sep 18 21:21:09.249946 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:09.249878    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h" podStartSLOduration=1.249862345 podStartE2EDuration="1.249862345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:21:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:21:09.248545387 +0000 UTC m=+902.711324743" watchObservedRunningTime="2026-09-18 21:21:09.249862345 +0000 UTC m=+902.712641701"
Sep 18 21:21:10.179262 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:10.179225    2576 generic.go:356] "Generic (PLEG): container finished" podID="b9a53bd4-39d1-4c7f-b62a-e171b8b65056" containerID="e604f9cd8f5aa44e79ae0538668bc406a9ef1361ee078d1366b432bdc68700c3" exitCode=0
Sep 18 21:21:10.179424 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:10.179315    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h" event={"ID":"b9a53bd4-39d1-4c7f-b62a-e171b8b65056","Type":"ContainerDied","Data":"e604f9cd8f5aa44e79ae0538668bc406a9ef1361ee078d1366b432bdc68700c3"}
Sep 18 21:21:11.309682 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:11.309661    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:11.455592 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:11.455527    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9a53bd4-39d1-4c7f-b62a-e171b8b65056-maas-api-service-ca\") pod \"b9a53bd4-39d1-4c7f-b62a-e171b8b65056\" (UID: \"b9a53bd4-39d1-4c7f-b62a-e171b8b65056\") "
Sep 18 21:21:11.455847 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:11.455827    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9a53bd4-39d1-4c7f-b62a-e171b8b65056-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b9a53bd4-39d1-4c7f-b62a-e171b8b65056" (UID: "b9a53bd4-39d1-4c7f-b62a-e171b8b65056"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:21:11.556217 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:11.556188    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9a53bd4-39d1-4c7f-b62a-e171b8b65056-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:21:12.189711 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:12.189685    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"
Sep 18 21:21:12.189876 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:12.189676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h" event={"ID":"b9a53bd4-39d1-4c7f-b62a-e171b8b65056","Type":"ContainerDied","Data":"c5a57b67943fbf77ad41b467865c5c31ebbb204ce7fba9bf5e699fa5b163a73f"}
Sep 18 21:21:12.189876 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:12.189842    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5a57b67943fbf77ad41b467865c5c31ebbb204ce7fba9bf5e699fa5b163a73f"
Sep 18 21:21:19.175658 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.175624    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"]
Sep 18 21:21:19.176256 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.175904    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk" podUID="2dc5c66c-eed3-4876-9806-eb25078d9e35" containerName="payload-processing" containerID="cri-o://cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80" gracePeriod=30
Sep 18 21:21:19.187273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.187220    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"]
Sep 18 21:21:19.187513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.187471    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz" podUID="b1616950-5112-40c8-a92b-a8f16d5889e4" containerName="payload-pre-processing" containerID="cri-o://bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046" gracePeriod=30
Sep 18 21:21:19.303357 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.303330    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:21:19.427655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.427601    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:21:19.434234 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.434209    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"]
Sep 18 21:21:19.436354 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.436332    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e01a72f-lmm6h"]
Sep 18 21:21:19.455029 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.455009    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:21:19.517774 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.517746    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc5c66c-eed3-4876-9806-eb25078d9e35-plugins-config-volume\") pod \"2dc5c66c-eed3-4876-9806-eb25078d9e35\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") "
Sep 18 21:21:19.517943 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.517837    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbqf2\" (UniqueName: \"kubernetes.io/projected/2dc5c66c-eed3-4876-9806-eb25078d9e35-kube-api-access-gbqf2\") pod \"2dc5c66c-eed3-4876-9806-eb25078d9e35\" (UID: \"2dc5c66c-eed3-4876-9806-eb25078d9e35\") "
Sep 18 21:21:19.518166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.518148    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dc5c66c-eed3-4876-9806-eb25078d9e35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2dc5c66c-eed3-4876-9806-eb25078d9e35" (UID: "2dc5c66c-eed3-4876-9806-eb25078d9e35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:21:19.519756 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.519736    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc5c66c-eed3-4876-9806-eb25078d9e35-kube-api-access-gbqf2" (OuterVolumeSpecName: "kube-api-access-gbqf2") pod "2dc5c66c-eed3-4876-9806-eb25078d9e35" (UID: "2dc5c66c-eed3-4876-9806-eb25078d9e35"). InnerVolumeSpecName "kube-api-access-gbqf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:21:19.618377 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.618346    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbn8j\" (UniqueName: \"kubernetes.io/projected/b1616950-5112-40c8-a92b-a8f16d5889e4-kube-api-access-zbn8j\") pod \"b1616950-5112-40c8-a92b-a8f16d5889e4\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") "
Sep 18 21:21:19.618532 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.618479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1616950-5112-40c8-a92b-a8f16d5889e4-plugins-config-volume\") pod \"b1616950-5112-40c8-a92b-a8f16d5889e4\" (UID: \"b1616950-5112-40c8-a92b-a8f16d5889e4\") "
Sep 18 21:21:19.618667 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.618652    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbqf2\" (UniqueName: \"kubernetes.io/projected/2dc5c66c-eed3-4876-9806-eb25078d9e35-kube-api-access-gbqf2\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:21:19.618722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.618671    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dc5c66c-eed3-4876-9806-eb25078d9e35-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:21:19.618839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.618816    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1616950-5112-40c8-a92b-a8f16d5889e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1616950-5112-40c8-a92b-a8f16d5889e4" (UID: "b1616950-5112-40c8-a92b-a8f16d5889e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:21:19.620303 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.620286    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1616950-5112-40c8-a92b-a8f16d5889e4-kube-api-access-zbn8j" (OuterVolumeSpecName: "kube-api-access-zbn8j") pod "b1616950-5112-40c8-a92b-a8f16d5889e4" (UID: "b1616950-5112-40c8-a92b-a8f16d5889e4"). InnerVolumeSpecName "kube-api-access-zbn8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:21:19.719643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.719570    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1616950-5112-40c8-a92b-a8f16d5889e4-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:21:19.719643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:19.719605    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbn8j\" (UniqueName: \"kubernetes.io/projected/b1616950-5112-40c8-a92b-a8f16d5889e4-kube-api-access-zbn8j\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:21:20.227657 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.227625    2576 generic.go:356] "Generic (PLEG): container finished" podID="2dc5c66c-eed3-4876-9806-eb25078d9e35" containerID="cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80" exitCode=0
Sep 18 21:21:20.227999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.227670    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"
Sep 18 21:21:20.227999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.227703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk" event={"ID":"2dc5c66c-eed3-4876-9806-eb25078d9e35","Type":"ContainerDied","Data":"cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80"}
Sep 18 21:21:20.227999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.227763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk" event={"ID":"2dc5c66c-eed3-4876-9806-eb25078d9e35","Type":"ContainerDied","Data":"8c3a4d7f7c5537c2b42296be7ddce9c9b92247d671a5702cd4564ccf757e3cd4"}
Sep 18 21:21:20.227999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.227795    2576 scope.go:117] "RemoveContainer" containerID="cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80"
Sep 18 21:21:20.229087 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.229066    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1616950-5112-40c8-a92b-a8f16d5889e4" containerID="bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046" exitCode=0
Sep 18 21:21:20.229154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.229108    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"
Sep 18 21:21:20.229154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.229130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz" event={"ID":"b1616950-5112-40c8-a92b-a8f16d5889e4","Type":"ContainerDied","Data":"bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046"}
Sep 18 21:21:20.229256 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.229179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz" event={"ID":"b1616950-5112-40c8-a92b-a8f16d5889e4","Type":"ContainerDied","Data":"77511439dee5e897a8cc312a102fa569229e2502b0831b51a2bd334fee440159"}
Sep 18 21:21:20.236505 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.236440    2576 scope.go:117] "RemoveContainer" containerID="cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80"
Sep 18 21:21:20.236800 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:21:20.236772    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80\": container with ID starting with cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80 not found: ID does not exist" containerID="cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80"
Sep 18 21:21:20.236942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.236809    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80"} err="failed to get container status \"cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80\": rpc error: code = NotFound desc = could not find container \"cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80\": container with ID starting with cf6de55ab9e30e7917f8cc1af590acb5a6fb0ea58b7a21fc7c20de0034ab1c80 not found: ID does not exist"
Sep 18 21:21:20.236942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.236831    2576 scope.go:117] "RemoveContainer" containerID="bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046"
Sep 18 21:21:20.246325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.246306    2576 scope.go:117] "RemoveContainer" containerID="bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046"
Sep 18 21:21:20.246597 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:21:20.246575    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046\": container with ID starting with bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046 not found: ID does not exist" containerID="bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046"
Sep 18 21:21:20.246646 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.246599    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046"} err="failed to get container status \"bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046\": rpc error: code = NotFound desc = could not find container \"bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046\": container with ID starting with bc545fbf308369d519a72073a6db55e4f6b511b29f868380bcdec8756dc8b046 not found: ID does not exist"
Sep 18 21:21:20.277162 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.277140    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"]
Sep 18 21:21:20.285110 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.285088    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz"]
Sep 18 21:21:20.312842 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.312814    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"]
Sep 18 21:21:20.316424 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.316403    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk"]
Sep 18 21:21:20.741022 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.740994    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dc5c66c-eed3-4876-9806-eb25078d9e35" path="/var/lib/kubelet/pods/2dc5c66c-eed3-4876-9806-eb25078d9e35/volumes"
Sep 18 21:21:20.741320 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.741307    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1616950-5112-40c8-a92b-a8f16d5889e4" path="/var/lib/kubelet/pods/b1616950-5112-40c8-a92b-a8f16d5889e4/volumes"
Sep 18 21:21:20.741575 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:20.741564    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9a53bd4-39d1-4c7f-b62a-e171b8b65056" path="/var/lib/kubelet/pods/b9a53bd4-39d1-4c7f-b62a-e171b8b65056/volumes"
Sep 18 21:21:27.431941 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.431906    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"]
Sep 18 21:21:27.432286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432250    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc5c66c-eed3-4876-9806-eb25078d9e35" containerName="payload-processing"
Sep 18 21:21:27.432286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432263    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc5c66c-eed3-4876-9806-eb25078d9e35" containerName="payload-processing"
Sep 18 21:21:27.432286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432271    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a53bd4-39d1-4c7f-b62a-e171b8b65056" containerName="revoke-keys"
Sep 18 21:21:27.432286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432276    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a53bd4-39d1-4c7f-b62a-e171b8b65056" containerName="revoke-keys"
Sep 18 21:21:27.432407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432292    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1616950-5112-40c8-a92b-a8f16d5889e4" containerName="payload-pre-processing"
Sep 18 21:21:27.432407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432297    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1616950-5112-40c8-a92b-a8f16d5889e4" containerName="payload-pre-processing"
Sep 18 21:21:27.432407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432348    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1616950-5112-40c8-a92b-a8f16d5889e4" containerName="payload-pre-processing"
Sep 18 21:21:27.432407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432359    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9a53bd4-39d1-4c7f-b62a-e171b8b65056" containerName="revoke-keys"
Sep 18 21:21:27.432407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.432366    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc5c66c-eed3-4876-9806-eb25078d9e35" containerName="payload-processing"
Sep 18 21:21:27.436612 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.436589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.439239 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.439223    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1084f187\""
Sep 18 21:21:27.448503 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.448482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"]
Sep 18 21:21:27.476778 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.476750    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"]
Sep 18 21:21:27.479939 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.479923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.482839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.482825    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1084f187-dockercfg-ctwkq\""
Sep 18 21:21:27.491363 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.491337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"]
Sep 18 21:21:27.580158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.580129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/936fb0b1-694b-4c5e-9509-1465d2f2e115-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.580299 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.580198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eeea3976-f624-446a-b103-70dce26d18ea-plugins-config-volume\") pod \"payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") " pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.580299 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.580217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h752t\" (UniqueName: \"kubernetes.io/projected/eeea3976-f624-446a-b103-70dce26d18ea-kube-api-access-h752t\") pod \"payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") " pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.580299 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.580246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kf7t\" (UniqueName: \"kubernetes.io/projected/936fb0b1-694b-4c5e-9509-1465d2f2e115-kube-api-access-2kf7t\") pod \"payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.681574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.681531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eeea3976-f624-446a-b103-70dce26d18ea-plugins-config-volume\") pod \"payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") " pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.681574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.681574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h752t\" (UniqueName: \"kubernetes.io/projected/eeea3976-f624-446a-b103-70dce26d18ea-kube-api-access-h752t\") pod \"payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") " pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.681799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.681607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kf7t\" (UniqueName: \"kubernetes.io/projected/936fb0b1-694b-4c5e-9509-1465d2f2e115-kube-api-access-2kf7t\") pod \"payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.681799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.681641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/936fb0b1-694b-4c5e-9509-1465d2f2e115-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.682307 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.682265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eeea3976-f624-446a-b103-70dce26d18ea-plugins-config-volume\") pod \"payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") " pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.682307 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.682283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/936fb0b1-694b-4c5e-9509-1465d2f2e115-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.691287 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.691257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h752t\" (UniqueName: \"kubernetes.io/projected/eeea3976-f624-446a-b103-70dce26d18ea-kube-api-access-h752t\") pod \"payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") " pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:27.691287 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.691265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kf7t\" (UniqueName: \"kubernetes.io/projected/936fb0b1-694b-4c5e-9509-1465d2f2e115-kube-api-access-2kf7t\") pod \"payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.745985 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.745962    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:27.788903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:27.788859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:28.016453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.016426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"]
Sep 18 21:21:28.017951 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:21:28.017921    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936fb0b1_694b_4c5e_9509_1465d2f2e115.slice/crio-26d2f8b17b591645ee454b528446a2d163f2d68bfdd431af63331fa1d6e474ab WatchSource:0}: Error finding container 26d2f8b17b591645ee454b528446a2d163f2d68bfdd431af63331fa1d6e474ab: Status 404 returned error can't find the container with id 26d2f8b17b591645ee454b528446a2d163f2d68bfdd431af63331fa1d6e474ab
Sep 18 21:21:28.071351 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.071327    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"]
Sep 18 21:21:28.072454 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:21:28.072422    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeea3976_f624_446a_b103_70dce26d18ea.slice/crio-2ef6f8ef6664075c023505942ef4d0017337b5308c4b5b178449380114071193 WatchSource:0}: Error finding container 2ef6f8ef6664075c023505942ef4d0017337b5308c4b5b178449380114071193: Status 404 returned error can't find the container with id 2ef6f8ef6664075c023505942ef4d0017337b5308c4b5b178449380114071193
Sep 18 21:21:28.268807 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.268711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5" event={"ID":"936fb0b1-694b-4c5e-9509-1465d2f2e115","Type":"ContainerStarted","Data":"000cccd0a58b01fc8fa2f3fe1aa8d7e43fbe554d3f321636a8928ecb86c31f7a"}
Sep 18 21:21:28.268807 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.268769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5" event={"ID":"936fb0b1-694b-4c5e-9509-1465d2f2e115","Type":"ContainerStarted","Data":"26d2f8b17b591645ee454b528446a2d163f2d68bfdd431af63331fa1d6e474ab"}
Sep 18 21:21:28.269040 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.268863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:28.270247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.270221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9" event={"ID":"eeea3976-f624-446a-b103-70dce26d18ea","Type":"ContainerStarted","Data":"7f4ab5c0080ee79f806a4e9c3167c97aaa97a850d5523d942e463a2a72e7a59f"}
Sep 18 21:21:28.270344 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.270269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9" event={"ID":"eeea3976-f624-446a-b103-70dce26d18ea","Type":"ContainerStarted","Data":"2ef6f8ef6664075c023505942ef4d0017337b5308c4b5b178449380114071193"}
Sep 18 21:21:28.270344 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.270292    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:28.311396 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.311340    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9" podStartSLOduration=1.311326529 podStartE2EDuration="1.311326529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:21:28.310361166 +0000 UTC m=+921.773140524" watchObservedRunningTime="2026-09-18 21:21:28.311326529 +0000 UTC m=+921.774105885"
Sep 18 21:21:28.312128 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:28.312101    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5" podStartSLOduration=1.312089747 podStartE2EDuration="1.312089747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:21:28.28882784 +0000 UTC m=+921.751607197" watchObservedRunningTime="2026-09-18 21:21:28.312089747 +0000 UTC m=+921.774869095"
Sep 18 21:21:34.209392 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:34.209358    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:21:39.277076 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:39.277048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:21:39.277471 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:39.277321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:21:48.025151 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.025118    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"]
Sep 18 21:21:48.028192 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.028171    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.030970 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.030950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-116f55\"/\"default-dockercfg-frvf4\""
Sep 18 21:21:48.031408 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.031386    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-116f55\"/\"openshift-service-ca.crt\""
Sep 18 21:21:48.031957 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.031943    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-116f55\"/\"kube-root-ca.crt\""
Sep 18 21:21:48.032371 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.032352    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-116f55\"/\"test-model-116f55-kserve-self-signed-certs\""
Sep 18 21:21:48.040653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.040633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"]
Sep 18 21:21:48.129078 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.129049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwqnh\" (UniqueName: \"kubernetes.io/projected/3f483766-0818-4303-a4f4-3cd0b90fa7d9-kube-api-access-xwqnh\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.129201 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.129086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-dshm\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.129201 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.129153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-model-cache\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.129319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.129212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-home\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.129319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.129246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tls-certs\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.129319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.129271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tmp-dir\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230100 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-model-cache\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-home\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tls-certs\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tmp-dir\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwqnh\" (UniqueName: \"kubernetes.io/projected/3f483766-0818-4303-a4f4-3cd0b90fa7d9-kube-api-access-xwqnh\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-dshm\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230545 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-model-cache\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230598 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-home\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.230633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.230593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tmp-dir\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.232291 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.232274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-dshm\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.232539 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.232523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tls-certs\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.243246 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.243224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwqnh\" (UniqueName: \"kubernetes.io/projected/3f483766-0818-4303-a4f4-3cd0b90fa7d9-kube-api-access-xwqnh\") pod \"test-model-116f55-kserve-7cb7fcd7c7-khv4p\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") " pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.337962 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.337938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:48.626591 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:48.626568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"]
Sep 18 21:21:48.628979 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:21:48.628947    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f483766_0818_4303_a4f4_3cd0b90fa7d9.slice/crio-c4eec784524305d1038c286cf7fa7b33e30ad4ee9532d63329bbaae8b43a58f5 WatchSource:0}: Error finding container c4eec784524305d1038c286cf7fa7b33e30ad4ee9532d63329bbaae8b43a58f5: Status 404 returned error can't find the container with id c4eec784524305d1038c286cf7fa7b33e30ad4ee9532d63329bbaae8b43a58f5
Sep 18 21:21:49.364522 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:49.364487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p" event={"ID":"3f483766-0818-4303-a4f4-3cd0b90fa7d9","Type":"ContainerStarted","Data":"41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3"}
Sep 18 21:21:49.364915 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:49.364535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p" event={"ID":"3f483766-0818-4303-a4f4-3cd0b90fa7d9","Type":"ContainerStarted","Data":"c4eec784524305d1038c286cf7fa7b33e30ad4ee9532d63329bbaae8b43a58f5"}
Sep 18 21:21:49.392571 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:49.392529    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p" podStartSLOduration=1.39251489 podStartE2EDuration="1.39251489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:21:49.391040916 +0000 UTC m=+942.853820272" watchObservedRunningTime="2026-09-18 21:21:49.39251489 +0000 UTC m=+942.855294246"
Sep 18 21:21:53.746897 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.746861    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"]
Sep 18 21:21:53.750224 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.750208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:53.754849 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.754825    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:21:53.754993 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.754870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:21:53.762112 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.762088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"]
Sep 18 21:21:53.774369 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.774340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50ea893f-2c96-45da-8b10-099f5dd0cf11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1084f187-c2pm8\" (UID: \"50ea893f-2c96-45da-8b10-099f5dd0cf11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:53.875562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.875535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50ea893f-2c96-45da-8b10-099f5dd0cf11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1084f187-c2pm8\" (UID: \"50ea893f-2c96-45da-8b10-099f5dd0cf11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:53.876094 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:53.876078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50ea893f-2c96-45da-8b10-099f5dd0cf11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1084f187-c2pm8\" (UID: \"50ea893f-2c96-45da-8b10-099f5dd0cf11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:54.060647 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:54.060585    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:54.353205 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:54.353176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"]
Sep 18 21:21:54.358199 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:21:54.358179    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ea893f_2c96_45da_8b10_099f5dd0cf11.slice/crio-7d80dd1aa8404656031657f7a38109c484940686b6176dc922d52508caaff6fa WatchSource:0}: Error finding container 7d80dd1aa8404656031657f7a38109c484940686b6176dc922d52508caaff6fa: Status 404 returned error can't find the container with id 7d80dd1aa8404656031657f7a38109c484940686b6176dc922d52508caaff6fa
Sep 18 21:21:54.391088 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:54.391066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8" event={"ID":"50ea893f-2c96-45da-8b10-099f5dd0cf11","Type":"ContainerStarted","Data":"7d80dd1aa8404656031657f7a38109c484940686b6176dc922d52508caaff6fa"}
Sep 18 21:21:55.396819 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:55.396785    2576 generic.go:356] "Generic (PLEG): container finished" podID="50ea893f-2c96-45da-8b10-099f5dd0cf11" containerID="9b2eb079531173c45d351df29294eebe07b444464160f415e87f67dc9a6c227d" exitCode=0
Sep 18 21:21:55.397182 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:55.396868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8" event={"ID":"50ea893f-2c96-45da-8b10-099f5dd0cf11","Type":"ContainerDied","Data":"9b2eb079531173c45d351df29294eebe07b444464160f415e87f67dc9a6c227d"}
Sep 18 21:21:56.531414 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:56.531391    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:56.597320 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:56.597293    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50ea893f-2c96-45da-8b10-099f5dd0cf11-maas-api-service-ca\") pod \"50ea893f-2c96-45da-8b10-099f5dd0cf11\" (UID: \"50ea893f-2c96-45da-8b10-099f5dd0cf11\") "
Sep 18 21:21:56.597612 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:56.597591    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50ea893f-2c96-45da-8b10-099f5dd0cf11-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50ea893f-2c96-45da-8b10-099f5dd0cf11" (UID: "50ea893f-2c96-45da-8b10-099f5dd0cf11"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:21:56.698664 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:56.698605    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50ea893f-2c96-45da-8b10-099f5dd0cf11-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:21:57.408234 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:57.408202    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"
Sep 18 21:21:57.408234 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:57.408211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8" event={"ID":"50ea893f-2c96-45da-8b10-099f5dd0cf11","Type":"ContainerDied","Data":"7d80dd1aa8404656031657f7a38109c484940686b6176dc922d52508caaff6fa"}
Sep 18 21:21:57.408435 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:57.408259    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d80dd1aa8404656031657f7a38109c484940686b6176dc922d52508caaff6fa"
Sep 18 21:21:58.339109 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:58.339080    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:58.339534 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:58.339123    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:58.350813 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:58.350784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:58.424203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:58.424171    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:21:58.598562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:21:58.598477    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:22:05.201486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.201448    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"]
Sep 18 21:22:05.201966 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.201673    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9" podUID="eeea3976-f624-446a-b103-70dce26d18ea" containerName="payload-processing" containerID="cri-o://7f4ab5c0080ee79f806a4e9c3167c97aaa97a850d5523d942e463a2a72e7a59f" gracePeriod=30
Sep 18 21:22:05.203716 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.203689    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"]
Sep 18 21:22:05.203874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.203851    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5" podUID="936fb0b1-694b-4c5e-9509-1465d2f2e115" containerName="payload-pre-processing" containerID="cri-o://000cccd0a58b01fc8fa2f3fe1aa8d7e43fbe554d3f321636a8928ecb86c31f7a" gracePeriod=30
Sep 18 21:22:05.396913 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.396853    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"]
Sep 18 21:22:05.402838 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.402803    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1084f187-c2pm8"]
Sep 18 21:22:05.447166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.447132    2576 generic.go:356] "Generic (PLEG): container finished" podID="936fb0b1-694b-4c5e-9509-1465d2f2e115" containerID="000cccd0a58b01fc8fa2f3fe1aa8d7e43fbe554d3f321636a8928ecb86c31f7a" exitCode=0
Sep 18 21:22:05.447327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.447194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5" event={"ID":"936fb0b1-694b-4c5e-9509-1465d2f2e115","Type":"ContainerDied","Data":"000cccd0a58b01fc8fa2f3fe1aa8d7e43fbe554d3f321636a8928ecb86c31f7a"}
Sep 18 21:22:05.448989 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.448964    2576 generic.go:356] "Generic (PLEG): container finished" podID="eeea3976-f624-446a-b103-70dce26d18ea" containerID="7f4ab5c0080ee79f806a4e9c3167c97aaa97a850d5523d942e463a2a72e7a59f" exitCode=0
Sep 18 21:22:05.449105 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.449017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9" event={"ID":"eeea3976-f624-446a-b103-70dce26d18ea","Type":"ContainerDied","Data":"7f4ab5c0080ee79f806a4e9c3167c97aaa97a850d5523d942e463a2a72e7a59f"}
Sep 18 21:22:05.475731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.475696    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:22:05.478291 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.478274    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:22:05.564430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.564396    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h752t\" (UniqueName: \"kubernetes.io/projected/eeea3976-f624-446a-b103-70dce26d18ea-kube-api-access-h752t\") pod \"eeea3976-f624-446a-b103-70dce26d18ea\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") "
Sep 18 21:22:05.564640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.564468    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eeea3976-f624-446a-b103-70dce26d18ea-plugins-config-volume\") pod \"eeea3976-f624-446a-b103-70dce26d18ea\" (UID: \"eeea3976-f624-446a-b103-70dce26d18ea\") "
Sep 18 21:22:05.564640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.564520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kf7t\" (UniqueName: \"kubernetes.io/projected/936fb0b1-694b-4c5e-9509-1465d2f2e115-kube-api-access-2kf7t\") pod \"936fb0b1-694b-4c5e-9509-1465d2f2e115\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") "
Sep 18 21:22:05.564640 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.564555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/936fb0b1-694b-4c5e-9509-1465d2f2e115-plugins-config-volume\") pod \"936fb0b1-694b-4c5e-9509-1465d2f2e115\" (UID: \"936fb0b1-694b-4c5e-9509-1465d2f2e115\") "
Sep 18 21:22:05.564982 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.564957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeea3976-f624-446a-b103-70dce26d18ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eeea3976-f624-446a-b103-70dce26d18ea" (UID: "eeea3976-f624-446a-b103-70dce26d18ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:05.565096 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.565040    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/936fb0b1-694b-4c5e-9509-1465d2f2e115-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "936fb0b1-694b-4c5e-9509-1465d2f2e115" (UID: "936fb0b1-694b-4c5e-9509-1465d2f2e115"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:05.566859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.566829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeea3976-f624-446a-b103-70dce26d18ea-kube-api-access-h752t" (OuterVolumeSpecName: "kube-api-access-h752t") pod "eeea3976-f624-446a-b103-70dce26d18ea" (UID: "eeea3976-f624-446a-b103-70dce26d18ea"). InnerVolumeSpecName "kube-api-access-h752t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:22:05.567005 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.566911    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/936fb0b1-694b-4c5e-9509-1465d2f2e115-kube-api-access-2kf7t" (OuterVolumeSpecName: "kube-api-access-2kf7t") pod "936fb0b1-694b-4c5e-9509-1465d2f2e115" (UID: "936fb0b1-694b-4c5e-9509-1465d2f2e115"). InnerVolumeSpecName "kube-api-access-2kf7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:22:05.665694 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.665654    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eeea3976-f624-446a-b103-70dce26d18ea-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:05.665694 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.665691    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kf7t\" (UniqueName: \"kubernetes.io/projected/936fb0b1-694b-4c5e-9509-1465d2f2e115-kube-api-access-2kf7t\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:05.665844 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.665704    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/936fb0b1-694b-4c5e-9509-1465d2f2e115-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:05.665844 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:05.665716    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h752t\" (UniqueName: \"kubernetes.io/projected/eeea3976-f624-446a-b103-70dce26d18ea-kube-api-access-h752t\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:06.455912 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.455871    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"
Sep 18 21:22:06.456364 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.455914    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5" event={"ID":"936fb0b1-694b-4c5e-9509-1465d2f2e115","Type":"ContainerDied","Data":"26d2f8b17b591645ee454b528446a2d163f2d68bfdd431af63331fa1d6e474ab"}
Sep 18 21:22:06.456364 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.455993    2576 scope.go:117] "RemoveContainer" containerID="000cccd0a58b01fc8fa2f3fe1aa8d7e43fbe554d3f321636a8928ecb86c31f7a"
Sep 18 21:22:06.457455 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.457435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9" event={"ID":"eeea3976-f624-446a-b103-70dce26d18ea","Type":"ContainerDied","Data":"2ef6f8ef6664075c023505942ef4d0017337b5308c4b5b178449380114071193"}
Sep 18 21:22:06.457540 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.457477    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"
Sep 18 21:22:06.466722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.466707    2576 scope.go:117] "RemoveContainer" containerID="7f4ab5c0080ee79f806a4e9c3167c97aaa97a850d5523d942e463a2a72e7a59f"
Sep 18 21:22:06.583782 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.583759    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"]
Sep 18 21:22:06.604385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.604368    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5"]
Sep 18 21:22:06.637166 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.637145    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"]
Sep 18 21:22:06.638454 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.638436    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9"]
Sep 18 21:22:06.740952 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.740842    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ea893f-2c96-45da-8b10-099f5dd0cf11" path="/var/lib/kubelet/pods/50ea893f-2c96-45da-8b10-099f5dd0cf11/volumes"
Sep 18 21:22:06.741239 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.741224    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="936fb0b1-694b-4c5e-9509-1465d2f2e115" path="/var/lib/kubelet/pods/936fb0b1-694b-4c5e-9509-1465d2f2e115/volumes"
Sep 18 21:22:06.741567 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:06.741549    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeea3976-f624-446a-b103-70dce26d18ea" path="/var/lib/kubelet/pods/eeea3976-f624-446a-b103-70dce26d18ea/volumes"
Sep 18 21:22:07.729591 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.729557    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"]
Sep 18 21:22:07.730087 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730069    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeea3976-f624-446a-b103-70dce26d18ea" containerName="payload-processing"
Sep 18 21:22:07.730175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730090    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeea3976-f624-446a-b103-70dce26d18ea" containerName="payload-processing"
Sep 18 21:22:07.730175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730110    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50ea893f-2c96-45da-8b10-099f5dd0cf11" containerName="revoke-keys"
Sep 18 21:22:07.730175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730119    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50ea893f-2c96-45da-8b10-099f5dd0cf11" containerName="revoke-keys"
Sep 18 21:22:07.730175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730143    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="936fb0b1-694b-4c5e-9509-1465d2f2e115" containerName="payload-pre-processing"
Sep 18 21:22:07.730175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730152    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="936fb0b1-694b-4c5e-9509-1465d2f2e115" containerName="payload-pre-processing"
Sep 18 21:22:07.730415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730246    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeea3976-f624-446a-b103-70dce26d18ea" containerName="payload-processing"
Sep 18 21:22:07.730415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730261    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="936fb0b1-694b-4c5e-9509-1465d2f2e115" containerName="payload-pre-processing"
Sep 18 21:22:07.730415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.730273    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50ea893f-2c96-45da-8b10-099f5dd0cf11" containerName="revoke-keys"
Sep 18 21:22:07.734871 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.734848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:07.737254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.737232    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:22:07.737389 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.737320    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:22:07.751572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.751544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"]
Sep 18 21:22:07.781574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.781549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ff3f48-60fc-4ba5-8a8a-d478af18e37c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-21df59-sh7ft\" (UID: \"72ff3f48-60fc-4ba5-8a8a-d478af18e37c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:07.882838 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.882809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ff3f48-60fc-4ba5-8a8a-d478af18e37c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-21df59-sh7ft\" (UID: \"72ff3f48-60fc-4ba5-8a8a-d478af18e37c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:07.883373 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:07.883354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ff3f48-60fc-4ba5-8a8a-d478af18e37c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-21df59-sh7ft\" (UID: \"72ff3f48-60fc-4ba5-8a8a-d478af18e37c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:08.046540 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:08.046478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:08.321539 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:08.321472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"]
Sep 18 21:22:08.324467 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:22:08.324439    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ff3f48_60fc_4ba5_8a8a_d478af18e37c.slice/crio-24cd7b8f30f9dfbc67b8c5e3da1908a195a6df0746ef608222551a3d7791a508 WatchSource:0}: Error finding container 24cd7b8f30f9dfbc67b8c5e3da1908a195a6df0746ef608222551a3d7791a508: Status 404 returned error can't find the container with id 24cd7b8f30f9dfbc67b8c5e3da1908a195a6df0746ef608222551a3d7791a508
Sep 18 21:22:08.469623 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:08.469577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft" event={"ID":"72ff3f48-60fc-4ba5-8a8a-d478af18e37c","Type":"ContainerStarted","Data":"24cd7b8f30f9dfbc67b8c5e3da1908a195a6df0746ef608222551a3d7791a508"}
Sep 18 21:22:09.475879 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:09.475844    2576 generic.go:356] "Generic (PLEG): container finished" podID="72ff3f48-60fc-4ba5-8a8a-d478af18e37c" containerID="376aedd782b05a945856bb75d5e41f7b18c2fa484f6fb2c7cd2b2e16b51b60c4" exitCode=0
Sep 18 21:22:09.476292 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:09.475928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft" event={"ID":"72ff3f48-60fc-4ba5-8a8a-d478af18e37c","Type":"ContainerDied","Data":"376aedd782b05a945856bb75d5e41f7b18c2fa484f6fb2c7cd2b2e16b51b60c4"}
Sep 18 21:22:10.612041 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:10.612018    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:10.707396 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:10.707370    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ff3f48-60fc-4ba5-8a8a-d478af18e37c-maas-api-service-ca\") pod \"72ff3f48-60fc-4ba5-8a8a-d478af18e37c\" (UID: \"72ff3f48-60fc-4ba5-8a8a-d478af18e37c\") "
Sep 18 21:22:10.707706 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:10.707683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72ff3f48-60fc-4ba5-8a8a-d478af18e37c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72ff3f48-60fc-4ba5-8a8a-d478af18e37c" (UID: "72ff3f48-60fc-4ba5-8a8a-d478af18e37c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:10.808504 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:10.808472    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ff3f48-60fc-4ba5-8a8a-d478af18e37c-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:11.486330 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:11.486306    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"
Sep 18 21:22:11.486485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:11.486349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft" event={"ID":"72ff3f48-60fc-4ba5-8a8a-d478af18e37c","Type":"ContainerDied","Data":"24cd7b8f30f9dfbc67b8c5e3da1908a195a6df0746ef608222551a3d7791a508"}
Sep 18 21:22:11.486485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:11.486392    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24cd7b8f30f9dfbc67b8c5e3da1908a195a6df0746ef608222551a3d7791a508"
Sep 18 21:22:16.937708 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.937676    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"]
Sep 18 21:22:16.938084 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.938042    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ff3f48-60fc-4ba5-8a8a-d478af18e37c" containerName="revoke-keys"
Sep 18 21:22:16.938084 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.938062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ff3f48-60fc-4ba5-8a8a-d478af18e37c" containerName="revoke-keys"
Sep 18 21:22:16.938156 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.938115    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ff3f48-60fc-4ba5-8a8a-d478af18e37c" containerName="revoke-keys"
Sep 18 21:22:16.940940 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.940925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:16.947035 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.946758    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-962c4157\""
Sep 18 21:22:16.949873 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.949857    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-962c4157-dockercfg-f8dj5\""
Sep 18 21:22:16.965074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.965051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"]
Sep 18 21:22:16.984924 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.984879    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"]
Sep 18 21:22:16.988355 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:16.988331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.016355 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.016328    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"]
Sep 18 21:22:17.054399 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.054370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r28z\" (UniqueName: \"kubernetes.io/projected/cc53f409-fe3e-47a0-9440-676e3e3b9472-kube-api-access-2r28z\") pod \"payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.054550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.054426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc53f409-fe3e-47a0-9440-676e3e3b9472-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.054550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.054482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db231901-1a15-4612-bfd0-4e218416c957-plugins-config-volume\") pod \"payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") " pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.054550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.054506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5mg\" (UniqueName: \"kubernetes.io/projected/db231901-1a15-4612-bfd0-4e218416c957-kube-api-access-gm5mg\") pod \"payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") " pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.155806 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.155773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r28z\" (UniqueName: \"kubernetes.io/projected/cc53f409-fe3e-47a0-9440-676e3e3b9472-kube-api-access-2r28z\") pod \"payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.155936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.155830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc53f409-fe3e-47a0-9440-676e3e3b9472-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.155936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.155872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db231901-1a15-4612-bfd0-4e218416c957-plugins-config-volume\") pod \"payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") " pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.156006 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.155924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5mg\" (UniqueName: \"kubernetes.io/projected/db231901-1a15-4612-bfd0-4e218416c957-kube-api-access-gm5mg\") pod \"payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") " pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.156534 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.156513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db231901-1a15-4612-bfd0-4e218416c957-plugins-config-volume\") pod \"payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") " pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.156571 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.156532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc53f409-fe3e-47a0-9440-676e3e3b9472-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.180444 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.180418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r28z\" (UniqueName: \"kubernetes.io/projected/cc53f409-fe3e-47a0-9440-676e3e3b9472-kube-api-access-2r28z\") pod \"payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.181185 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.181166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5mg\" (UniqueName: \"kubernetes.io/projected/db231901-1a15-4612-bfd0-4e218416c957-kube-api-access-gm5mg\") pod \"payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") " pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.250301 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.250252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:17.300268 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.300234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:17.473641 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.473613    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:22:17.537595 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.537546    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"]
Sep 18 21:22:17.539675 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:22:17.539651    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc53f409_fe3e_47a0_9440_676e3e3b9472.slice/crio-8aa8168873881c36d64b585684c216b91cf3d37f6960bfa5f773f5d36cb0984a WatchSource:0}: Error finding container 8aa8168873881c36d64b585684c216b91cf3d37f6960bfa5f773f5d36cb0984a: Status 404 returned error can't find the container with id 8aa8168873881c36d64b585684c216b91cf3d37f6960bfa5f773f5d36cb0984a
Sep 18 21:22:17.666614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:17.666591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"]
Sep 18 21:22:17.668346 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:22:17.668325    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb231901_1a15_4612_bfd0_4e218416c957.slice/crio-7aca2911a1c8f7b720f25d5e8177174f7b61b85029c39400d155aa0bf8171f96 WatchSource:0}: Error finding container 7aca2911a1c8f7b720f25d5e8177174f7b61b85029c39400d155aa0bf8171f96: Status 404 returned error can't find the container with id 7aca2911a1c8f7b720f25d5e8177174f7b61b85029c39400d155aa0bf8171f96
Sep 18 21:22:18.527376 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.527339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl" event={"ID":"db231901-1a15-4612-bfd0-4e218416c957","Type":"ContainerStarted","Data":"b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4"}
Sep 18 21:22:18.527800 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.527465    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:18.527800 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.527504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl" event={"ID":"db231901-1a15-4612-bfd0-4e218416c957","Type":"ContainerStarted","Data":"7aca2911a1c8f7b720f25d5e8177174f7b61b85029c39400d155aa0bf8171f96"}
Sep 18 21:22:18.529108 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.529086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t" event={"ID":"cc53f409-fe3e-47a0-9440-676e3e3b9472","Type":"ContainerStarted","Data":"5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32"}
Sep 18 21:22:18.529245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.529126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t" event={"ID":"cc53f409-fe3e-47a0-9440-676e3e3b9472","Type":"ContainerStarted","Data":"8aa8168873881c36d64b585684c216b91cf3d37f6960bfa5f773f5d36cb0984a"}
Sep 18 21:22:18.529245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.529153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:18.560718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.560670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl" podStartSLOduration=2.560655123 podStartE2EDuration="2.560655123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:22:18.559831153 +0000 UTC m=+972.022610513" watchObservedRunningTime="2026-09-18 21:22:18.560655123 +0000 UTC m=+972.023434484"
Sep 18 21:22:18.592167 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:18.592118    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t" podStartSLOduration=2.592102081 podStartE2EDuration="2.592102081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:22:18.590914258 +0000 UTC m=+972.053693615" watchObservedRunningTime="2026-09-18 21:22:18.592102081 +0000 UTC m=+972.054881441"
Sep 18 21:22:20.553279 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.553248    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"]
Sep 18 21:22:20.553723 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.553480    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n" podUID="91c7d31d-4e3f-4019-947b-4fb944087d71" containerName="payload-processing" containerID="cri-o://513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc" gracePeriod=30
Sep 18 21:22:20.809315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.809262    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:22:20.884798 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.884774    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c7d31d-4e3f-4019-947b-4fb944087d71-plugins-config-volume\") pod \"91c7d31d-4e3f-4019-947b-4fb944087d71\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") "
Sep 18 21:22:20.884955 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.884821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t77nf\" (UniqueName: \"kubernetes.io/projected/91c7d31d-4e3f-4019-947b-4fb944087d71-kube-api-access-t77nf\") pod \"91c7d31d-4e3f-4019-947b-4fb944087d71\" (UID: \"91c7d31d-4e3f-4019-947b-4fb944087d71\") "
Sep 18 21:22:20.885191 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.885165    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91c7d31d-4e3f-4019-947b-4fb944087d71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91c7d31d-4e3f-4019-947b-4fb944087d71" (UID: "91c7d31d-4e3f-4019-947b-4fb944087d71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:20.886934 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.886907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c7d31d-4e3f-4019-947b-4fb944087d71-kube-api-access-t77nf" (OuterVolumeSpecName: "kube-api-access-t77nf") pod "91c7d31d-4e3f-4019-947b-4fb944087d71" (UID: "91c7d31d-4e3f-4019-947b-4fb944087d71"). InnerVolumeSpecName "kube-api-access-t77nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:22:20.986051 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.986013    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91c7d31d-4e3f-4019-947b-4fb944087d71-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:20.986051 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:20.986041    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t77nf\" (UniqueName: \"kubernetes.io/projected/91c7d31d-4e3f-4019-947b-4fb944087d71-kube-api-access-t77nf\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:21.018376 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.018348    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"]
Sep 18 21:22:21.023788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.023766    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-21df59-sh7ft"]
Sep 18 21:22:21.545180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.545148    2576 generic.go:356] "Generic (PLEG): container finished" podID="91c7d31d-4e3f-4019-947b-4fb944087d71" containerID="513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc" exitCode=0
Sep 18 21:22:21.545338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.545189    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"
Sep 18 21:22:21.545338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.545232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n" event={"ID":"91c7d31d-4e3f-4019-947b-4fb944087d71","Type":"ContainerDied","Data":"513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc"}
Sep 18 21:22:21.545338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.545285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n" event={"ID":"91c7d31d-4e3f-4019-947b-4fb944087d71","Type":"ContainerDied","Data":"0901b2b7462ffcb3050092c243b3707fac5ab2a1e2d269856725cc35e7cf8d3b"}
Sep 18 21:22:21.545338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.545313    2576 scope.go:117] "RemoveContainer" containerID="513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc"
Sep 18 21:22:21.553823 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.553807    2576 scope.go:117] "RemoveContainer" containerID="513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc"
Sep 18 21:22:21.554323 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:22:21.554303    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc\": container with ID starting with 513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc not found: ID does not exist" containerID="513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc"
Sep 18 21:22:21.554379 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.554330    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc"} err="failed to get container status \"513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc\": rpc error: code = NotFound desc = could not find container \"513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc\": container with ID starting with 513f4143ff3da93b2ed7666ac94ab133f213191aa33a5a7e94a97b987a80b5fc not found: ID does not exist"
Sep 18 21:22:21.594999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.594974    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"]
Sep 18 21:22:21.615074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:21.615053    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n"]
Sep 18 21:22:22.740839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:22.740807    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ff3f48-60fc-4ba5-8a8a-d478af18e37c" path="/var/lib/kubelet/pods/72ff3f48-60fc-4ba5-8a8a-d478af18e37c/volumes"
Sep 18 21:22:22.741192 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:22.741178    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c7d31d-4e3f-4019-947b-4fb944087d71" path="/var/lib/kubelet/pods/91c7d31d-4e3f-4019-947b-4fb944087d71/volumes"
Sep 18 21:22:29.536970 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:29.536904    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:29.537385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:29.536974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:30.166392 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.166362    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"]
Sep 18 21:22:30.166750 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.166736    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c7d31d-4e3f-4019-947b-4fb944087d71" containerName="payload-processing"
Sep 18 21:22:30.166797 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.166752    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c7d31d-4e3f-4019-947b-4fb944087d71" containerName="payload-processing"
Sep 18 21:22:30.166829 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.166802    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c7d31d-4e3f-4019-947b-4fb944087d71" containerName="payload-processing"
Sep 18 21:22:30.169512 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.169496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:30.172370 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.172348    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:22:30.172953 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.172940    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:22:30.179235 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.179210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"]
Sep 18 21:22:30.253227 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.253201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e00a2-28ef-4fba-b61c-23e495b53aaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-962c4157-kf9vd\" (UID: \"fe0e00a2-28ef-4fba-b61c-23e495b53aaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:30.353624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.353592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e00a2-28ef-4fba-b61c-23e495b53aaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-962c4157-kf9vd\" (UID: \"fe0e00a2-28ef-4fba-b61c-23e495b53aaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:30.354304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.354284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e00a2-28ef-4fba-b61c-23e495b53aaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-962c4157-kf9vd\" (UID: \"fe0e00a2-28ef-4fba-b61c-23e495b53aaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:30.479632 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.479558    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:30.772510 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:30.772445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"]
Sep 18 21:22:30.779618 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:22:30.779587    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0e00a2_28ef_4fba_b61c_23e495b53aaf.slice/crio-f7ff4864cdf68c694d030d371939cc435dc537d3e5cdd1523c72aec09e6e7200 WatchSource:0}: Error finding container f7ff4864cdf68c694d030d371939cc435dc537d3e5cdd1523c72aec09e6e7200: Status 404 returned error can't find the container with id f7ff4864cdf68c694d030d371939cc435dc537d3e5cdd1523c72aec09e6e7200
Sep 18 21:22:31.598147 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:31.598118    2576 generic.go:356] "Generic (PLEG): container finished" podID="fe0e00a2-28ef-4fba-b61c-23e495b53aaf" containerID="2e64c29e167d8dde7c3723238d31fc7b2ce538350204241291f4d6a36c615429" exitCode=0
Sep 18 21:22:31.598271 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:31.598179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd" event={"ID":"fe0e00a2-28ef-4fba-b61c-23e495b53aaf","Type":"ContainerDied","Data":"2e64c29e167d8dde7c3723238d31fc7b2ce538350204241291f4d6a36c615429"}
Sep 18 21:22:31.598271 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:31.598216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd" event={"ID":"fe0e00a2-28ef-4fba-b61c-23e495b53aaf","Type":"ContainerStarted","Data":"f7ff4864cdf68c694d030d371939cc435dc537d3e5cdd1523c72aec09e6e7200"}
Sep 18 21:22:32.725990 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:32.725968    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:32.875675 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:32.875595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e00a2-28ef-4fba-b61c-23e495b53aaf-maas-api-service-ca\") pod \"fe0e00a2-28ef-4fba-b61c-23e495b53aaf\" (UID: \"fe0e00a2-28ef-4fba-b61c-23e495b53aaf\") "
Sep 18 21:22:32.875954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:32.875934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0e00a2-28ef-4fba-b61c-23e495b53aaf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe0e00a2-28ef-4fba-b61c-23e495b53aaf" (UID: "fe0e00a2-28ef-4fba-b61c-23e495b53aaf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:32.976347 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:32.976312    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0e00a2-28ef-4fba-b61c-23e495b53aaf-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:33.608274 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:33.608234    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd" event={"ID":"fe0e00a2-28ef-4fba-b61c-23e495b53aaf","Type":"ContainerDied","Data":"f7ff4864cdf68c694d030d371939cc435dc537d3e5cdd1523c72aec09e6e7200"}
Sep 18 21:22:33.608274 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:33.608260    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"
Sep 18 21:22:33.608476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:33.608291    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7ff4864cdf68c694d030d371939cc435dc537d3e5cdd1523c72aec09e6e7200"
Sep 18 21:22:41.134184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.134154    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"]
Sep 18 21:22:41.134615 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.134396    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl" podUID="db231901-1a15-4612-bfd0-4e218416c957" containerName="payload-processing" containerID="cri-o://b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4" gracePeriod=30
Sep 18 21:22:41.147203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.147178    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"]
Sep 18 21:22:41.147436 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.147409    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t" podUID="cc53f409-fe3e-47a0-9440-676e3e3b9472" containerName="payload-pre-processing" containerID="cri-o://5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32" gracePeriod=30
Sep 18 21:22:41.367400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.367368    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"]
Sep 18 21:22:41.373790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.373752    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-962c4157-kf9vd"]
Sep 18 21:22:41.400051 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.400028    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:41.420066 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.420036    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:41.543837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.543806    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r28z\" (UniqueName: \"kubernetes.io/projected/cc53f409-fe3e-47a0-9440-676e3e3b9472-kube-api-access-2r28z\") pod \"cc53f409-fe3e-47a0-9440-676e3e3b9472\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") "
Sep 18 21:22:41.544031 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.543849    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc53f409-fe3e-47a0-9440-676e3e3b9472-plugins-config-volume\") pod \"cc53f409-fe3e-47a0-9440-676e3e3b9472\" (UID: \"cc53f409-fe3e-47a0-9440-676e3e3b9472\") "
Sep 18 21:22:41.544031 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.543990    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db231901-1a15-4612-bfd0-4e218416c957-plugins-config-volume\") pod \"db231901-1a15-4612-bfd0-4e218416c957\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") "
Sep 18 21:22:41.544210 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.544029    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm5mg\" (UniqueName: \"kubernetes.io/projected/db231901-1a15-4612-bfd0-4e218416c957-kube-api-access-gm5mg\") pod \"db231901-1a15-4612-bfd0-4e218416c957\" (UID: \"db231901-1a15-4612-bfd0-4e218416c957\") "
Sep 18 21:22:41.544303 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.544230    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc53f409-fe3e-47a0-9440-676e3e3b9472-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc53f409-fe3e-47a0-9440-676e3e3b9472" (UID: "cc53f409-fe3e-47a0-9440-676e3e3b9472"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:41.544444 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.544414    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db231901-1a15-4612-bfd0-4e218416c957-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db231901-1a15-4612-bfd0-4e218416c957" (UID: "db231901-1a15-4612-bfd0-4e218416c957"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:22:41.545974 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.545954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc53f409-fe3e-47a0-9440-676e3e3b9472-kube-api-access-2r28z" (OuterVolumeSpecName: "kube-api-access-2r28z") pod "cc53f409-fe3e-47a0-9440-676e3e3b9472" (UID: "cc53f409-fe3e-47a0-9440-676e3e3b9472"). InnerVolumeSpecName "kube-api-access-2r28z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:22:41.546027 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.546002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db231901-1a15-4612-bfd0-4e218416c957-kube-api-access-gm5mg" (OuterVolumeSpecName: "kube-api-access-gm5mg") pod "db231901-1a15-4612-bfd0-4e218416c957" (UID: "db231901-1a15-4612-bfd0-4e218416c957"). InnerVolumeSpecName "kube-api-access-gm5mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:22:41.645564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.645491    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db231901-1a15-4612-bfd0-4e218416c957-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:41.645564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.645517    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm5mg\" (UniqueName: \"kubernetes.io/projected/db231901-1a15-4612-bfd0-4e218416c957-kube-api-access-gm5mg\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:41.645564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.645527    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r28z\" (UniqueName: \"kubernetes.io/projected/cc53f409-fe3e-47a0-9440-676e3e3b9472-kube-api-access-2r28z\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:41.645564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.645536    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc53f409-fe3e-47a0-9440-676e3e3b9472-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:22:41.651398 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.651369    2576 generic.go:356] "Generic (PLEG): container finished" podID="db231901-1a15-4612-bfd0-4e218416c957" containerID="b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4" exitCode=0
Sep 18 21:22:41.651513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.651411    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"
Sep 18 21:22:41.651513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.651451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl" event={"ID":"db231901-1a15-4612-bfd0-4e218416c957","Type":"ContainerDied","Data":"b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4"}
Sep 18 21:22:41.651599 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.651540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl" event={"ID":"db231901-1a15-4612-bfd0-4e218416c957","Type":"ContainerDied","Data":"7aca2911a1c8f7b720f25d5e8177174f7b61b85029c39400d155aa0bf8171f96"}
Sep 18 21:22:41.651599 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.651570    2576 scope.go:117] "RemoveContainer" containerID="b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4"
Sep 18 21:22:41.652769 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.652744    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc53f409-fe3e-47a0-9440-676e3e3b9472" containerID="5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32" exitCode=0
Sep 18 21:22:41.652859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.652778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t" event={"ID":"cc53f409-fe3e-47a0-9440-676e3e3b9472","Type":"ContainerDied","Data":"5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32"}
Sep 18 21:22:41.652859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.652803    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"
Sep 18 21:22:41.652859 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.652822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t" event={"ID":"cc53f409-fe3e-47a0-9440-676e3e3b9472","Type":"ContainerDied","Data":"8aa8168873881c36d64b585684c216b91cf3d37f6960bfa5f773f5d36cb0984a"}
Sep 18 21:22:41.660758 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.660712    2576 scope.go:117] "RemoveContainer" containerID="b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4"
Sep 18 21:22:41.661070 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:22:41.661039    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4\": container with ID starting with b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4 not found: ID does not exist" containerID="b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4"
Sep 18 21:22:41.661154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.661073    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4"} err="failed to get container status \"b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4\": rpc error: code = NotFound desc = could not find container \"b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4\": container with ID starting with b5f3096e2fb32d3133084e8227ade684be17023dd41281738c49e2d73d769ac4 not found: ID does not exist"
Sep 18 21:22:41.661154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.661097    2576 scope.go:117] "RemoveContainer" containerID="5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32"
Sep 18 21:22:41.668959 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.668936    2576 scope.go:117] "RemoveContainer" containerID="5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32"
Sep 18 21:22:41.669270 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:22:41.669249    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32\": container with ID starting with 5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32 not found: ID does not exist" containerID="5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32"
Sep 18 21:22:41.669330 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.669276    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32"} err="failed to get container status \"5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32\": rpc error: code = NotFound desc = could not find container \"5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32\": container with ID starting with 5063beb2411cae991a4b0efc6d5238e1a0a08b62f1ef630454598ece85ecfb32 not found: ID does not exist"
Sep 18 21:22:41.682091 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.682073    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"]
Sep 18 21:22:41.686466 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.686447    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl"]
Sep 18 21:22:41.697320 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.697299    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"]
Sep 18 21:22:41.702537 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:41.702520    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t"]
Sep 18 21:22:42.740615 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:42.740588    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc53f409-fe3e-47a0-9440-676e3e3b9472" path="/var/lib/kubelet/pods/cc53f409-fe3e-47a0-9440-676e3e3b9472/volumes"
Sep 18 21:22:42.740982 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:42.740948    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db231901-1a15-4612-bfd0-4e218416c957" path="/var/lib/kubelet/pods/db231901-1a15-4612-bfd0-4e218416c957/volumes"
Sep 18 21:22:42.741217 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:42.741205    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0e00a2-28ef-4fba-b61c-23e495b53aaf" path="/var/lib/kubelet/pods/fe0e00a2-28ef-4fba-b61c-23e495b53aaf/volumes"
Sep 18 21:22:43.458117 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:43.458091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:22:58.492942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:22:58.492909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:23:10.077338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077308    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"]
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077634    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0e00a2-28ef-4fba-b61c-23e495b53aaf" containerName="revoke-keys"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077646    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0e00a2-28ef-4fba-b61c-23e495b53aaf" containerName="revoke-keys"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077662    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc53f409-fe3e-47a0-9440-676e3e3b9472" containerName="payload-pre-processing"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077668    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc53f409-fe3e-47a0-9440-676e3e3b9472" containerName="payload-pre-processing"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077675    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db231901-1a15-4612-bfd0-4e218416c957" containerName="payload-processing"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077681    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="db231901-1a15-4612-bfd0-4e218416c957" containerName="payload-processing"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077733    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc53f409-fe3e-47a0-9440-676e3e3b9472" containerName="payload-pre-processing"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077741    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="db231901-1a15-4612-bfd0-4e218416c957" containerName="payload-processing"
Sep 18 21:23:10.077765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.077746    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0e00a2-28ef-4fba-b61c-23e495b53aaf" containerName="revoke-keys"
Sep 18 21:23:10.081893 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.081867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:10.084698 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.084677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:23:10.085111 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.085097    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:23:10.092579 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.092558    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"]
Sep 18 21:23:10.257405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.257370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5ae355-37b7-44d3-8595-26d5d2aeb348-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb\" (UID: \"9a5ae355-37b7-44d3-8595-26d5d2aeb348\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:10.358799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.358717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5ae355-37b7-44d3-8595-26d5d2aeb348-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb\" (UID: \"9a5ae355-37b7-44d3-8595-26d5d2aeb348\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:10.359407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.359387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5ae355-37b7-44d3-8595-26d5d2aeb348-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb\" (UID: \"9a5ae355-37b7-44d3-8595-26d5d2aeb348\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:10.392133 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.392111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:10.663842 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.663817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"]
Sep 18 21:23:10.666166 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:23:10.666138    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5ae355_37b7_44d3_8595_26d5d2aeb348.slice/crio-381e08505f2be3ffdb98bf0fac5ec65fea2cdf04c6d5a9a965cd9b6aedfe2bc0 WatchSource:0}: Error finding container 381e08505f2be3ffdb98bf0fac5ec65fea2cdf04c6d5a9a965cd9b6aedfe2bc0: Status 404 returned error can't find the container with id 381e08505f2be3ffdb98bf0fac5ec65fea2cdf04c6d5a9a965cd9b6aedfe2bc0
Sep 18 21:23:10.790713 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:10.790670    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb" event={"ID":"9a5ae355-37b7-44d3-8595-26d5d2aeb348","Type":"ContainerStarted","Data":"381e08505f2be3ffdb98bf0fac5ec65fea2cdf04c6d5a9a965cd9b6aedfe2bc0"}
Sep 18 21:23:11.804222 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:11.804181    2576 generic.go:356] "Generic (PLEG): container finished" podID="9a5ae355-37b7-44d3-8595-26d5d2aeb348" containerID="8cf3a3fd3362fbcecd93da9c466468c2356faffeb3137763935d470d0f7f0058" exitCode=0
Sep 18 21:23:11.804685 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:11.804280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb" event={"ID":"9a5ae355-37b7-44d3-8595-26d5d2aeb348","Type":"ContainerDied","Data":"8cf3a3fd3362fbcecd93da9c466468c2356faffeb3137763935d470d0f7f0058"}
Sep 18 21:23:12.940496 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:12.940464    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:12.976843 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:12.976813    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5ae355-37b7-44d3-8595-26d5d2aeb348-maas-api-service-ca\") pod \"9a5ae355-37b7-44d3-8595-26d5d2aeb348\" (UID: \"9a5ae355-37b7-44d3-8595-26d5d2aeb348\") "
Sep 18 21:23:12.977193 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:12.977169    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5ae355-37b7-44d3-8595-26d5d2aeb348-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9a5ae355-37b7-44d3-8595-26d5d2aeb348" (UID: "9a5ae355-37b7-44d3-8595-26d5d2aeb348"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:23:13.077645 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:13.077616    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5ae355-37b7-44d3-8595-26d5d2aeb348-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:23:13.815933 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:13.815881    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"
Sep 18 21:23:13.815933 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:13.815918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb" event={"ID":"9a5ae355-37b7-44d3-8595-26d5d2aeb348","Type":"ContainerDied","Data":"381e08505f2be3ffdb98bf0fac5ec65fea2cdf04c6d5a9a965cd9b6aedfe2bc0"}
Sep 18 21:23:13.816139 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:13.815969    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="381e08505f2be3ffdb98bf0fac5ec65fea2cdf04c6d5a9a965cd9b6aedfe2bc0"
Sep 18 21:23:20.684767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.684731    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"]
Sep 18 21:23:20.685341 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.685019    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv" podUID="02a9634c-8c01-40d8-9a57-eca0d1c32500" containerName="payload-processing" containerID="cri-o://4a6caefb64a8cbcfd5b80c8a3ff0951d31a75d6e96c349d243bcd0f57cb3d0f1" gracePeriod=30
Sep 18 21:23:20.704363 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.704338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"]
Sep 18 21:23:20.704575 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.704542    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv" podUID="fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" containerName="payload-pre-processing" containerID="cri-o://f6ed06485da7625c0f16406aa61301d0f4c95719041a74985b7db7dcbfe98ae2" gracePeriod=30
Sep 18 21:23:20.853915 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.853865    2576 generic.go:356] "Generic (PLEG): container finished" podID="fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" containerID="f6ed06485da7625c0f16406aa61301d0f4c95719041a74985b7db7dcbfe98ae2" exitCode=0
Sep 18 21:23:20.854087 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.853912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv" event={"ID":"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8","Type":"ContainerDied","Data":"f6ed06485da7625c0f16406aa61301d0f4c95719041a74985b7db7dcbfe98ae2"}
Sep 18 21:23:20.855829 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.855797    2576 generic.go:356] "Generic (PLEG): container finished" podID="02a9634c-8c01-40d8-9a57-eca0d1c32500" containerID="4a6caefb64a8cbcfd5b80c8a3ff0951d31a75d6e96c349d243bcd0f57cb3d0f1" exitCode=0
Sep 18 21:23:20.855963 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.855844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv" event={"ID":"02a9634c-8c01-40d8-9a57-eca0d1c32500","Type":"ContainerDied","Data":"4a6caefb64a8cbcfd5b80c8a3ff0951d31a75d6e96c349d243bcd0f57cb3d0f1"}
Sep 18 21:23:20.979742 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.979717    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:23:20.983057 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:20.983038    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:23:21.032668 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.032637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpf47\" (UniqueName: \"kubernetes.io/projected/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-kube-api-access-fpf47\") pod \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") "
Sep 18 21:23:21.032828 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.032689    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a9634c-8c01-40d8-9a57-eca0d1c32500-plugins-config-volume\") pod \"02a9634c-8c01-40d8-9a57-eca0d1c32500\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") "
Sep 18 21:23:21.032828 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.032718    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-plugins-config-volume\") pod \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\" (UID: \"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8\") "
Sep 18 21:23:21.032828 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.032765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95wk9\" (UniqueName: \"kubernetes.io/projected/02a9634c-8c01-40d8-9a57-eca0d1c32500-kube-api-access-95wk9\") pod \"02a9634c-8c01-40d8-9a57-eca0d1c32500\" (UID: \"02a9634c-8c01-40d8-9a57-eca0d1c32500\") "
Sep 18 21:23:21.033123 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.033068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a9634c-8c01-40d8-9a57-eca0d1c32500-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02a9634c-8c01-40d8-9a57-eca0d1c32500" (UID: "02a9634c-8c01-40d8-9a57-eca0d1c32500"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:23:21.033123 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.033108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" (UID: "fe4f5785-28c6-4631-aa3d-1ba5cd4018f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:23:21.034806 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.034785    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-kube-api-access-fpf47" (OuterVolumeSpecName: "kube-api-access-fpf47") pod "fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" (UID: "fe4f5785-28c6-4631-aa3d-1ba5cd4018f8"). InnerVolumeSpecName "kube-api-access-fpf47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:23:21.034870 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.034790    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a9634c-8c01-40d8-9a57-eca0d1c32500-kube-api-access-95wk9" (OuterVolumeSpecName: "kube-api-access-95wk9") pod "02a9634c-8c01-40d8-9a57-eca0d1c32500" (UID: "02a9634c-8c01-40d8-9a57-eca0d1c32500"). InnerVolumeSpecName "kube-api-access-95wk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:23:21.093438 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.093402    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"]
Sep 18 21:23:21.094909 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.094873    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a7d035-62swb"]
Sep 18 21:23:21.133722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.133690    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95wk9\" (UniqueName: \"kubernetes.io/projected/02a9634c-8c01-40d8-9a57-eca0d1c32500-kube-api-access-95wk9\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:23:21.133722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.133714    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpf47\" (UniqueName: \"kubernetes.io/projected/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-kube-api-access-fpf47\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:23:21.133722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.133725    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02a9634c-8c01-40d8-9a57-eca0d1c32500-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:23:21.133980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.133737    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:23:21.861524 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.861494    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"
Sep 18 21:23:21.861524 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.861510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv" event={"ID":"fe4f5785-28c6-4631-aa3d-1ba5cd4018f8","Type":"ContainerDied","Data":"d3c1658daaea5b41d3e3e588eed63ea422c008f17b8ce8f87636fba2c8ba2b33"}
Sep 18 21:23:21.862075 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.861575    2576 scope.go:117] "RemoveContainer" containerID="f6ed06485da7625c0f16406aa61301d0f4c95719041a74985b7db7dcbfe98ae2"
Sep 18 21:23:21.862981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.862959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv" event={"ID":"02a9634c-8c01-40d8-9a57-eca0d1c32500","Type":"ContainerDied","Data":"da9e2dd3c931601c2de96a7f85a170152cd80ed40b80dfb73320c5adf56cd2bd"}
Sep 18 21:23:21.863043 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.862998    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"
Sep 18 21:23:21.878380 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.878362    2576 scope.go:117] "RemoveContainer" containerID="4a6caefb64a8cbcfd5b80c8a3ff0951d31a75d6e96c349d243bcd0f57cb3d0f1"
Sep 18 21:23:21.893655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.893630    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"]
Sep 18 21:23:21.901102 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.901078    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv"]
Sep 18 21:23:21.915827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.915805    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"]
Sep 18 21:23:21.917759 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:21.917738    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv"]
Sep 18 21:23:22.740709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:22.740678    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a9634c-8c01-40d8-9a57-eca0d1c32500" path="/var/lib/kubelet/pods/02a9634c-8c01-40d8-9a57-eca0d1c32500/volumes"
Sep 18 21:23:22.741108 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:22.741089    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5ae355-37b7-44d3-8595-26d5d2aeb348" path="/var/lib/kubelet/pods/9a5ae355-37b7-44d3-8595-26d5d2aeb348/volumes"
Sep 18 21:23:22.741460 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:22.741442    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" path="/var/lib/kubelet/pods/fe4f5785-28c6-4631-aa3d-1ba5cd4018f8/volumes"
Sep 18 21:23:26.004807 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.004771    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:23:26.346510 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346481    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"]
Sep 18 21:23:26.346828 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346815    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a5ae355-37b7-44d3-8595-26d5d2aeb348" containerName="revoke-keys"
Sep 18 21:23:26.346877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346829    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a5ae355-37b7-44d3-8595-26d5d2aeb348" containerName="revoke-keys"
Sep 18 21:23:26.346877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346851    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" containerName="payload-pre-processing"
Sep 18 21:23:26.346877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346857    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" containerName="payload-pre-processing"
Sep 18 21:23:26.346877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346865    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a9634c-8c01-40d8-9a57-eca0d1c32500" containerName="payload-processing"
Sep 18 21:23:26.346877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346870    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a9634c-8c01-40d8-9a57-eca0d1c32500" containerName="payload-processing"
Sep 18 21:23:26.347086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346941    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a5ae355-37b7-44d3-8595-26d5d2aeb348" containerName="revoke-keys"
Sep 18 21:23:26.347086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346954    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a9634c-8c01-40d8-9a57-eca0d1c32500" containerName="payload-processing"
Sep 18 21:23:26.347086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.346959    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f5785-28c6-4631-aa3d-1ba5cd4018f8" containerName="payload-pre-processing"
Sep 18 21:23:26.351177 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.351158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.356862 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.356843    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-773e07\""
Sep 18 21:23:26.373209 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.373183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"]
Sep 18 21:23:26.374616 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.374594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbg5c\" (UniqueName: \"kubernetes.io/projected/bad68850-d890-48e4-9514-250b99ebe50b-kube-api-access-vbg5c\") pod \"payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") " pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.374715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.374638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bad68850-d890-48e4-9514-250b99ebe50b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") " pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.394698 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.394673    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"]
Sep 18 21:23:26.397733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.397718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.403827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.403805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-773e07-dockercfg-559nf\""
Sep 18 21:23:26.421756 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.421725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"]
Sep 18 21:23:26.475286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.475255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw6fh\" (UniqueName: \"kubernetes.io/projected/82ea817a-f603-471e-bf2f-51343faf8654-kube-api-access-pw6fh\") pod \"payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.475437 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.475299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbg5c\" (UniqueName: \"kubernetes.io/projected/bad68850-d890-48e4-9514-250b99ebe50b-kube-api-access-vbg5c\") pod \"payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") " pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.475437 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.475320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ea817a-f603-471e-bf2f-51343faf8654-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.475437 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.475343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bad68850-d890-48e4-9514-250b99ebe50b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") " pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.476066 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.476048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bad68850-d890-48e4-9514-250b99ebe50b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") " pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.498227 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.498200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbg5c\" (UniqueName: \"kubernetes.io/projected/bad68850-d890-48e4-9514-250b99ebe50b-kube-api-access-vbg5c\") pod \"payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") " pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.576398 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.576369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw6fh\" (UniqueName: \"kubernetes.io/projected/82ea817a-f603-471e-bf2f-51343faf8654-kube-api-access-pw6fh\") pod \"payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.576574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.576412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ea817a-f603-471e-bf2f-51343faf8654-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.577156 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.577135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ea817a-f603-471e-bf2f-51343faf8654-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.590161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.590137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw6fh\" (UniqueName: \"kubernetes.io/projected/82ea817a-f603-471e-bf2f-51343faf8654-kube-api-access-pw6fh\") pod \"payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.660793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.660710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:26.707386 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.707353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:26.971097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:26.971070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"]
Sep 18 21:23:26.971395 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:23:26.971374    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad68850_d890_48e4_9514_250b99ebe50b.slice/crio-271bc4961430947c6efbbd60f00c3fb7ec25314e91353328ded04e3c6dbda8fe WatchSource:0}: Error finding container 271bc4961430947c6efbbd60f00c3fb7ec25314e91353328ded04e3c6dbda8fe: Status 404 returned error can't find the container with id 271bc4961430947c6efbbd60f00c3fb7ec25314e91353328ded04e3c6dbda8fe
Sep 18 21:23:27.046291 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.046265    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"]
Sep 18 21:23:27.048066 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:23:27.048035    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ea817a_f603_471e_bf2f_51343faf8654.slice/crio-4103339a3a1a82b296cc287c95409c098faaddb84b35171b326be109b14afafe WatchSource:0}: Error finding container 4103339a3a1a82b296cc287c95409c098faaddb84b35171b326be109b14afafe: Status 404 returned error can't find the container with id 4103339a3a1a82b296cc287c95409c098faaddb84b35171b326be109b14afafe
Sep 18 21:23:27.895518 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.895482    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc" event={"ID":"bad68850-d890-48e4-9514-250b99ebe50b","Type":"ContainerStarted","Data":"204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0"}
Sep 18 21:23:27.895720 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.895533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc" event={"ID":"bad68850-d890-48e4-9514-250b99ebe50b","Type":"ContainerStarted","Data":"271bc4961430947c6efbbd60f00c3fb7ec25314e91353328ded04e3c6dbda8fe"}
Sep 18 21:23:27.895720 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.895584    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:27.897079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.897056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4" event={"ID":"82ea817a-f603-471e-bf2f-51343faf8654","Type":"ContainerStarted","Data":"0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c"}
Sep 18 21:23:27.897172 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.897098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4" event={"ID":"82ea817a-f603-471e-bf2f-51343faf8654","Type":"ContainerStarted","Data":"4103339a3a1a82b296cc287c95409c098faaddb84b35171b326be109b14afafe"}
Sep 18 21:23:27.897213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.897198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:27.914902 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.914839    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc" podStartSLOduration=1.9148265979999999 podStartE2EDuration="1.914826598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:23:27.913425636 +0000 UTC m=+1041.376204994" watchObservedRunningTime="2026-09-18 21:23:27.914826598 +0000 UTC m=+1041.377605956"
Sep 18 21:23:27.934016 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:27.933961    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4" podStartSLOduration=1.9339439889999999 podStartE2EDuration="1.933943989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:23:27.932500691 +0000 UTC m=+1041.395280050" watchObservedRunningTime="2026-09-18 21:23:27.933943989 +0000 UTC m=+1041.396723349"
Sep 18 21:23:38.903934 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:38.903877    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:23:38.904333 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:38.903964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:23:41.892452 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:23:41.892420    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:24:06.432001 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:06.431913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:24:24.917679 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:24.917646    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:24:37.991994 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:37.991964    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"]
Sep 18 21:24:37.995403 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:37.995385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:37.998082 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:37.998058    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a2b92ced-dockercfg-kqcgg\""
Sep 18 21:24:37.998982 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:37.998960    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a2b92ced\""
Sep 18 21:24:38.007922 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.007894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"]
Sep 18 21:24:38.052310 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.052276    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"]
Sep 18 21:24:38.055542 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.055523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.070478 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.070450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"]
Sep 18 21:24:38.081868 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.081831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/f20e00ec-8df1-4119-873a-f7e458d58ce6-kube-api-access-58qsh\") pod \"payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.082204 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.082172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f20e00ec-8df1-4119-873a-f7e458d58ce6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.182912 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.182838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f20e00ec-8df1-4119-873a-f7e458d58ce6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.183118 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.182922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6cd75e-1070-4bc3-bb53-c15a98b109ed-plugins-config-volume\") pod \"payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") " pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.183118 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.183056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n6t5\" (UniqueName: \"kubernetes.io/projected/da6cd75e-1070-4bc3-bb53-c15a98b109ed-kube-api-access-8n6t5\") pod \"payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") " pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.183118 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.183094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/f20e00ec-8df1-4119-873a-f7e458d58ce6-kube-api-access-58qsh\") pod \"payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.183634 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.183610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f20e00ec-8df1-4119-873a-f7e458d58ce6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.192656 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.192628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/f20e00ec-8df1-4119-873a-f7e458d58ce6-kube-api-access-58qsh\") pod \"payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.283953 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.283833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n6t5\" (UniqueName: \"kubernetes.io/projected/da6cd75e-1070-4bc3-bb53-c15a98b109ed-kube-api-access-8n6t5\") pod \"payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") " pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.283953 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.283895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6cd75e-1070-4bc3-bb53-c15a98b109ed-plugins-config-volume\") pod \"payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") " pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.284558 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.284539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6cd75e-1070-4bc3-bb53-c15a98b109ed-plugins-config-volume\") pod \"payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") " pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.292613 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.292584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n6t5\" (UniqueName: \"kubernetes.io/projected/da6cd75e-1070-4bc3-bb53-c15a98b109ed-kube-api-access-8n6t5\") pod \"payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") " pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.305527 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.305500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:38.368309 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.368255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:38.580042 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.580013    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"]
Sep 18 21:24:38.582638 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:24:38.582608    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20e00ec_8df1_4119_873a_f7e458d58ce6.slice/crio-724938b5363658d525c483d89cb7889d2f1a8e19a157cfe904970765ee799a68 WatchSource:0}: Error finding container 724938b5363658d525c483d89cb7889d2f1a8e19a157cfe904970765ee799a68: Status 404 returned error can't find the container with id 724938b5363658d525c483d89cb7889d2f1a8e19a157cfe904970765ee799a68
Sep 18 21:24:38.643315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:38.643290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"]
Sep 18 21:24:38.644654 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:24:38.644630    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6cd75e_1070_4bc3_bb53_c15a98b109ed.slice/crio-06716afb6ee5587ed3a29cb2a6108fd7dec8558319a7a8b70f28fc13e6235a05 WatchSource:0}: Error finding container 06716afb6ee5587ed3a29cb2a6108fd7dec8558319a7a8b70f28fc13e6235a05: Status 404 returned error can't find the container with id 06716afb6ee5587ed3a29cb2a6108fd7dec8558319a7a8b70f28fc13e6235a05
Sep 18 21:24:39.245239 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.245198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh" event={"ID":"f20e00ec-8df1-4119-873a-f7e458d58ce6","Type":"ContainerStarted","Data":"0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48"}
Sep 18 21:24:39.245709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.245270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:24:39.245709 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.245298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh" event={"ID":"f20e00ec-8df1-4119-873a-f7e458d58ce6","Type":"ContainerStarted","Data":"724938b5363658d525c483d89cb7889d2f1a8e19a157cfe904970765ee799a68"}
Sep 18 21:24:39.246952 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.246916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2" event={"ID":"da6cd75e-1070-4bc3-bb53-c15a98b109ed","Type":"ContainerStarted","Data":"31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae"}
Sep 18 21:24:39.247098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.246971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2" event={"ID":"da6cd75e-1070-4bc3-bb53-c15a98b109ed","Type":"ContainerStarted","Data":"06716afb6ee5587ed3a29cb2a6108fd7dec8558319a7a8b70f28fc13e6235a05"}
Sep 18 21:24:39.247098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.246993    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:39.274121 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.274063    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh" podStartSLOduration=2.274045403 podStartE2EDuration="2.274045403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:24:39.271322081 +0000 UTC m=+1112.734101454" watchObservedRunningTime="2026-09-18 21:24:39.274045403 +0000 UTC m=+1112.736824740"
Sep 18 21:24:39.294372 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:39.294317    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2" podStartSLOduration=1.2942981009999999 podStartE2EDuration="1.294298101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:24:39.292840126 +0000 UTC m=+1112.755619485" watchObservedRunningTime="2026-09-18 21:24:39.294298101 +0000 UTC m=+1112.757077760"
Sep 18 21:24:48.604131 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:48.604092    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:24:50.255062 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:50.255034    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:24:50.255476 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:24:50.255110    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:25:04.585661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.585627    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"]
Sep 18 21:25:04.589128 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.589109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:04.591608 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.591584    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:25:04.591743 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.591726    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:25:04.597183 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.597148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"]
Sep 18 21:25:04.715229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.715187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e9067-1baa-4526-a506-51bbd9fe82fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-773e07-wqwvd\" (UID: \"6d1e9067-1baa-4526-a506-51bbd9fe82fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:04.815959 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.815918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e9067-1baa-4526-a506-51bbd9fe82fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-773e07-wqwvd\" (UID: \"6d1e9067-1baa-4526-a506-51bbd9fe82fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:04.816562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.816542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e9067-1baa-4526-a506-51bbd9fe82fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-773e07-wqwvd\" (UID: \"6d1e9067-1baa-4526-a506-51bbd9fe82fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:04.900976 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:04.900892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:05.170369 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:05.170224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"]
Sep 18 21:25:05.172807 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:25:05.172778    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1e9067_1baa_4526_a506_51bbd9fe82fc.slice/crio-7d5f5f0dade4acc558fd4c96e84106c59f3e08a574d9ac755a1061bf649891f0 WatchSource:0}: Error finding container 7d5f5f0dade4acc558fd4c96e84106c59f3e08a574d9ac755a1061bf649891f0: Status 404 returned error can't find the container with id 7d5f5f0dade4acc558fd4c96e84106c59f3e08a574d9ac755a1061bf649891f0
Sep 18 21:25:05.377041 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:05.377003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd" event={"ID":"6d1e9067-1baa-4526-a506-51bbd9fe82fc","Type":"ContainerStarted","Data":"7d5f5f0dade4acc558fd4c96e84106c59f3e08a574d9ac755a1061bf649891f0"}
Sep 18 21:25:06.383233 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:06.383198    2576 generic.go:356] "Generic (PLEG): container finished" podID="6d1e9067-1baa-4526-a506-51bbd9fe82fc" containerID="373707f0e775dbfb4daaf261f9ce45745bac78c9577489727a6fba961fa2745a" exitCode=0
Sep 18 21:25:06.383663 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:06.383289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd" event={"ID":"6d1e9067-1baa-4526-a506-51bbd9fe82fc","Type":"ContainerDied","Data":"373707f0e775dbfb4daaf261f9ce45745bac78c9577489727a6fba961fa2745a"}
Sep 18 21:25:07.521267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:07.521244    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:07.536307 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:07.536271    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e9067-1baa-4526-a506-51bbd9fe82fc-maas-api-service-ca\") pod \"6d1e9067-1baa-4526-a506-51bbd9fe82fc\" (UID: \"6d1e9067-1baa-4526-a506-51bbd9fe82fc\") "
Sep 18 21:25:07.536633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:07.536608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d1e9067-1baa-4526-a506-51bbd9fe82fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d1e9067-1baa-4526-a506-51bbd9fe82fc" (UID: "6d1e9067-1baa-4526-a506-51bbd9fe82fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:25:07.637307 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:07.637274    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e9067-1baa-4526-a506-51bbd9fe82fc-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:08.395559 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:08.395526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd" event={"ID":"6d1e9067-1baa-4526-a506-51bbd9fe82fc","Type":"ContainerDied","Data":"7d5f5f0dade4acc558fd4c96e84106c59f3e08a574d9ac755a1061bf649891f0"}
Sep 18 21:25:08.395738 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:08.395579    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d5f5f0dade4acc558fd4c96e84106c59f3e08a574d9ac755a1061bf649891f0"
Sep 18 21:25:08.395738 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:08.395537    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"
Sep 18 21:25:10.285495 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.285459    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"]
Sep 18 21:25:10.285861 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.285844    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1e9067-1baa-4526-a506-51bbd9fe82fc" containerName="revoke-keys"
Sep 18 21:25:10.285861 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.285854    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1e9067-1baa-4526-a506-51bbd9fe82fc" containerName="revoke-keys"
Sep 18 21:25:10.285947 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.285930    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1e9067-1baa-4526-a506-51bbd9fe82fc" containerName="revoke-keys"
Sep 18 21:25:10.289011 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.288992    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:10.291758 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.291727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:25:10.292012 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.291999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:25:10.299606 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.299579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"]
Sep 18 21:25:10.361350 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.361310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7e6ee6-691d-42e4-9831-e735a75fa5cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx\" (UID: \"4c7e6ee6-691d-42e4-9831-e735a75fa5cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:10.461799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.461761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7e6ee6-691d-42e4-9831-e735a75fa5cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx\" (UID: \"4c7e6ee6-691d-42e4-9831-e735a75fa5cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:10.462443 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.462415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7e6ee6-691d-42e4-9831-e735a75fa5cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx\" (UID: \"4c7e6ee6-691d-42e4-9831-e735a75fa5cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:10.600868 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.600839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:10.878463 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:10.878372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"]
Sep 18 21:25:10.880993 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:25:10.880967    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7e6ee6_691d_42e4_9831_e735a75fa5cf.slice/crio-c9da9fe80e2da930f33155c66f9f854b913e49552824c549529ce6dfca4948ee WatchSource:0}: Error finding container c9da9fe80e2da930f33155c66f9f854b913e49552824c549529ce6dfca4948ee: Status 404 returned error can't find the container with id c9da9fe80e2da930f33155c66f9f854b913e49552824c549529ce6dfca4948ee
Sep 18 21:25:11.411067 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:11.410959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx" event={"ID":"4c7e6ee6-691d-42e4-9831-e735a75fa5cf","Type":"ContainerStarted","Data":"eb0bcfa8bd7044a9b701b1f0a25d0beb4f5f5f649da52b36fd5ff32fec398798"}
Sep 18 21:25:11.411067 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:11.411029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx" event={"ID":"4c7e6ee6-691d-42e4-9831-e735a75fa5cf","Type":"ContainerStarted","Data":"c9da9fe80e2da930f33155c66f9f854b913e49552824c549529ce6dfca4948ee"}
Sep 18 21:25:11.441036 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:11.440983    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx" podStartSLOduration=1.440964078 podStartE2EDuration="1.440964078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:25:11.438953027 +0000 UTC m=+1144.901732387" watchObservedRunningTime="2026-09-18 21:25:11.440964078 +0000 UTC m=+1144.903743481"
Sep 18 21:25:12.416827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:12.416790    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c7e6ee6-691d-42e4-9831-e735a75fa5cf" containerID="eb0bcfa8bd7044a9b701b1f0a25d0beb4f5f5f649da52b36fd5ff32fec398798" exitCode=0
Sep 18 21:25:12.417235 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:12.416877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx" event={"ID":"4c7e6ee6-691d-42e4-9831-e735a75fa5cf","Type":"ContainerDied","Data":"eb0bcfa8bd7044a9b701b1f0a25d0beb4f5f5f649da52b36fd5ff32fec398798"}
Sep 18 21:25:13.553881 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:13.553850    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:13.590753 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:13.590727    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7e6ee6-691d-42e4-9831-e735a75fa5cf-maas-api-service-ca\") pod \"4c7e6ee6-691d-42e4-9831-e735a75fa5cf\" (UID: \"4c7e6ee6-691d-42e4-9831-e735a75fa5cf\") "
Sep 18 21:25:13.591086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:13.591063    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7e6ee6-691d-42e4-9831-e735a75fa5cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c7e6ee6-691d-42e4-9831-e735a75fa5cf" (UID: "4c7e6ee6-691d-42e4-9831-e735a75fa5cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:25:13.691749 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:13.691661    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7e6ee6-691d-42e4-9831-e735a75fa5cf-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:14.428142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:14.428112    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"
Sep 18 21:25:14.428347 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:14.428154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx" event={"ID":"4c7e6ee6-691d-42e4-9831-e735a75fa5cf","Type":"ContainerDied","Data":"c9da9fe80e2da930f33155c66f9f854b913e49552824c549529ce6dfca4948ee"}
Sep 18 21:25:14.428347 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:14.428200    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9da9fe80e2da930f33155c66f9f854b913e49552824c549529ce6dfca4948ee"
Sep 18 21:25:16.670077 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:16.670040    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"]
Sep 18 21:25:16.670529 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:16.670259    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc" podUID="bad68850-d890-48e4-9514-250b99ebe50b" containerName="payload-processing" containerID="cri-o://204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0" gracePeriod=30
Sep 18 21:25:16.695365 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:16.695338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"]
Sep 18 21:25:16.695562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:16.695527    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4" podUID="82ea817a-f603-471e-bf2f-51343faf8654" containerName="payload-pre-processing" containerID="cri-o://0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c" gracePeriod=30
Sep 18 21:25:16.946767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:16.946737    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:25:16.988138 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:16.988036    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:25:17.022321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.022290    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbg5c\" (UniqueName: \"kubernetes.io/projected/bad68850-d890-48e4-9514-250b99ebe50b-kube-api-access-vbg5c\") pod \"bad68850-d890-48e4-9514-250b99ebe50b\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") "
Sep 18 21:25:17.022514 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.022344    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw6fh\" (UniqueName: \"kubernetes.io/projected/82ea817a-f603-471e-bf2f-51343faf8654-kube-api-access-pw6fh\") pod \"82ea817a-f603-471e-bf2f-51343faf8654\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") "
Sep 18 21:25:17.022514 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.022371    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ea817a-f603-471e-bf2f-51343faf8654-plugins-config-volume\") pod \"82ea817a-f603-471e-bf2f-51343faf8654\" (UID: \"82ea817a-f603-471e-bf2f-51343faf8654\") "
Sep 18 21:25:17.022514 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.022498    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bad68850-d890-48e4-9514-250b99ebe50b-plugins-config-volume\") pod \"bad68850-d890-48e4-9514-250b99ebe50b\" (UID: \"bad68850-d890-48e4-9514-250b99ebe50b\") "
Sep 18 21:25:17.022907 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.022865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ea817a-f603-471e-bf2f-51343faf8654-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82ea817a-f603-471e-bf2f-51343faf8654" (UID: "82ea817a-f603-471e-bf2f-51343faf8654"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:25:17.023104 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.023083    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bad68850-d890-48e4-9514-250b99ebe50b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bad68850-d890-48e4-9514-250b99ebe50b" (UID: "bad68850-d890-48e4-9514-250b99ebe50b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:25:17.024861 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.024829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad68850-d890-48e4-9514-250b99ebe50b-kube-api-access-vbg5c" (OuterVolumeSpecName: "kube-api-access-vbg5c") pod "bad68850-d890-48e4-9514-250b99ebe50b" (UID: "bad68850-d890-48e4-9514-250b99ebe50b"). InnerVolumeSpecName "kube-api-access-vbg5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:25:17.024988 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.024907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ea817a-f603-471e-bf2f-51343faf8654-kube-api-access-pw6fh" (OuterVolumeSpecName: "kube-api-access-pw6fh") pod "82ea817a-f603-471e-bf2f-51343faf8654" (UID: "82ea817a-f603-471e-bf2f-51343faf8654"). InnerVolumeSpecName "kube-api-access-pw6fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:25:17.123160 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.123130    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bad68850-d890-48e4-9514-250b99ebe50b-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:17.123160 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.123154    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbg5c\" (UniqueName: \"kubernetes.io/projected/bad68850-d890-48e4-9514-250b99ebe50b-kube-api-access-vbg5c\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:17.123160 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.123163    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw6fh\" (UniqueName: \"kubernetes.io/projected/82ea817a-f603-471e-bf2f-51343faf8654-kube-api-access-pw6fh\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:17.123388 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.123174    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82ea817a-f603-471e-bf2f-51343faf8654-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:17.176929 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.176830    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"]
Sep 18 21:25:17.182314 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.182289    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-773e07-wqwvd"]
Sep 18 21:25:17.444122 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.444032    2576 generic.go:356] "Generic (PLEG): container finished" podID="bad68850-d890-48e4-9514-250b99ebe50b" containerID="204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0" exitCode=0
Sep 18 21:25:17.444122 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.444081    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"
Sep 18 21:25:17.444327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.444120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc" event={"ID":"bad68850-d890-48e4-9514-250b99ebe50b","Type":"ContainerDied","Data":"204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0"}
Sep 18 21:25:17.444327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.444180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc" event={"ID":"bad68850-d890-48e4-9514-250b99ebe50b","Type":"ContainerDied","Data":"271bc4961430947c6efbbd60f00c3fb7ec25314e91353328ded04e3c6dbda8fe"}
Sep 18 21:25:17.444327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.444213    2576 scope.go:117] "RemoveContainer" containerID="204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0"
Sep 18 21:25:17.445515 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.445489    2576 generic.go:356] "Generic (PLEG): container finished" podID="82ea817a-f603-471e-bf2f-51343faf8654" containerID="0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c" exitCode=0
Sep 18 21:25:17.445592 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.445537    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"
Sep 18 21:25:17.445592 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.445562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4" event={"ID":"82ea817a-f603-471e-bf2f-51343faf8654","Type":"ContainerDied","Data":"0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c"}
Sep 18 21:25:17.445668 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.445600    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4" event={"ID":"82ea817a-f603-471e-bf2f-51343faf8654","Type":"ContainerDied","Data":"4103339a3a1a82b296cc287c95409c098faaddb84b35171b326be109b14afafe"}
Sep 18 21:25:17.453114 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.453096    2576 scope.go:117] "RemoveContainer" containerID="204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0"
Sep 18 21:25:17.453383 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:25:17.453366    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0\": container with ID starting with 204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0 not found: ID does not exist" containerID="204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0"
Sep 18 21:25:17.453469 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.453394    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0"} err="failed to get container status \"204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0\": rpc error: code = NotFound desc = could not find container \"204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0\": container with ID starting with 204b7b1f0760e897a14b31eb6a17888325040564bfa4a9f1674b684c0b9c38a0 not found: ID does not exist"
Sep 18 21:25:17.453469 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.453419    2576 scope.go:117] "RemoveContainer" containerID="0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c"
Sep 18 21:25:17.461468 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.461452    2576 scope.go:117] "RemoveContainer" containerID="0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c"
Sep 18 21:25:17.461694 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:25:17.461679    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c\": container with ID starting with 0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c not found: ID does not exist" containerID="0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c"
Sep 18 21:25:17.461742 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.461699    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c"} err="failed to get container status \"0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c\": rpc error: code = NotFound desc = could not find container \"0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c\": container with ID starting with 0b1903ee49047268f22452619064344ddbe11a33a0b59a7940df4cad5e9bb10c not found: ID does not exist"
Sep 18 21:25:17.476955 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.476934    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"]
Sep 18 21:25:17.491518 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.491486    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4"]
Sep 18 21:25:17.516467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.516441    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"]
Sep 18 21:25:17.528286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.528263    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc"]
Sep 18 21:25:17.690190 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:17.690151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:25:18.740669 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:18.740638    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1e9067-1baa-4526-a506-51bbd9fe82fc" path="/var/lib/kubelet/pods/6d1e9067-1baa-4526-a506-51bbd9fe82fc/volumes"
Sep 18 21:25:18.741069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:18.740998    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ea817a-f603-471e-bf2f-51343faf8654" path="/var/lib/kubelet/pods/82ea817a-f603-471e-bf2f-51343faf8654/volumes"
Sep 18 21:25:18.741326 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:18.741314    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad68850-d890-48e4-9514-250b99ebe50b" path="/var/lib/kubelet/pods/bad68850-d890-48e4-9514-250b99ebe50b/volumes"
Sep 18 21:25:21.764533 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:21.764493    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"]
Sep 18 21:25:21.764969 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:21.764744    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2" podUID="da6cd75e-1070-4bc3-bb53-c15a98b109ed" containerName="payload-processing" containerID="cri-o://31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae" gracePeriod=30
Sep 18 21:25:21.795005 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:21.794974    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"]
Sep 18 21:25:21.795207 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:21.795184    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh" podUID="f20e00ec-8df1-4119-873a-f7e458d58ce6" containerName="payload-pre-processing" containerID="cri-o://0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48" gracePeriod=30
Sep 18 21:25:22.041018 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.040990    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:25:22.072964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.072937    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:25:22.089658 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.089629    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"]
Sep 18 21:25:22.096767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.096738    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a2b92ced-7rlzx"]
Sep 18 21:25:22.170729 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.170690    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n6t5\" (UniqueName: \"kubernetes.io/projected/da6cd75e-1070-4bc3-bb53-c15a98b109ed-kube-api-access-8n6t5\") pod \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") "
Sep 18 21:25:22.170940 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.170749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f20e00ec-8df1-4119-873a-f7e458d58ce6-plugins-config-volume\") pod \"f20e00ec-8df1-4119-873a-f7e458d58ce6\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") "
Sep 18 21:25:22.170940 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.170796    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/f20e00ec-8df1-4119-873a-f7e458d58ce6-kube-api-access-58qsh\") pod \"f20e00ec-8df1-4119-873a-f7e458d58ce6\" (UID: \"f20e00ec-8df1-4119-873a-f7e458d58ce6\") "
Sep 18 21:25:22.170940 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.170832    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6cd75e-1070-4bc3-bb53-c15a98b109ed-plugins-config-volume\") pod \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\" (UID: \"da6cd75e-1070-4bc3-bb53-c15a98b109ed\") "
Sep 18 21:25:22.171368 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.171337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f20e00ec-8df1-4119-873a-f7e458d58ce6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f20e00ec-8df1-4119-873a-f7e458d58ce6" (UID: "f20e00ec-8df1-4119-873a-f7e458d58ce6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:25:22.171484 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.171430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6cd75e-1070-4bc3-bb53-c15a98b109ed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da6cd75e-1070-4bc3-bb53-c15a98b109ed" (UID: "da6cd75e-1070-4bc3-bb53-c15a98b109ed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:25:22.172987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.172962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f20e00ec-8df1-4119-873a-f7e458d58ce6-kube-api-access-58qsh" (OuterVolumeSpecName: "kube-api-access-58qsh") pod "f20e00ec-8df1-4119-873a-f7e458d58ce6" (UID: "f20e00ec-8df1-4119-873a-f7e458d58ce6"). InnerVolumeSpecName "kube-api-access-58qsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:25:22.173097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.172991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6cd75e-1070-4bc3-bb53-c15a98b109ed-kube-api-access-8n6t5" (OuterVolumeSpecName: "kube-api-access-8n6t5") pod "da6cd75e-1070-4bc3-bb53-c15a98b109ed" (UID: "da6cd75e-1070-4bc3-bb53-c15a98b109ed"). InnerVolumeSpecName "kube-api-access-8n6t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:25:22.272338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.272250    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n6t5\" (UniqueName: \"kubernetes.io/projected/da6cd75e-1070-4bc3-bb53-c15a98b109ed-kube-api-access-8n6t5\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:22.272338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.272281    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f20e00ec-8df1-4119-873a-f7e458d58ce6-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:22.272338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.272292    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/f20e00ec-8df1-4119-873a-f7e458d58ce6-kube-api-access-58qsh\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:22.272338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.272300    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6cd75e-1070-4bc3-bb53-c15a98b109ed-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:25:22.472653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.472621    2576 generic.go:356] "Generic (PLEG): container finished" podID="f20e00ec-8df1-4119-873a-f7e458d58ce6" containerID="0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48" exitCode=0
Sep 18 21:25:22.472839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.472665    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"
Sep 18 21:25:22.472839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.472702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh" event={"ID":"f20e00ec-8df1-4119-873a-f7e458d58ce6","Type":"ContainerDied","Data":"0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48"}
Sep 18 21:25:22.472839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.472764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh" event={"ID":"f20e00ec-8df1-4119-873a-f7e458d58ce6","Type":"ContainerDied","Data":"724938b5363658d525c483d89cb7889d2f1a8e19a157cfe904970765ee799a68"}
Sep 18 21:25:22.472839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.472802    2576 scope.go:117] "RemoveContainer" containerID="0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48"
Sep 18 21:25:22.474319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.474292    2576 generic.go:356] "Generic (PLEG): container finished" podID="da6cd75e-1070-4bc3-bb53-c15a98b109ed" containerID="31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae" exitCode=0
Sep 18 21:25:22.474430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.474333    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"
Sep 18 21:25:22.474430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.474379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2" event={"ID":"da6cd75e-1070-4bc3-bb53-c15a98b109ed","Type":"ContainerDied","Data":"31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae"}
Sep 18 21:25:22.474529 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.474429    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2" event={"ID":"da6cd75e-1070-4bc3-bb53-c15a98b109ed","Type":"ContainerDied","Data":"06716afb6ee5587ed3a29cb2a6108fd7dec8558319a7a8b70f28fc13e6235a05"}
Sep 18 21:25:22.483508 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.483058    2576 scope.go:117] "RemoveContainer" containerID="0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48"
Sep 18 21:25:22.483703 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:25:22.483581    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48\": container with ID starting with 0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48 not found: ID does not exist" containerID="0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48"
Sep 18 21:25:22.483703 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.483610    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48"} err="failed to get container status \"0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48\": rpc error: code = NotFound desc = could not find container \"0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48\": container with ID starting with 0ec8278ada4e70a05033ce0fceecb7e8e880a8670fec1a0a7bb59509f0a9df48 not found: ID does not exist"
Sep 18 21:25:22.483703 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.483628    2576 scope.go:117] "RemoveContainer" containerID="31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae"
Sep 18 21:25:22.492106 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.492084    2576 scope.go:117] "RemoveContainer" containerID="31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae"
Sep 18 21:25:22.492433 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:25:22.492411    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae\": container with ID starting with 31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae not found: ID does not exist" containerID="31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae"
Sep 18 21:25:22.492478 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.492442    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae"} err="failed to get container status \"31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae\": rpc error: code = NotFound desc = could not find container \"31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae\": container with ID starting with 31719b430f4b08536001ee8decbfc115e98101000a24934d2ddb63921256eaae not found: ID does not exist"
Sep 18 21:25:22.504800 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.504768    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"]
Sep 18 21:25:22.510186 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.510157    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh"]
Sep 18 21:25:22.522679 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.522602    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"]
Sep 18 21:25:22.529305 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.529278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2"]
Sep 18 21:25:22.740725 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.740689    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7e6ee6-691d-42e4-9831-e735a75fa5cf" path="/var/lib/kubelet/pods/4c7e6ee6-691d-42e4-9831-e735a75fa5cf/volumes"
Sep 18 21:25:22.741063 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.741049    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6cd75e-1070-4bc3-bb53-c15a98b109ed" path="/var/lib/kubelet/pods/da6cd75e-1070-4bc3-bb53-c15a98b109ed/volumes"
Sep 18 21:25:22.741358 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:22.741347    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f20e00ec-8df1-4119-873a-f7e458d58ce6" path="/var/lib/kubelet/pods/f20e00ec-8df1-4119-873a-f7e458d58ce6/volumes"
Sep 18 21:25:25.732507 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732434    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"]
Sep 18 21:25:25.732925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732846    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20e00ec-8df1-4119-873a-f7e458d58ce6" containerName="payload-pre-processing"
Sep 18 21:25:25.732925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20e00ec-8df1-4119-873a-f7e458d58ce6" containerName="payload-pre-processing"
Sep 18 21:25:25.732925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732873    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad68850-d890-48e4-9514-250b99ebe50b" containerName="payload-processing"
Sep 18 21:25:25.732925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732879    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad68850-d890-48e4-9514-250b99ebe50b" containerName="payload-processing"
Sep 18 21:25:25.732925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732920    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ea817a-f603-471e-bf2f-51343faf8654" containerName="payload-pre-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732929    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ea817a-f603-471e-bf2f-51343faf8654" containerName="payload-pre-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732940    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7e6ee6-691d-42e4-9831-e735a75fa5cf" containerName="revoke-keys"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732945    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7e6ee6-691d-42e4-9831-e735a75fa5cf" containerName="revoke-keys"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732953    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6cd75e-1070-4bc3-bb53-c15a98b109ed" containerName="payload-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.732958    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6cd75e-1070-4bc3-bb53-c15a98b109ed" containerName="payload-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.733011    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ea817a-f603-471e-bf2f-51343faf8654" containerName="payload-pre-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.733017    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6cd75e-1070-4bc3-bb53-c15a98b109ed" containerName="payload-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.733025    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20e00ec-8df1-4119-873a-f7e458d58ce6" containerName="payload-pre-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.733032    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad68850-d890-48e4-9514-250b99ebe50b" containerName="payload-processing"
Sep 18 21:25:25.733090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.733038    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7e6ee6-691d-42e4-9831-e735a75fa5cf" containerName="revoke-keys"
Sep 18 21:25:25.737385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.737368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.743998 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.743844    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-6ad49b\"/\"kube-root-ca.crt\""
Sep 18 21:25:25.744542 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.744520    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-6ad49b\"/\"default-dockercfg-97mfm\""
Sep 18 21:25:25.744542 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.744539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-6ad49b\"/\"e2e-conflict-a-7ef75f5d-kserve-self-signed-certs\""
Sep 18 21:25:25.744690 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.744548    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-6ad49b\"/\"openshift-service-ca.crt\""
Sep 18 21:25:25.756487 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.756463    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"]
Sep 18 21:25:25.801462 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.801434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-dshm\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.801614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.801467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4wl\" (UniqueName: \"kubernetes.io/projected/8a349706-3bbc-4c66-bc40-f0188b00a99c-kube-api-access-gl4wl\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.801614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.801487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-home\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.801614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.801505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-tmp-dir\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.801614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.801584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a349706-3bbc-4c66-bc40-f0188b00a99c-tls-certs\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.801765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.801632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-model-cache\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.902850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.902802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-dshm\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.902988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4wl\" (UniqueName: \"kubernetes.io/projected/8a349706-3bbc-4c66-bc40-f0188b00a99c-kube-api-access-gl4wl\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-home\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-tmp-dir\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903279 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a349706-3bbc-4c66-bc40-f0188b00a99c-tls-certs\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903279 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-model-cache\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903520 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-home\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903615 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-tmp-dir\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.903665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.903620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-model-cache\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.905983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.905959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-dshm\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.906231 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.906150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a349706-3bbc-4c66-bc40-f0188b00a99c-tls-certs\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:25.915325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:25.915300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4wl\" (UniqueName: \"kubernetes.io/projected/8a349706-3bbc-4c66-bc40-f0188b00a99c-kube-api-access-gl4wl\") pod \"e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:26.046199 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:26.046113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:26.352003 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:26.351967    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"]
Sep 18 21:25:26.358051 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:25:26.358015    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a349706_3bbc_4c66_bc40_f0188b00a99c.slice/crio-9b6c8f6af9cf171259b67ba58fdd44251873a83462bfb69d09e81b7ab7815ecb WatchSource:0}: Error finding container 9b6c8f6af9cf171259b67ba58fdd44251873a83462bfb69d09e81b7ab7815ecb: Status 404 returned error can't find the container with id 9b6c8f6af9cf171259b67ba58fdd44251873a83462bfb69d09e81b7ab7815ecb
Sep 18 21:25:26.500631 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:26.500593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9" event={"ID":"8a349706-3bbc-4c66-bc40-f0188b00a99c","Type":"ContainerStarted","Data":"08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e"}
Sep 18 21:25:26.500816 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:26.500641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9" event={"ID":"8a349706-3bbc-4c66-bc40-f0188b00a99c","Type":"ContainerStarted","Data":"9b6c8f6af9cf171259b67ba58fdd44251873a83462bfb69d09e81b7ab7815ecb"}
Sep 18 21:25:36.046572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:36.046538    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:36.047089 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:36.046595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:36.058899 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:36.058867    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:36.080627 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:36.080575    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9" podStartSLOduration=11.080558 podStartE2EDuration="11.080558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:25:26.586020477 +0000 UTC m=+1160.048799845" watchObservedRunningTime="2026-09-18 21:25:36.080558 +0000 UTC m=+1169.543337358"
Sep 18 21:25:36.560685 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:36.560651    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:25:44.418601 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:44.418560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:25:50.920915 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:50.920869    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"]
Sep 18 21:25:50.924108 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:50.924087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:50.927328 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:50.927307    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-6ad49b\"/\"e2e-conflict-b-7ef75f5d-kserve-self-signed-certs\""
Sep 18 21:25:50.937098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:50.937074    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"]
Sep 18 21:25:51.027926 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.027876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce82311-16a7-4731-850d-bba90d921e3c-tls-certs\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.027926 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.027929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-tmp-dir\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.028195 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.028075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-dshm\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.028195 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.028115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-home\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.028195 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.028145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2zpl\" (UniqueName: \"kubernetes.io/projected/8ce82311-16a7-4731-850d-bba90d921e3c-kube-api-access-c2zpl\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.028324 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.028201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-model-cache\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-dshm\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-home\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129587 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2zpl\" (UniqueName: \"kubernetes.io/projected/8ce82311-16a7-4731-850d-bba90d921e3c-kube-api-access-c2zpl\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129587 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-model-cache\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129587 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce82311-16a7-4731-850d-bba90d921e3c-tls-certs\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129587 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-tmp-dir\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129846 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-home\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129928 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-model-cache\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.129928 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.129874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-tmp-dir\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.131591 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.131571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-dshm\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.131842 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.131826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce82311-16a7-4731-850d-bba90d921e3c-tls-certs\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.138296 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.138270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2zpl\" (UniqueName: \"kubernetes.io/projected/8ce82311-16a7-4731-850d-bba90d921e3c-kube-api-access-c2zpl\") pod \"e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") " pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.234011 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.233928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:25:51.528814 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.528784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"]
Sep 18 21:25:51.530809 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:25:51.530774    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ce82311_16a7_4731_850d_bba90d921e3c.slice/crio-86d8124ce89c9b032b0c6d13589463ddf5b23d1dc8cf07765ba16f67695c3221 WatchSource:0}: Error finding container 86d8124ce89c9b032b0c6d13589463ddf5b23d1dc8cf07765ba16f67695c3221: Status 404 returned error can't find the container with id 86d8124ce89c9b032b0c6d13589463ddf5b23d1dc8cf07765ba16f67695c3221
Sep 18 21:25:51.623903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.623839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh" event={"ID":"8ce82311-16a7-4731-850d-bba90d921e3c","Type":"ContainerStarted","Data":"81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3"}
Sep 18 21:25:51.624091 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.623910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh" event={"ID":"8ce82311-16a7-4731-850d-bba90d921e3c","Type":"ContainerStarted","Data":"86d8124ce89c9b032b0c6d13589463ddf5b23d1dc8cf07765ba16f67695c3221"}
Sep 18 21:25:51.650765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:51.650708    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh" podStartSLOduration=1.6506908519999999 podStartE2EDuration="1.650690852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:25:51.649300099 +0000 UTC m=+1185.112079459" watchObservedRunningTime="2026-09-18 21:25:51.650690852 +0000 UTC m=+1185.113470209"
Sep 18 21:25:52.412234 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.412199    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"]
Sep 18 21:25:52.415699 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.415678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.418313 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.418286    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-1b65ac\""
Sep 18 21:25:52.418436 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.418412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-1b65ac-dockercfg-xvlwv\""
Sep 18 21:25:52.429398 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.429376    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"]
Sep 18 21:25:52.432539 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.432522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.441360 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.441332    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"]
Sep 18 21:25:52.454183 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.454155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"]
Sep 18 21:25:52.542610 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.542575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7l4m\" (UniqueName: \"kubernetes.io/projected/5489e4f9-9686-4895-8073-737ec60adbbf-kube-api-access-v7l4m\") pod \"payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.542824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.542715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787fe9aa-c105-4964-8c4a-e629e78c4208-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.542824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.542759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5489e4f9-9686-4895-8073-737ec60adbbf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.542824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.542822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlvvd\" (UniqueName: \"kubernetes.io/projected/787fe9aa-c105-4964-8c4a-e629e78c4208-kube-api-access-nlvvd\") pod \"payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.643754 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.643719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787fe9aa-c105-4964-8c4a-e629e78c4208-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.643754 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.643761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5489e4f9-9686-4895-8073-737ec60adbbf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.644070 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.643797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlvvd\" (UniqueName: \"kubernetes.io/projected/787fe9aa-c105-4964-8c4a-e629e78c4208-kube-api-access-nlvvd\") pod \"payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.644070 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.643819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7l4m\" (UniqueName: \"kubernetes.io/projected/5489e4f9-9686-4895-8073-737ec60adbbf-kube-api-access-v7l4m\") pod \"payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.644501 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.644475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5489e4f9-9686-4895-8073-737ec60adbbf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.644595 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.644510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787fe9aa-c105-4964-8c4a-e629e78c4208-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.664514 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.664440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7l4m\" (UniqueName: \"kubernetes.io/projected/5489e4f9-9686-4895-8073-737ec60adbbf-kube-api-access-v7l4m\") pod \"payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.665037 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.665014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlvvd\" (UniqueName: \"kubernetes.io/projected/787fe9aa-c105-4964-8c4a-e629e78c4208-kube-api-access-nlvvd\") pod \"payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:52.726468 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.726433    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:52.742182 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:52.742154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:53.003030 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.002953    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"]
Sep 18 21:25:53.006449 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:25:53.006417    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5489e4f9_9686_4895_8073_737ec60adbbf.slice/crio-1bc24dbd375f253f719df222acad64cf4912066c2d60e64d2be5b8b6d3416c2f WatchSource:0}: Error finding container 1bc24dbd375f253f719df222acad64cf4912066c2d60e64d2be5b8b6d3416c2f: Status 404 returned error can't find the container with id 1bc24dbd375f253f719df222acad64cf4912066c2d60e64d2be5b8b6d3416c2f
Sep 18 21:25:53.027391 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.027368    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"]
Sep 18 21:25:53.040001 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:25:53.039976    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787fe9aa_c105_4964_8c4a_e629e78c4208.slice/crio-cb1d00075525566507702570e481e2c184246768c18f52aa3745b500335884ef WatchSource:0}: Error finding container cb1d00075525566507702570e481e2c184246768c18f52aa3745b500335884ef: Status 404 returned error can't find the container with id cb1d00075525566507702570e481e2c184246768c18f52aa3745b500335884ef
Sep 18 21:25:53.637257 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.637216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx" event={"ID":"787fe9aa-c105-4964-8c4a-e629e78c4208","Type":"ContainerStarted","Data":"51cbf329964afb37388d84778e22c6f1647e366a629f751c00dc4831f9e25983"}
Sep 18 21:25:53.637754 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.637288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:25:53.637754 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.637312    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx" event={"ID":"787fe9aa-c105-4964-8c4a-e629e78c4208","Type":"ContainerStarted","Data":"cb1d00075525566507702570e481e2c184246768c18f52aa3745b500335884ef"}
Sep 18 21:25:53.638846 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.638817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p" event={"ID":"5489e4f9-9686-4895-8073-737ec60adbbf","Type":"ContainerStarted","Data":"aef17a57e46979f67ea4eb4a944b759736b5a5d72439978b9cd938468aee31ae"}
Sep 18 21:25:53.639011 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.638867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p" event={"ID":"5489e4f9-9686-4895-8073-737ec60adbbf","Type":"ContainerStarted","Data":"1bc24dbd375f253f719df222acad64cf4912066c2d60e64d2be5b8b6d3416c2f"}
Sep 18 21:25:53.639011 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.638953    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:25:53.664168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.664113    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx" podStartSLOduration=1.664096114 podStartE2EDuration="1.664096114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:25:53.662098712 +0000 UTC m=+1187.124878070" watchObservedRunningTime="2026-09-18 21:25:53.664096114 +0000 UTC m=+1187.126875471"
Sep 18 21:25:53.681733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:25:53.681689    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p" podStartSLOduration=1.681673349 podStartE2EDuration="1.681673349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:25:53.680282629 +0000 UTC m=+1187.143061987" watchObservedRunningTime="2026-09-18 21:25:53.681673349 +0000 UTC m=+1187.144452745"
Sep 18 21:26:01.234550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:01.234515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:26:01.235076 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:01.234597    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:26:01.247144 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:01.247108    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:26:01.693822 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:01.693785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:26:04.645596 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:04.645566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:26:04.646045 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:04.645639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:26:06.445945 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:06.445906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:26:27.320533 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.320487    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"]
Sep 18 21:26:27.324048 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.324025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.328015 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.327986    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-514a1a-dockercfg-gh2ck\""
Sep 18 21:26:27.328302 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.328286    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-514a1a\""
Sep 18 21:26:27.341169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.341128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"]
Sep 18 21:26:27.401057 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.401021    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"]
Sep 18 21:26:27.404508 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.404473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.419834 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.419798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"]
Sep 18 21:26:27.447925 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.447864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff70fb5c-81e0-4627-8007-f7529f0b8db3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.448158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.448077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhp4\" (UniqueName: \"kubernetes.io/projected/ff70fb5c-81e0-4627-8007-f7529f0b8db3-kube-api-access-srhp4\") pod \"payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.548748 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.548710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff70fb5c-81e0-4627-8007-f7529f0b8db3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.548936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.548766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d501008-3326-4c51-91d0-e99aaacd0098-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.548936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.548806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqkn\" (UniqueName: \"kubernetes.io/projected/0d501008-3326-4c51-91d0-e99aaacd0098-kube-api-access-ndqkn\") pod \"payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.548936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.548832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srhp4\" (UniqueName: \"kubernetes.io/projected/ff70fb5c-81e0-4627-8007-f7529f0b8db3-kube-api-access-srhp4\") pod \"payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.549557 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.549534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff70fb5c-81e0-4627-8007-f7529f0b8db3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.558641 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.558611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhp4\" (UniqueName: \"kubernetes.io/projected/ff70fb5c-81e0-4627-8007-f7529f0b8db3-kube-api-access-srhp4\") pod \"payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.635407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.635360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:27.649935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.649899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d501008-3326-4c51-91d0-e99aaacd0098-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.650093 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.649980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqkn\" (UniqueName: \"kubernetes.io/projected/0d501008-3326-4c51-91d0-e99aaacd0098-kube-api-access-ndqkn\") pod \"payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.650602 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.650582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d501008-3326-4c51-91d0-e99aaacd0098-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.674509 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.674476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqkn\" (UniqueName: \"kubernetes.io/projected/0d501008-3326-4c51-91d0-e99aaacd0098-kube-api-access-ndqkn\") pod \"payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.718761 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.718715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:27.924537 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:27.924444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"]
Sep 18 21:26:27.928301 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:26:27.928271    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff70fb5c_81e0_4627_8007_f7529f0b8db3.slice/crio-20b2a744810654315394d17937a4f0e9ccffb70f6e6f89d875708525949d0990 WatchSource:0}: Error finding container 20b2a744810654315394d17937a4f0e9ccffb70f6e6f89d875708525949d0990: Status 404 returned error can't find the container with id 20b2a744810654315394d17937a4f0e9ccffb70f6e6f89d875708525949d0990
Sep 18 21:26:28.001481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.001448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"]
Sep 18 21:26:28.003961 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:26:28.003928    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d501008_3326_4c51_91d0_e99aaacd0098.slice/crio-82366dab4f0f7a521776b4db34686f9bb2ed196f3eed7bad9f0493eead09569b WatchSource:0}: Error finding container 82366dab4f0f7a521776b4db34686f9bb2ed196f3eed7bad9f0493eead09569b: Status 404 returned error can't find the container with id 82366dab4f0f7a521776b4db34686f9bb2ed196f3eed7bad9f0493eead09569b
Sep 18 21:26:28.826839 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.826796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm" event={"ID":"0d501008-3326-4c51-91d0-e99aaacd0098","Type":"ContainerStarted","Data":"222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c"}
Sep 18 21:26:28.827357 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.826869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm" event={"ID":"0d501008-3326-4c51-91d0-e99aaacd0098","Type":"ContainerStarted","Data":"82366dab4f0f7a521776b4db34686f9bb2ed196f3eed7bad9f0493eead09569b"}
Sep 18 21:26:28.827357 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.827000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:28.828654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.828628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n" event={"ID":"ff70fb5c-81e0-4627-8007-f7529f0b8db3","Type":"ContainerStarted","Data":"e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4"}
Sep 18 21:26:28.828811 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.828676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n" event={"ID":"ff70fb5c-81e0-4627-8007-f7529f0b8db3","Type":"ContainerStarted","Data":"20b2a744810654315394d17937a4f0e9ccffb70f6e6f89d875708525949d0990"}
Sep 18 21:26:28.828811 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.828717    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:28.849675 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.849614    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm" podStartSLOduration=1.8495917450000001 podStartE2EDuration="1.849591745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:26:28.848581332 +0000 UTC m=+1222.311360698" watchObservedRunningTime="2026-09-18 21:26:28.849591745 +0000 UTC m=+1222.312371100"
Sep 18 21:26:28.869361 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:28.869294    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n" podStartSLOduration=1.869269626 podStartE2EDuration="1.869269626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:26:28.86730299 +0000 UTC m=+1222.330082349" watchObservedRunningTime="2026-09-18 21:26:28.869269626 +0000 UTC m=+1222.332048978"
Sep 18 21:26:39.836329 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:39.836294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:26:39.836821 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:39.836481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:26:42.602503 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:42.602458    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:26:44.031745 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:44.031699    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"]
Sep 18 21:26:44.527085 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:44.527042    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"]
Sep 18 21:26:48.052286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.052170    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"]
Sep 18 21:26:48.070338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.056589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:48.070338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.060261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:26:48.070338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.060261    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:26:48.077663 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.077630    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"]
Sep 18 21:26:48.148841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.148795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd0d093-85dc-402a-92e6-dac7a8171517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-116f55-kdstq\" (UID: \"7cd0d093-85dc-402a-92e6-dac7a8171517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:48.250310 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.250269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd0d093-85dc-402a-92e6-dac7a8171517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-116f55-kdstq\" (UID: \"7cd0d093-85dc-402a-92e6-dac7a8171517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:48.250968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.250948    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd0d093-85dc-402a-92e6-dac7a8171517-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-116f55-kdstq\" (UID: \"7cd0d093-85dc-402a-92e6-dac7a8171517\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:48.367644 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.367591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:48.667998 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.667934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"]
Sep 18 21:26:48.670720 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:26:48.670672    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd0d093_85dc_402a_92e6_dac7a8171517.slice/crio-aa1637c29a8a5d3231cd89322f987b41e29bb54a3de6125ece29a3708f9a6d1f WatchSource:0}: Error finding container aa1637c29a8a5d3231cd89322f987b41e29bb54a3de6125ece29a3708f9a6d1f: Status 404 returned error can't find the container with id aa1637c29a8a5d3231cd89322f987b41e29bb54a3de6125ece29a3708f9a6d1f
Sep 18 21:26:48.937811 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:48.937781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq" event={"ID":"7cd0d093-85dc-402a-92e6-dac7a8171517","Type":"ContainerStarted","Data":"aa1637c29a8a5d3231cd89322f987b41e29bb54a3de6125ece29a3708f9a6d1f"}
Sep 18 21:26:49.945159 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:49.945118    2576 generic.go:356] "Generic (PLEG): container finished" podID="7cd0d093-85dc-402a-92e6-dac7a8171517" containerID="4f2c44dca538f20b312fb1eca160a788a79ec872f4a5031148df93104cd40036" exitCode=0
Sep 18 21:26:49.945564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:49.945209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq" event={"ID":"7cd0d093-85dc-402a-92e6-dac7a8171517","Type":"ContainerDied","Data":"4f2c44dca538f20b312fb1eca160a788a79ec872f4a5031148df93104cd40036"}
Sep 18 21:26:51.086105 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.086077    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:51.175981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.175946    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd0d093-85dc-402a-92e6-dac7a8171517-maas-api-service-ca\") pod \"7cd0d093-85dc-402a-92e6-dac7a8171517\" (UID: \"7cd0d093-85dc-402a-92e6-dac7a8171517\") "
Sep 18 21:26:51.176390 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.176357    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cd0d093-85dc-402a-92e6-dac7a8171517-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cd0d093-85dc-402a-92e6-dac7a8171517" (UID: "7cd0d093-85dc-402a-92e6-dac7a8171517"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:26:51.202451 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.202360    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"]
Sep 18 21:26:51.278597 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.277617    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd0d093-85dc-402a-92e6-dac7a8171517-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:51.956467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.956433    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"
Sep 18 21:26:51.956467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.956460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq" event={"ID":"7cd0d093-85dc-402a-92e6-dac7a8171517","Type":"ContainerDied","Data":"aa1637c29a8a5d3231cd89322f987b41e29bb54a3de6125ece29a3708f9a6d1f"}
Sep 18 21:26:51.956698 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:51.956510    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa1637c29a8a5d3231cd89322f987b41e29bb54a3de6125ece29a3708f9a6d1f"
Sep 18 21:26:53.092117 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.092078    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7867-0b2b52"]
Sep 18 21:26:53.092517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.092505    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd0d093-85dc-402a-92e6-dac7a8171517" containerName="revoke-keys"
Sep 18 21:26:53.092560 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.092519    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd0d093-85dc-402a-92e6-dac7a8171517" containerName="revoke-keys"
Sep 18 21:26:53.092595 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.092590    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd0d093-85dc-402a-92e6-dac7a8171517" containerName="revoke-keys"
Sep 18 21:26:53.095602 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.095581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:53.098029 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.098003    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zrg6b\""
Sep 18 21:26:53.105880 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.105844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7867-0b2b52"]
Sep 18 21:26:53.192921 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.192838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkktn\" (UniqueName: \"kubernetes.io/projected/0d61f20c-1be2-4de8-be72-e97ebebbeb4a-kube-api-access-hkktn\") pod \"test-curl-7867-0b2b52\" (UID: \"0d61f20c-1be2-4de8-be72-e97ebebbeb4a\") " pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:53.293666 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.293613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkktn\" (UniqueName: \"kubernetes.io/projected/0d61f20c-1be2-4de8-be72-e97ebebbeb4a-kube-api-access-hkktn\") pod \"test-curl-7867-0b2b52\" (UID: \"0d61f20c-1be2-4de8-be72-e97ebebbeb4a\") " pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:53.308551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.308515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkktn\" (UniqueName: \"kubernetes.io/projected/0d61f20c-1be2-4de8-be72-e97ebebbeb4a-kube-api-access-hkktn\") pod \"test-curl-7867-0b2b52\" (UID: \"0d61f20c-1be2-4de8-be72-e97ebebbeb4a\") " pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:53.406097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.405978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:53.706090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.706059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7867-0b2b52"]
Sep 18 21:26:53.708359 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:26:53.708317    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d61f20c_1be2_4de8_be72_e97ebebbeb4a.slice/crio-07d88efdfcb6d8e73b604849012f9995f5db19b88ba2d7ea6a18daaf34775d08 WatchSource:0}: Error finding container 07d88efdfcb6d8e73b604849012f9995f5db19b88ba2d7ea6a18daaf34775d08: Status 404 returned error can't find the container with id 07d88efdfcb6d8e73b604849012f9995f5db19b88ba2d7ea6a18daaf34775d08
Sep 18 21:26:53.969135 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.969046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7867-0b2b52" event={"ID":"0d61f20c-1be2-4de8-be72-e97ebebbeb4a","Type":"ContainerStarted","Data":"d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea"}
Sep 18 21:26:53.969135 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.969090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7867-0b2b52" event={"ID":"0d61f20c-1be2-4de8-be72-e97ebebbeb4a","Type":"ContainerStarted","Data":"07d88efdfcb6d8e73b604849012f9995f5db19b88ba2d7ea6a18daaf34775d08"}
Sep 18 21:26:53.995975 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:53.995913    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7867-0b2b52" podStartSLOduration=0.995880609 podStartE2EDuration="995.880609ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:26:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:26:53.995628064 +0000 UTC m=+1247.458407423" watchObservedRunningTime="2026-09-18 21:26:53.995880609 +0000 UTC m=+1247.458659964"
Sep 18 21:26:54.699169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:54.699069    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7867-0b2b52"]
Sep 18 21:26:54.704443 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:54.704407    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7867-0b2b52"]
Sep 18 21:26:54.974840 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:26:54.974755    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7867-0b2b52" container="test-curl-7867-0b2b52"
Sep 18 21:26:55.979819 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:55.979761    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7867-0b2b52" podUID="0d61f20c-1be2-4de8-be72-e97ebebbeb4a" containerName="test-curl-7867-0b2b52" containerID="cri-o://d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea" gracePeriod=2
Sep 18 21:26:58.178755 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.178727    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:58.242685 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.242595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkktn\" (UniqueName: \"kubernetes.io/projected/0d61f20c-1be2-4de8-be72-e97ebebbeb4a-kube-api-access-hkktn\") pod \"0d61f20c-1be2-4de8-be72-e97ebebbeb4a\" (UID: \"0d61f20c-1be2-4de8-be72-e97ebebbeb4a\") "
Sep 18 21:26:58.244765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.244730    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d61f20c-1be2-4de8-be72-e97ebebbeb4a-kube-api-access-hkktn" (OuterVolumeSpecName: "kube-api-access-hkktn") pod "0d61f20c-1be2-4de8-be72-e97ebebbeb4a" (UID: "0d61f20c-1be2-4de8-be72-e97ebebbeb4a"). InnerVolumeSpecName "kube-api-access-hkktn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:26:58.344093 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.344048    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkktn\" (UniqueName: \"kubernetes.io/projected/0d61f20c-1be2-4de8-be72-e97ebebbeb4a-kube-api-access-hkktn\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:58.747146 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.747102    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d61f20c-1be2-4de8-be72-e97ebebbeb4a" path="/var/lib/kubelet/pods/0d61f20c-1be2-4de8-be72-e97ebebbeb4a/volumes"
Sep 18 21:26:58.996767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.996723    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d61f20c-1be2-4de8-be72-e97ebebbeb4a" containerID="d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea" exitCode=137
Sep 18 21:26:58.996767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.996767    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-0b2b52"
Sep 18 21:26:58.997062 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:58.996828    2576 scope.go:117] "RemoveContainer" containerID="d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea"
Sep 18 21:26:59.008444 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.008420    2576 scope.go:117] "RemoveContainer" containerID="d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea"
Sep 18 21:26:59.008921 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:26:59.008869    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea\": container with ID starting with d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea not found: ID does not exist" containerID="d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea"
Sep 18 21:26:59.009019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.008919    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea"} err="failed to get container status \"d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea\": rpc error: code = NotFound desc = could not find container \"d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea\": container with ID starting with d618f7592d86c4cc50a6fdebff9a8cb0f601f7592cb1341509b4ae667b7b39ea not found: ID does not exist"
Sep 18 21:26:59.051911 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.051844    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p" podUID="3f483766-0818-4303-a4f4-3cd0b90fa7d9" containerName="main" containerID="cri-o://41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3" gracePeriod=45
Sep 18 21:26:59.114920 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.114860    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"]
Sep 18 21:26:59.115175 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.115143    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr" podUID="a46b350a-e646-4411-ba8b-1ca6f1bab8b2" containerName="payload-processing" containerID="cri-o://0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9" gracePeriod=30
Sep 18 21:26:59.128158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.128126    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"]
Sep 18 21:26:59.128389 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.128363    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw" podUID="7bae7052-019d-450d-9085-bf854a58fa3f" containerName="payload-pre-processing" containerID="cri-o://3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8" gracePeriod=30
Sep 18 21:26:59.390689 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.390614    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"]
Sep 18 21:26:59.392553 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.392505    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-116f55-kdstq"]
Sep 18 21:26:59.442287 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.442257    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:26:59.446181 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.446157    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:26:59.452823 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.452786    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:26:59.547098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.547011    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh" podUID="8ce82311-16a7-4731-850d-bba90d921e3c" containerName="main" containerID="cri-o://81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3" gracePeriod=45
Sep 18 21:26:59.552666 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.552637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-plugins-config-volume\") pod \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") "
Sep 18 21:26:59.552799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.552695    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tmp-dir\") pod \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") "
Sep 18 21:26:59.552799 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.552726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tls-certs\") pod \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") "
Sep 18 21:26:59.552942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.552879    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f8x5\" (UniqueName: \"kubernetes.io/projected/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-kube-api-access-6f8x5\") pod \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\" (UID: \"a46b350a-e646-4411-ba8b-1ca6f1bab8b2\") "
Sep 18 21:26:59.553003 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.552946    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wchzj\" (UniqueName: \"kubernetes.io/projected/7bae7052-019d-450d-9085-bf854a58fa3f-kube-api-access-wchzj\") pod \"7bae7052-019d-450d-9085-bf854a58fa3f\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") "
Sep 18 21:26:59.553059 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553021    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-dshm\") pod \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") "
Sep 18 21:26:59.553059 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553053    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwqnh\" (UniqueName: \"kubernetes.io/projected/3f483766-0818-4303-a4f4-3cd0b90fa7d9-kube-api-access-xwqnh\") pod \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") "
Sep 18 21:26:59.553154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553016    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f483766-0818-4303-a4f4-3cd0b90fa7d9" (UID: "3f483766-0818-4303-a4f4-3cd0b90fa7d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.553154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bae7052-019d-450d-9085-bf854a58fa3f-plugins-config-volume\") pod \"7bae7052-019d-450d-9085-bf854a58fa3f\" (UID: \"7bae7052-019d-450d-9085-bf854a58fa3f\") "
Sep 18 21:26:59.553260 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553231    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-model-cache\") pod \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") "
Sep 18 21:26:59.553316 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553290    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-home\") pod \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\" (UID: \"3f483766-0818-4303-a4f4-3cd0b90fa7d9\") "
Sep 18 21:26:59.553372 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553299    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a46b350a-e646-4411-ba8b-1ca6f1bab8b2" (UID: "a46b350a-e646-4411-ba8b-1ca6f1bab8b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:26:59.554548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553444    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bae7052-019d-450d-9085-bf854a58fa3f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7bae7052-019d-450d-9085-bf854a58fa3f" (UID: "7bae7052-019d-450d-9085-bf854a58fa3f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:26:59.554548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553599    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.554548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553618    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tmp-dir\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.554548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553631    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bae7052-019d-450d-9085-bf854a58fa3f-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.554548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553788    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f483766-0818-4303-a4f4-3cd0b90fa7d9" (UID: "3f483766-0818-4303-a4f4-3cd0b90fa7d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.554548 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.553863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-home" (OuterVolumeSpecName: "home") pod "3f483766-0818-4303-a4f4-3cd0b90fa7d9" (UID: "3f483766-0818-4303-a4f4-3cd0b90fa7d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.555517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.555491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-kube-api-access-6f8x5" (OuterVolumeSpecName: "kube-api-access-6f8x5") pod "a46b350a-e646-4411-ba8b-1ca6f1bab8b2" (UID: "a46b350a-e646-4411-ba8b-1ca6f1bab8b2"). InnerVolumeSpecName "kube-api-access-6f8x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:26:59.555517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.555508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f483766-0818-4303-a4f4-3cd0b90fa7d9" (UID: "3f483766-0818-4303-a4f4-3cd0b90fa7d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:26:59.555684 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.555656    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bae7052-019d-450d-9085-bf854a58fa3f-kube-api-access-wchzj" (OuterVolumeSpecName: "kube-api-access-wchzj") pod "7bae7052-019d-450d-9085-bf854a58fa3f" (UID: "7bae7052-019d-450d-9085-bf854a58fa3f"). InnerVolumeSpecName "kube-api-access-wchzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:26:59.555860 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.555841    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f483766-0818-4303-a4f4-3cd0b90fa7d9-kube-api-access-xwqnh" (OuterVolumeSpecName: "kube-api-access-xwqnh") pod "3f483766-0818-4303-a4f4-3cd0b90fa7d9" (UID: "3f483766-0818-4303-a4f4-3cd0b90fa7d9"). InnerVolumeSpecName "kube-api-access-xwqnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:26:59.556521 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.556500    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-dshm" (OuterVolumeSpecName: "dshm") pod "3f483766-0818-4303-a4f4-3cd0b90fa7d9" (UID: "3f483766-0818-4303-a4f4-3cd0b90fa7d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.654394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654361    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f483766-0818-4303-a4f4-3cd0b90fa7d9-tls-certs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.654394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654392    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f8x5\" (UniqueName: \"kubernetes.io/projected/a46b350a-e646-4411-ba8b-1ca6f1bab8b2-kube-api-access-6f8x5\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.654394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654402    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wchzj\" (UniqueName: \"kubernetes.io/projected/7bae7052-019d-450d-9085-bf854a58fa3f-kube-api-access-wchzj\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.654624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654411    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-dshm\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.654624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654421    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwqnh\" (UniqueName: \"kubernetes.io/projected/3f483766-0818-4303-a4f4-3cd0b90fa7d9-kube-api-access-xwqnh\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.654624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654429    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-model-cache\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.654624 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.654437    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f483766-0818-4303-a4f4-3cd0b90fa7d9-home\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.794824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.794788    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:26:59.856659 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.856617    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2zpl\" (UniqueName: \"kubernetes.io/projected/8ce82311-16a7-4731-850d-bba90d921e3c-kube-api-access-c2zpl\") pod \"8ce82311-16a7-4731-850d-bba90d921e3c\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") "
Sep 18 21:26:59.856878 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.856671    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce82311-16a7-4731-850d-bba90d921e3c-tls-certs\") pod \"8ce82311-16a7-4731-850d-bba90d921e3c\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") "
Sep 18 21:26:59.856878 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.856699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-tmp-dir\") pod \"8ce82311-16a7-4731-850d-bba90d921e3c\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") "
Sep 18 21:26:59.856878 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.856722    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-dshm\") pod \"8ce82311-16a7-4731-850d-bba90d921e3c\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") "
Sep 18 21:26:59.856878 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.856764    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-home\") pod \"8ce82311-16a7-4731-850d-bba90d921e3c\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") "
Sep 18 21:26:59.857145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.856994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-model-cache\") pod \"8ce82311-16a7-4731-850d-bba90d921e3c\" (UID: \"8ce82311-16a7-4731-850d-bba90d921e3c\") "
Sep 18 21:26:59.857145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.857013    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ce82311-16a7-4731-850d-bba90d921e3c" (UID: "8ce82311-16a7-4731-850d-bba90d921e3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.857145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.857061    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-home" (OuterVolumeSpecName: "home") pod "8ce82311-16a7-4731-850d-bba90d921e3c" (UID: "8ce82311-16a7-4731-850d-bba90d921e3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.857321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.857287    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ce82311-16a7-4731-850d-bba90d921e3c" (UID: "8ce82311-16a7-4731-850d-bba90d921e3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.857416 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.857395    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-model-cache\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.857485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.857435    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-tmp-dir\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.857485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.857456    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-home\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.859203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.859176    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-dshm" (OuterVolumeSpecName: "dshm") pod "8ce82311-16a7-4731-850d-bba90d921e3c" (UID: "8ce82311-16a7-4731-850d-bba90d921e3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:26:59.859332 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.859267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce82311-16a7-4731-850d-bba90d921e3c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ce82311-16a7-4731-850d-bba90d921e3c" (UID: "8ce82311-16a7-4731-850d-bba90d921e3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:26:59.859332 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.859271    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce82311-16a7-4731-850d-bba90d921e3c-kube-api-access-c2zpl" (OuterVolumeSpecName: "kube-api-access-c2zpl") pod "8ce82311-16a7-4731-850d-bba90d921e3c" (UID: "8ce82311-16a7-4731-850d-bba90d921e3c"). InnerVolumeSpecName "kube-api-access-c2zpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:26:59.958531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.958488    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2zpl\" (UniqueName: \"kubernetes.io/projected/8ce82311-16a7-4731-850d-bba90d921e3c-kube-api-access-c2zpl\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.958531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.958522    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce82311-16a7-4731-850d-bba90d921e3c-tls-certs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:26:59.958531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:26:59.958534    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce82311-16a7-4731-850d-bba90d921e3c-dshm\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:00.005141 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.005105    2576 generic.go:356] "Generic (PLEG): container finished" podID="a46b350a-e646-4411-ba8b-1ca6f1bab8b2" containerID="0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9" exitCode=0
Sep 18 21:27:00.005141 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.005145    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"
Sep 18 21:27:00.005397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.005199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr" event={"ID":"a46b350a-e646-4411-ba8b-1ca6f1bab8b2","Type":"ContainerDied","Data":"0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9"}
Sep 18 21:27:00.005397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.005248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr" event={"ID":"a46b350a-e646-4411-ba8b-1ca6f1bab8b2","Type":"ContainerDied","Data":"c3f78ae46c874d65cf4cd7a1d72f8921f0889c775847171341ba52b4bfafe351"}
Sep 18 21:27:00.005397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.005275    2576 scope.go:117] "RemoveContainer" containerID="0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9"
Sep 18 21:27:00.006824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.006641    2576 generic.go:356] "Generic (PLEG): container finished" podID="7bae7052-019d-450d-9085-bf854a58fa3f" containerID="3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8" exitCode=0
Sep 18 21:27:00.006824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.006690    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"
Sep 18 21:27:00.006824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.006735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw" event={"ID":"7bae7052-019d-450d-9085-bf854a58fa3f","Type":"ContainerDied","Data":"3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8"}
Sep 18 21:27:00.006824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.006786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw" event={"ID":"7bae7052-019d-450d-9085-bf854a58fa3f","Type":"ContainerDied","Data":"bd6c534dc328ac02a2c748e864178c07d2aee4696b891accbf6e0d603473f7f5"}
Sep 18 21:27:00.008328 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.008298    2576 generic.go:356] "Generic (PLEG): container finished" podID="3f483766-0818-4303-a4f4-3cd0b90fa7d9" containerID="41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3" exitCode=0
Sep 18 21:27:00.008452 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.008340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p" event={"ID":"3f483766-0818-4303-a4f4-3cd0b90fa7d9","Type":"ContainerDied","Data":"41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3"}
Sep 18 21:27:00.008452 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.008383    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p" event={"ID":"3f483766-0818-4303-a4f4-3cd0b90fa7d9","Type":"ContainerDied","Data":"c4eec784524305d1038c286cf7fa7b33e30ad4ee9532d63329bbaae8b43a58f5"}
Sep 18 21:27:00.008452 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.008346    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"
Sep 18 21:27:00.011159 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.011133    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ce82311-16a7-4731-850d-bba90d921e3c" containerID="81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3" exitCode=0
Sep 18 21:27:00.011333 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.011293    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"
Sep 18 21:27:00.011513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.011330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh" event={"ID":"8ce82311-16a7-4731-850d-bba90d921e3c","Type":"ContainerDied","Data":"81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3"}
Sep 18 21:27:00.011513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.011488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh" event={"ID":"8ce82311-16a7-4731-850d-bba90d921e3c","Type":"ContainerDied","Data":"86d8124ce89c9b032b0c6d13589463ddf5b23d1dc8cf07765ba16f67695c3221"}
Sep 18 21:27:00.020497 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.019866    2576 scope.go:117] "RemoveContainer" containerID="0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9"
Sep 18 21:27:00.020737 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:00.020706    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9\": container with ID starting with 0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9 not found: ID does not exist" containerID="0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9"
Sep 18 21:27:00.020857 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.020749    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9"} err="failed to get container status \"0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9\": rpc error: code = NotFound desc = could not find container \"0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9\": container with ID starting with 0c1fdcb5332e942354ee2bd85c18c072b593ef67c9f7990dcf563d616f4a27a9 not found: ID does not exist"
Sep 18 21:27:00.020857 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.020784    2576 scope.go:117] "RemoveContainer" containerID="3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8"
Sep 18 21:27:00.032068 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.032045    2576 scope.go:117] "RemoveContainer" containerID="3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8"
Sep 18 21:27:00.032465 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:00.032443    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8\": container with ID starting with 3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8 not found: ID does not exist" containerID="3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8"
Sep 18 21:27:00.032566 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.032472    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8"} err="failed to get container status \"3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8\": rpc error: code = NotFound desc = could not find container \"3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8\": container with ID starting with 3fea3d5dc73f29adb0a4da4427e9973b72245ae51564401d4cb3aa67f0051bd8 not found: ID does not exist"
Sep 18 21:27:00.032566 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.032492    2576 scope.go:117] "RemoveContainer" containerID="41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3"
Sep 18 21:27:00.043692 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.043659    2576 scope.go:117] "RemoveContainer" containerID="41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3"
Sep 18 21:27:00.044643 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:00.044614    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3\": container with ID starting with 41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3 not found: ID does not exist" containerID="41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3"
Sep 18 21:27:00.044764 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.044648    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3"} err="failed to get container status \"41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3\": rpc error: code = NotFound desc = could not find container \"41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3\": container with ID starting with 41a862ffef7a85cdd2393f06c9e172f40ffc145f4de608e76cf275e86a5431e3 not found: ID does not exist"
Sep 18 21:27:00.044764 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.044667    2576 scope.go:117] "RemoveContainer" containerID="81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3"
Sep 18 21:27:00.048270 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.048245    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"]
Sep 18 21:27:00.054084 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.054005    2576 scope.go:117] "RemoveContainer" containerID="81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3"
Sep 18 21:27:00.054485 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:00.054456    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3\": container with ID starting with 81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3 not found: ID does not exist" containerID="81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3"
Sep 18 21:27:00.054616 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.054495    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3"} err="failed to get container status \"81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3\": rpc error: code = NotFound desc = could not find container \"81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3\": container with ID starting with 81ea5cca8af8667348858e4315fffbc67fe93a1b2c1b53db022548f9a8133ad3 not found: ID does not exist"
Sep 18 21:27:00.057355 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.057325    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw"]
Sep 18 21:27:00.074137 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.074106    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"]
Sep 18 21:27:00.077834 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.077805    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr"]
Sep 18 21:27:00.090505 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.090466    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"]
Sep 18 21:27:00.094619 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.094584    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-116f55/test-model-116f55-kserve-7cb7fcd7c7-khv4p"]
Sep 18 21:27:00.109196 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.109107    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"]
Sep 18 21:27:00.113607 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.113572    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-b-7ef75f5d-kserve-646444cc44-bk4zh"]
Sep 18 21:27:00.741747 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.741707    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f483766-0818-4303-a4f4-3cd0b90fa7d9" path="/var/lib/kubelet/pods/3f483766-0818-4303-a4f4-3cd0b90fa7d9/volumes"
Sep 18 21:27:00.742185 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.742136    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bae7052-019d-450d-9085-bf854a58fa3f" path="/var/lib/kubelet/pods/7bae7052-019d-450d-9085-bf854a58fa3f/volumes"
Sep 18 21:27:00.742451 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.742437    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd0d093-85dc-402a-92e6-dac7a8171517" path="/var/lib/kubelet/pods/7cd0d093-85dc-402a-92e6-dac7a8171517/volumes"
Sep 18 21:27:00.742977 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.742951    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce82311-16a7-4731-850d-bba90d921e3c" path="/var/lib/kubelet/pods/8ce82311-16a7-4731-850d-bba90d921e3c/volumes"
Sep 18 21:27:00.743418 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:00.743403    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46b350a-e646-4411-ba8b-1ca6f1bab8b2" path="/var/lib/kubelet/pods/a46b350a-e646-4411-ba8b-1ca6f1bab8b2/volumes"
Sep 18 21:27:03.592053 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592012    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7867-2548e1"]
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592351    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f483766-0818-4303-a4f4-3cd0b90fa7d9" containerName="main"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592362    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f483766-0818-4303-a4f4-3cd0b90fa7d9" containerName="main"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592410    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d61f20c-1be2-4de8-be72-e97ebebbeb4a" containerName="test-curl-7867-0b2b52"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592417    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d61f20c-1be2-4de8-be72-e97ebebbeb4a" containerName="test-curl-7867-0b2b52"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592424    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bae7052-019d-450d-9085-bf854a58fa3f" containerName="payload-pre-processing"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592430    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bae7052-019d-450d-9085-bf854a58fa3f" containerName="payload-pre-processing"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592438    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce82311-16a7-4731-850d-bba90d921e3c" containerName="main"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592443    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce82311-16a7-4731-850d-bba90d921e3c" containerName="main"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592449    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46b350a-e646-4411-ba8b-1ca6f1bab8b2" containerName="payload-processing"
Sep 18 21:27:03.592453 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592454    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46b350a-e646-4411-ba8b-1ca6f1bab8b2" containerName="payload-processing"
Sep 18 21:27:03.592753 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592507    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d61f20c-1be2-4de8-be72-e97ebebbeb4a" containerName="test-curl-7867-0b2b52"
Sep 18 21:27:03.592753 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592515    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce82311-16a7-4731-850d-bba90d921e3c" containerName="main"
Sep 18 21:27:03.592753 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592522    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f483766-0818-4303-a4f4-3cd0b90fa7d9" containerName="main"
Sep 18 21:27:03.592753 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592528    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46b350a-e646-4411-ba8b-1ca6f1bab8b2" containerName="payload-processing"
Sep 18 21:27:03.592753 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.592533    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bae7052-019d-450d-9085-bf854a58fa3f" containerName="payload-pre-processing"
Sep 18 21:27:03.596966 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.596943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:03.599924 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.599878    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zrg6b\""
Sep 18 21:27:03.604649 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.604625    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7867-2548e1"]
Sep 18 21:27:03.691767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.691717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttt4j\" (UniqueName: \"kubernetes.io/projected/67175204-9005-436f-9165-693e23c2d598-kube-api-access-ttt4j\") pod \"test-curl-7867-2548e1\" (UID: \"67175204-9005-436f-9165-693e23c2d598\") " pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:03.793198 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.793133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttt4j\" (UniqueName: \"kubernetes.io/projected/67175204-9005-436f-9165-693e23c2d598-kube-api-access-ttt4j\") pod \"test-curl-7867-2548e1\" (UID: \"67175204-9005-436f-9165-693e23c2d598\") " pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:03.804015 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.803978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttt4j\" (UniqueName: \"kubernetes.io/projected/67175204-9005-436f-9165-693e23c2d598-kube-api-access-ttt4j\") pod \"test-curl-7867-2548e1\" (UID: \"67175204-9005-436f-9165-693e23c2d598\") " pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:03.907953 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:03.907821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:04.182791 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:04.182763    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7867-2548e1"]
Sep 18 21:27:04.185513 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:27:04.185470    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67175204_9005_436f_9165_693e23c2d598.slice/crio-17915d7a1efe2c679f2db3e80b5f058311dc649491ab1cd8bda786842b40cc3f WatchSource:0}: Error finding container 17915d7a1efe2c679f2db3e80b5f058311dc649491ab1cd8bda786842b40cc3f: Status 404 returned error can't find the container with id 17915d7a1efe2c679f2db3e80b5f058311dc649491ab1cd8bda786842b40cc3f
Sep 18 21:27:05.042635 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:05.042601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7867-2548e1" event={"ID":"67175204-9005-436f-9165-693e23c2d598","Type":"ContainerStarted","Data":"414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf"}
Sep 18 21:27:05.043072 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:05.042642    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7867-2548e1" event={"ID":"67175204-9005-436f-9165-693e23c2d598","Type":"ContainerStarted","Data":"17915d7a1efe2c679f2db3e80b5f058311dc649491ab1cd8bda786842b40cc3f"}
Sep 18 21:27:05.063114 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:05.063057    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7867-2548e1" podStartSLOduration=2.063034844 podStartE2EDuration="2.063034844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:05.062715606 +0000 UTC m=+1258.525494965" watchObservedRunningTime="2026-09-18 21:27:05.063034844 +0000 UTC m=+1258.525814203"
Sep 18 21:27:05.684289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:05.684245    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7867-2548e1"]
Sep 18 21:27:05.690707 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:05.690674    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7867-2548e1"]
Sep 18 21:27:06.049176 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:06.049136    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7867-2548e1" container="test-curl-7867-2548e1"
Sep 18 21:27:06.222141 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.222094    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9" podUID="8a349706-3bbc-4c66-bc40-f0188b00a99c" containerName="main" containerID="cri-o://08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e" gracePeriod=45
Sep 18 21:27:06.484154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.484123    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:27:06.617584 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-dshm\") pod \"8a349706-3bbc-4c66-bc40-f0188b00a99c\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") "
Sep 18 21:27:06.617584 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617519    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-tmp-dir\") pod \"8a349706-3bbc-4c66-bc40-f0188b00a99c\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") "
Sep 18 21:27:06.617584 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617539    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-home\") pod \"8a349706-3bbc-4c66-bc40-f0188b00a99c\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") "
Sep 18 21:27:06.617584 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617563    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4wl\" (UniqueName: \"kubernetes.io/projected/8a349706-3bbc-4c66-bc40-f0188b00a99c-kube-api-access-gl4wl\") pod \"8a349706-3bbc-4c66-bc40-f0188b00a99c\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") "
Sep 18 21:27:06.617584 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617589    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a349706-3bbc-4c66-bc40-f0188b00a99c-tls-certs\") pod \"8a349706-3bbc-4c66-bc40-f0188b00a99c\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") "
Sep 18 21:27:06.617996 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617733    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-model-cache\") pod \"8a349706-3bbc-4c66-bc40-f0188b00a99c\" (UID: \"8a349706-3bbc-4c66-bc40-f0188b00a99c\") "
Sep 18 21:27:06.617996 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-home" (OuterVolumeSpecName: "home") pod "8a349706-3bbc-4c66-bc40-f0188b00a99c" (UID: "8a349706-3bbc-4c66-bc40-f0188b00a99c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:27:06.617996 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.617919    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a349706-3bbc-4c66-bc40-f0188b00a99c" (UID: "8a349706-3bbc-4c66-bc40-f0188b00a99c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:27:06.618179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.618053    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-tmp-dir\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:06.618179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.618097    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-home\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:06.618179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.618117    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a349706-3bbc-4c66-bc40-f0188b00a99c" (UID: "8a349706-3bbc-4c66-bc40-f0188b00a99c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:27:06.619942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.619913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-dshm" (OuterVolumeSpecName: "dshm") pod "8a349706-3bbc-4c66-bc40-f0188b00a99c" (UID: "8a349706-3bbc-4c66-bc40-f0188b00a99c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:27:06.620065 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.619939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a349706-3bbc-4c66-bc40-f0188b00a99c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a349706-3bbc-4c66-bc40-f0188b00a99c" (UID: "8a349706-3bbc-4c66-bc40-f0188b00a99c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:27:06.620065 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.620014    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a349706-3bbc-4c66-bc40-f0188b00a99c-kube-api-access-gl4wl" (OuterVolumeSpecName: "kube-api-access-gl4wl") pod "8a349706-3bbc-4c66-bc40-f0188b00a99c" (UID: "8a349706-3bbc-4c66-bc40-f0188b00a99c"). InnerVolumeSpecName "kube-api-access-gl4wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:27:06.719019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.718962    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-model-cache\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:06.719019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.718997    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a349706-3bbc-4c66-bc40-f0188b00a99c-dshm\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:06.719019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.719012    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4wl\" (UniqueName: \"kubernetes.io/projected/8a349706-3bbc-4c66-bc40-f0188b00a99c-kube-api-access-gl4wl\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:06.719019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:06.719027    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a349706-3bbc-4c66-bc40-f0188b00a99c-tls-certs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:07.055574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.055482    2576 generic.go:356] "Generic (PLEG): container finished" podID="8a349706-3bbc-4c66-bc40-f0188b00a99c" containerID="08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e" exitCode=0
Sep 18 21:27:07.055574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.055518    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"
Sep 18 21:27:07.055574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.055563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9" event={"ID":"8a349706-3bbc-4c66-bc40-f0188b00a99c","Type":"ContainerDied","Data":"08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e"}
Sep 18 21:27:07.056132 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.055607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9" event={"ID":"8a349706-3bbc-4c66-bc40-f0188b00a99c","Type":"ContainerDied","Data":"9b6c8f6af9cf171259b67ba58fdd44251873a83462bfb69d09e81b7ab7815ecb"}
Sep 18 21:27:07.056132 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.055627    2576 scope.go:117] "RemoveContainer" containerID="08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e"
Sep 18 21:27:07.056132 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.055812    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7867-2548e1" podUID="67175204-9005-436f-9165-693e23c2d598" containerName="test-curl-7867-2548e1" containerID="cri-o://414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf" gracePeriod=2
Sep 18 21:27:07.064788 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.064764    2576 scope.go:117] "RemoveContainer" containerID="08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e"
Sep 18 21:27:07.065299 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:07.065251    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e\": container with ID starting with 08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e not found: ID does not exist" containerID="08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e"
Sep 18 21:27:07.065385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.065310    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e"} err="failed to get container status \"08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e\": rpc error: code = NotFound desc = could not find container \"08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e\": container with ID starting with 08070c096f6af74da703105ed8485b802be329135cb16650330c0fff5b3ea08e not found: ID does not exist"
Sep 18 21:27:07.089661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.089621    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"]
Sep 18 21:27:07.111212 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.111170    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-6ad49b/e2e-conflict-a-7ef75f5d-kserve-77b79fc966-kglm9"]
Sep 18 21:27:07.426282 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.426248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:27:07.984582 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.984541    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"]
Sep 18 21:27:07.984921 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.984907    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a349706-3bbc-4c66-bc40-f0188b00a99c" containerName="main"
Sep 18 21:27:07.984983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.984922    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a349706-3bbc-4c66-bc40-f0188b00a99c" containerName="main"
Sep 18 21:27:07.984983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.984949    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67175204-9005-436f-9165-693e23c2d598" containerName="test-curl-7867-2548e1"
Sep 18 21:27:07.984983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.984955    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="67175204-9005-436f-9165-693e23c2d598" containerName="test-curl-7867-2548e1"
Sep 18 21:27:07.985077 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.985010    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="67175204-9005-436f-9165-693e23c2d598" containerName="test-curl-7867-2548e1"
Sep 18 21:27:07.985077 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.985020    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a349706-3bbc-4c66-bc40-f0188b00a99c" containerName="main"
Sep 18 21:27:07.989273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.989250    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:07.992836 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.992809    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:27:07.992982 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:07.992812    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:27:08.000769 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.000740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"]
Sep 18 21:27:08.131560 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.131519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b89bd5-65ec-42ce-9e87-a9a502a2cb39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf\" (UID: \"33b89bd5-65ec-42ce-9e87-a9a502a2cb39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:08.232790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.232745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b89bd5-65ec-42ce-9e87-a9a502a2cb39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf\" (UID: \"33b89bd5-65ec-42ce-9e87-a9a502a2cb39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:08.233456 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.233431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b89bd5-65ec-42ce-9e87-a9a502a2cb39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf\" (UID: \"33b89bd5-65ec-42ce-9e87-a9a502a2cb39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:08.300353 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.300267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:08.601521 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.601492    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"]
Sep 18 21:27:08.603791 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:27:08.603758    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b89bd5_65ec_42ce_9e87_a9a502a2cb39.slice/crio-a76077be783da1be5b41f58d7b56ed96ab3f56095e81e01b2c53f8a1c8a15cbe WatchSource:0}: Error finding container a76077be783da1be5b41f58d7b56ed96ab3f56095e81e01b2c53f8a1c8a15cbe: Status 404 returned error can't find the container with id a76077be783da1be5b41f58d7b56ed96ab3f56095e81e01b2c53f8a1c8a15cbe
Sep 18 21:27:08.740816 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.740768    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a349706-3bbc-4c66-bc40-f0188b00a99c" path="/var/lib/kubelet/pods/8a349706-3bbc-4c66-bc40-f0188b00a99c/volumes"
Sep 18 21:27:08.786188 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:08.786155    2576 scope.go:117] "RemoveContainer" containerID="57322c3ab007891f96186ec19df9b405c2ee9539d4f2f3d99dee6a8235d75e29"
Sep 18 21:27:09.070074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.070025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf" event={"ID":"33b89bd5-65ec-42ce-9e87-a9a502a2cb39","Type":"ContainerStarted","Data":"bb5abaa076781d8cd3d28bbd32aade0d1135a18e58052479dff961ff814ac919"}
Sep 18 21:27:09.070248 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.070107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf" event={"ID":"33b89bd5-65ec-42ce-9e87-a9a502a2cb39","Type":"ContainerStarted","Data":"a76077be783da1be5b41f58d7b56ed96ab3f56095e81e01b2c53f8a1c8a15cbe"}
Sep 18 21:27:09.095298 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.095240    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf" podStartSLOduration=2.095221549 podStartE2EDuration="2.095221549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:09.092398883 +0000 UTC m=+1262.555178241" watchObservedRunningTime="2026-09-18 21:27:09.095221549 +0000 UTC m=+1262.558000901"
Sep 18 21:27:09.240881 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.240848    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:09.344034 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.343993    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttt4j\" (UniqueName: \"kubernetes.io/projected/67175204-9005-436f-9165-693e23c2d598-kube-api-access-ttt4j\") pod \"67175204-9005-436f-9165-693e23c2d598\" (UID: \"67175204-9005-436f-9165-693e23c2d598\") "
Sep 18 21:27:09.346238 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.346202    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67175204-9005-436f-9165-693e23c2d598-kube-api-access-ttt4j" (OuterVolumeSpecName: "kube-api-access-ttt4j") pod "67175204-9005-436f-9165-693e23c2d598" (UID: "67175204-9005-436f-9165-693e23c2d598"). InnerVolumeSpecName "kube-api-access-ttt4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:27:09.444764 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:09.444727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttt4j\" (UniqueName: \"kubernetes.io/projected/67175204-9005-436f-9165-693e23c2d598-kube-api-access-ttt4j\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:10.077298 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.077262    2576 generic.go:356] "Generic (PLEG): container finished" podID="67175204-9005-436f-9165-693e23c2d598" containerID="414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf" exitCode=137
Sep 18 21:27:10.077561 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.077323    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:10.077561 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.077369    2576 scope.go:117] "RemoveContainer" containerID="414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf"
Sep 18 21:27:10.079223 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.079199    2576 generic.go:356] "Generic (PLEG): container finished" podID="33b89bd5-65ec-42ce-9e87-a9a502a2cb39" containerID="bb5abaa076781d8cd3d28bbd32aade0d1135a18e58052479dff961ff814ac919" exitCode=0
Sep 18 21:27:10.079323 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.079295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf" event={"ID":"33b89bd5-65ec-42ce-9e87-a9a502a2cb39","Type":"ContainerDied","Data":"bb5abaa076781d8cd3d28bbd32aade0d1135a18e58052479dff961ff814ac919"}
Sep 18 21:27:10.087077 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.087055    2576 scope.go:117] "RemoveContainer" containerID="414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf"
Sep 18 21:27:10.087439 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:10.087420    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf\": container with ID starting with 414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf not found: ID does not exist" containerID="414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf"
Sep 18 21:27:10.087490 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.087452    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf"} err="failed to get container status \"414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf\": rpc error: code = NotFound desc = could not find container \"414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf\": container with ID starting with 414e2271df31ec186a12c1dbc164239e9352ef4cc888c723c7bb47c5a6b8ffaf not found: ID does not exist"
Sep 18 21:27:10.106004 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:10.105960    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7867-2548e1\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="67175204-9005-436f-9165-693e23c2d598" pod="opendatahub/test-curl-7867-2548e1"
Sep 18 21:27:10.741950 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:10.741910    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67175204-9005-436f-9165-693e23c2d598" path="/var/lib/kubelet/pods/67175204-9005-436f-9165-693e23c2d598/volumes"
Sep 18 21:27:11.226211 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:11.226178    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:11.363828 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:11.363733    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b89bd5-65ec-42ce-9e87-a9a502a2cb39-maas-api-service-ca\") pod \"33b89bd5-65ec-42ce-9e87-a9a502a2cb39\" (UID: \"33b89bd5-65ec-42ce-9e87-a9a502a2cb39\") "
Sep 18 21:27:11.364201 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:11.364178    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b89bd5-65ec-42ce-9e87-a9a502a2cb39-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33b89bd5-65ec-42ce-9e87-a9a502a2cb39" (UID: "33b89bd5-65ec-42ce-9e87-a9a502a2cb39"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:27:11.464408 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:11.464365    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b89bd5-65ec-42ce-9e87-a9a502a2cb39-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:12.092455 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:12.092429    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"
Sep 18 21:27:12.092851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:12.092456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf" event={"ID":"33b89bd5-65ec-42ce-9e87-a9a502a2cb39","Type":"ContainerDied","Data":"a76077be783da1be5b41f58d7b56ed96ab3f56095e81e01b2c53f8a1c8a15cbe"}
Sep 18 21:27:12.092851 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:12.092530    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a76077be783da1be5b41f58d7b56ed96ab3f56095e81e01b2c53f8a1c8a15cbe"
Sep 18 21:27:14.468365 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.468329    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"]
Sep 18 21:27:14.468795 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.468685    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b89bd5-65ec-42ce-9e87-a9a502a2cb39" containerName="revoke-keys"
Sep 18 21:27:14.468795 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.468696    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b89bd5-65ec-42ce-9e87-a9a502a2cb39" containerName="revoke-keys"
Sep 18 21:27:14.468795 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.468774    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b89bd5-65ec-42ce-9e87-a9a502a2cb39" containerName="revoke-keys"
Sep 18 21:27:14.471984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.471959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.477528 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.477497    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-67ccba3b\""
Sep 18 21:27:14.477718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.477644    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-67ccba3b-dockercfg-qx5gs\""
Sep 18 21:27:14.493766 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.493731    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"]
Sep 18 21:27:14.547837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.547784    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"]
Sep 18 21:27:14.555047 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.551979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.590995 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.590960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c349f5-726a-4770-814e-3295915ab524-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.591177 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.591094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgzx\" (UniqueName: \"kubernetes.io/projected/a6c349f5-726a-4770-814e-3295915ab524-kube-api-access-djgzx\") pod \"payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.600345 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.600311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"]
Sep 18 21:27:14.692294 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.692247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c349f5-726a-4770-814e-3295915ab524-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.692294 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.692299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-plugins-config-volume\") pod \"payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") " pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.692561 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.692357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djgzx\" (UniqueName: \"kubernetes.io/projected/a6c349f5-726a-4770-814e-3295915ab524-kube-api-access-djgzx\") pod \"payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.692561 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.692373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5svcc\" (UniqueName: \"kubernetes.io/projected/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-kube-api-access-5svcc\") pod \"payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") " pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.693054 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.693031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c349f5-726a-4770-814e-3295915ab524-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.706630 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.706593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgzx\" (UniqueName: \"kubernetes.io/projected/a6c349f5-726a-4770-814e-3295915ab524-kube-api-access-djgzx\") pod \"payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.782952 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.782838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:14.793450 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.793419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5svcc\" (UniqueName: \"kubernetes.io/projected/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-kube-api-access-5svcc\") pod \"payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") " pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.793541 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.793510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-plugins-config-volume\") pod \"payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") " pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.794325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.794300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-plugins-config-volume\") pod \"payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") " pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.812372 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.812336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5svcc\" (UniqueName: \"kubernetes.io/projected/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-kube-api-access-5svcc\") pod \"payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") " pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:14.866240 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:14.866174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:15.070751 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:15.070723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"]
Sep 18 21:27:15.072939 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:27:15.072859    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c349f5_726a_4770_814e_3295915ab524.slice/crio-33e9bc89134a8a1627f26c4bd73f6798f04ea21e8cfe6233062b400ea8213ab2 WatchSource:0}: Error finding container 33e9bc89134a8a1627f26c4bd73f6798f04ea21e8cfe6233062b400ea8213ab2: Status 404 returned error can't find the container with id 33e9bc89134a8a1627f26c4bd73f6798f04ea21e8cfe6233062b400ea8213ab2
Sep 18 21:27:15.109575 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:15.109542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7" event={"ID":"a6c349f5-726a-4770-814e-3295915ab524","Type":"ContainerStarted","Data":"33e9bc89134a8a1627f26c4bd73f6798f04ea21e8cfe6233062b400ea8213ab2"}
Sep 18 21:27:15.163377 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:15.163340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"]
Sep 18 21:27:15.164002 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:27:15.163974    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e08e05_0bf8_4be4_92e5_3bc146ae23a9.slice/crio-999c789a6ee51480c13a68671c58e9fb192633547414fa3fd9b3992932d985e4 WatchSource:0}: Error finding container 999c789a6ee51480c13a68671c58e9fb192633547414fa3fd9b3992932d985e4: Status 404 returned error can't find the container with id 999c789a6ee51480c13a68671c58e9fb192633547414fa3fd9b3992932d985e4
Sep 18 21:27:16.124037 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.123991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz" event={"ID":"27e08e05-0bf8-4be4-92e5-3bc146ae23a9","Type":"ContainerStarted","Data":"db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88"}
Sep 18 21:27:16.124527 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.124097    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:16.124527 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.124124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz" event={"ID":"27e08e05-0bf8-4be4-92e5-3bc146ae23a9","Type":"ContainerStarted","Data":"999c789a6ee51480c13a68671c58e9fb192633547414fa3fd9b3992932d985e4"}
Sep 18 21:27:16.125832 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.125803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7" event={"ID":"a6c349f5-726a-4770-814e-3295915ab524","Type":"ContainerStarted","Data":"44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a"}
Sep 18 21:27:16.126010 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.125869    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:16.208270 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.208205    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz" podStartSLOduration=2.208182829 podStartE2EDuration="2.208182829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:16.161554665 +0000 UTC m=+1269.624334024" watchObservedRunningTime="2026-09-18 21:27:16.208182829 +0000 UTC m=+1269.670962188"
Sep 18 21:27:16.209114 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:16.209072    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7" podStartSLOduration=2.209060314 podStartE2EDuration="2.209060314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:16.20858653 +0000 UTC m=+1269.671365889" watchObservedRunningTime="2026-09-18 21:27:16.209060314 +0000 UTC m=+1269.671839703"
Sep 18 21:27:19.182186 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.182150    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"]
Sep 18 21:27:19.182627 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.182372    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk" podUID="74b3e6ae-89f1-402a-8565-3f6d40fba088" containerName="payload-pre-processing" containerID="cri-o://15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497" gracePeriod=30
Sep 18 21:27:19.432836 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.432755    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:27:19.442898 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.442845    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"]
Sep 18 21:27:19.447107 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.447072    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f86a8-vs7nf"]
Sep 18 21:27:19.539368 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.539328    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74b3e6ae-89f1-402a-8565-3f6d40fba088-plugins-config-volume\") pod \"74b3e6ae-89f1-402a-8565-3f6d40fba088\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") "
Sep 18 21:27:19.539597 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.539403    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9zs4\" (UniqueName: \"kubernetes.io/projected/74b3e6ae-89f1-402a-8565-3f6d40fba088-kube-api-access-q9zs4\") pod \"74b3e6ae-89f1-402a-8565-3f6d40fba088\" (UID: \"74b3e6ae-89f1-402a-8565-3f6d40fba088\") "
Sep 18 21:27:19.539809 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.539771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b3e6ae-89f1-402a-8565-3f6d40fba088-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74b3e6ae-89f1-402a-8565-3f6d40fba088" (UID: "74b3e6ae-89f1-402a-8565-3f6d40fba088"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:27:19.541547 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.541521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b3e6ae-89f1-402a-8565-3f6d40fba088-kube-api-access-q9zs4" (OuterVolumeSpecName: "kube-api-access-q9zs4") pod "74b3e6ae-89f1-402a-8565-3f6d40fba088" (UID: "74b3e6ae-89f1-402a-8565-3f6d40fba088"). InnerVolumeSpecName "kube-api-access-q9zs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:27:19.640319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.640277    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74b3e6ae-89f1-402a-8565-3f6d40fba088-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:19.640319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:19.640308    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9zs4\" (UniqueName: \"kubernetes.io/projected/74b3e6ae-89f1-402a-8565-3f6d40fba088-kube-api-access-q9zs4\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:27:20.148426 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.148394    2576 generic.go:356] "Generic (PLEG): container finished" podID="74b3e6ae-89f1-402a-8565-3f6d40fba088" containerID="15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497" exitCode=0
Sep 18 21:27:20.148655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.148452    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"
Sep 18 21:27:20.148655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.148488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk" event={"ID":"74b3e6ae-89f1-402a-8565-3f6d40fba088","Type":"ContainerDied","Data":"15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497"}
Sep 18 21:27:20.148655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.148552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk" event={"ID":"74b3e6ae-89f1-402a-8565-3f6d40fba088","Type":"ContainerDied","Data":"e7cdd121eb92ac80cad2736ca9aead886f2a1fdfe3bb364ed6b65aeb4fc50d99"}
Sep 18 21:27:20.148655 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.148576    2576 scope.go:117] "RemoveContainer" containerID="15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497"
Sep 18 21:27:20.158051 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.158011    2576 scope.go:117] "RemoveContainer" containerID="15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497"
Sep 18 21:27:20.158443 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:27:20.158423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497\": container with ID starting with 15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497 not found: ID does not exist" containerID="15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497"
Sep 18 21:27:20.158525 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.158455    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497"} err="failed to get container status \"15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497\": rpc error: code = NotFound desc = could not find container \"15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497\": container with ID starting with 15afa0f1fa30ebbcce14dabd8d2f58407e1d4820c3a5b19302e9fcc31419f497 not found: ID does not exist"
Sep 18 21:27:20.172780 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.172740    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"]
Sep 18 21:27:20.176485 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.176449    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk"]
Sep 18 21:27:20.741080 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.741045    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b89bd5-65ec-42ce-9e87-a9a502a2cb39" path="/var/lib/kubelet/pods/33b89bd5-65ec-42ce-9e87-a9a502a2cb39/volumes"
Sep 18 21:27:20.741486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:20.741412    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b3e6ae-89f1-402a-8565-3f6d40fba088" path="/var/lib/kubelet/pods/74b3e6ae-89f1-402a-8565-3f6d40fba088/volumes"
Sep 18 21:27:23.806853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:23.806803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:27:27.132869 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:27.132836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:27:27.133288 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:27.132950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:27:37.772161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.772124    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"]
Sep 18 21:27:37.772633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.772471    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b3e6ae-89f1-402a-8565-3f6d40fba088" containerName="payload-pre-processing"
Sep 18 21:27:37.772633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.772483    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b3e6ae-89f1-402a-8565-3f6d40fba088" containerName="payload-pre-processing"
Sep 18 21:27:37.772633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.772555    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b3e6ae-89f1-402a-8565-3f6d40fba088" containerName="payload-pre-processing"
Sep 18 21:27:37.775659 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.775638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:37.778043 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.778002    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-cad5cf\""
Sep 18 21:27:37.791735 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.791701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"]
Sep 18 21:27:37.804178 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.804140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:37.804388 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.804294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9r8q\" (UniqueName: \"kubernetes.io/projected/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-kube-api-access-s9r8q\") pod \"payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:37.835013 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.834973    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"]
Sep 18 21:27:37.838325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.838303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:37.841252 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.841217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-cad5cf-dockercfg-9rf22\""
Sep 18 21:27:37.852414 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.852378    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"]
Sep 18 21:27:37.905427 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.905382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:37.905647 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.905468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436354e-de97-4f2f-a950-f29c90eb92ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:37.905647 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.905502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9r8q\" (UniqueName: \"kubernetes.io/projected/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-kube-api-access-s9r8q\") pod \"payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:37.905647 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.905536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrjl\" (UniqueName: \"kubernetes.io/projected/5436354e-de97-4f2f-a950-f29c90eb92ac-kube-api-access-fgrjl\") pod \"payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:37.906269 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.906243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:37.917022 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:37.916990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9r8q\" (UniqueName: \"kubernetes.io/projected/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-kube-api-access-s9r8q\") pod \"payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:38.006259 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.006207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436354e-de97-4f2f-a950-f29c90eb92ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:38.006473 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.006271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrjl\" (UniqueName: \"kubernetes.io/projected/5436354e-de97-4f2f-a950-f29c90eb92ac-kube-api-access-fgrjl\") pod \"payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:38.006956 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.006934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436354e-de97-4f2f-a950-f29c90eb92ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:38.016420 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.016394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrjl\" (UniqueName: \"kubernetes.io/projected/5436354e-de97-4f2f-a950-f29c90eb92ac-kube-api-access-fgrjl\") pod \"payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:38.086430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.086381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:38.149109 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.149074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:38.372348 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.372315    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"]
Sep 18 21:27:38.374249 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:27:38.374222    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc534b4_6b31_4867_aba9_a5aeb11e3e0f.slice/crio-4d3e72a210fd4e2fb0d01a71bde5dea9b968c3705954acf29698d525b5224d39 WatchSource:0}: Error finding container 4d3e72a210fd4e2fb0d01a71bde5dea9b968c3705954acf29698d525b5224d39: Status 404 returned error can't find the container with id 4d3e72a210fd4e2fb0d01a71bde5dea9b968c3705954acf29698d525b5224d39
Sep 18 21:27:38.438620 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:38.438585    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"]
Sep 18 21:27:38.441298 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:27:38.441268    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5436354e_de97_4f2f_a950_f29c90eb92ac.slice/crio-dcd2c97e1f764ea0e0b4d0ee48dbd070a511884dcc8a1861b6bdab0addfd9684 WatchSource:0}: Error finding container dcd2c97e1f764ea0e0b4d0ee48dbd070a511884dcc8a1861b6bdab0addfd9684: Status 404 returned error can't find the container with id dcd2c97e1f764ea0e0b4d0ee48dbd070a511884dcc8a1861b6bdab0addfd9684
Sep 18 21:27:39.262653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.262601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj" event={"ID":"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f","Type":"ContainerStarted","Data":"b30585c936dc0cc12b63c853b8fe5610eb575115efb1b59c79156e8ed283f92e"}
Sep 18 21:27:39.263185 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.262712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj" event={"ID":"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f","Type":"ContainerStarted","Data":"4d3e72a210fd4e2fb0d01a71bde5dea9b968c3705954acf29698d525b5224d39"}
Sep 18 21:27:39.263185 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.262746    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:39.264611 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.264586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq" event={"ID":"5436354e-de97-4f2f-a950-f29c90eb92ac","Type":"ContainerStarted","Data":"8e6836938e9ef16a4eb297b154315380639e9b222b428771b06564874039b991"}
Sep 18 21:27:39.264701 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.264632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq" event={"ID":"5436354e-de97-4f2f-a950-f29c90eb92ac","Type":"ContainerStarted","Data":"dcd2c97e1f764ea0e0b4d0ee48dbd070a511884dcc8a1861b6bdab0addfd9684"}
Sep 18 21:27:39.264701 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.264657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:27:39.281779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.281708    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj" podStartSLOduration=2.281693116 podStartE2EDuration="2.281693116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:39.279989214 +0000 UTC m=+1292.742768569" watchObservedRunningTime="2026-09-18 21:27:39.281693116 +0000 UTC m=+1292.744472474"
Sep 18 21:27:39.299833 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:39.299726    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq" podStartSLOduration=2.299709422 podStartE2EDuration="2.299709422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:27:39.299447186 +0000 UTC m=+1292.762226564" watchObservedRunningTime="2026-09-18 21:27:39.299709422 +0000 UTC m=+1292.762488823"
Sep 18 21:27:45.913312 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:45.913262    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:27:50.271564 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:50.271534    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:27:50.271957 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:27:50.271609    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:28:08.835417 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:08.835384    2576 scope.go:117] "RemoveContainer" containerID="376aedd782b05a945856bb75d5e41f7b18c2fa484f6fb2c7cd2b2e16b51b60c4"
Sep 18 21:28:08.844518 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:08.844493    2576 scope.go:117] "RemoveContainer" containerID="9b2eb079531173c45d351df29294eebe07b444464160f415e87f67dc9a6c227d"
Sep 18 21:28:08.858228 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:08.858201    2576 scope.go:117] "RemoveContainer" containerID="e604f9cd8f5aa44e79ae0538668bc406a9ef1361ee078d1366b432bdc68700c3"
Sep 18 21:28:09.469501 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:09.469459    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:28:10.308727 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.308690    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"]
Sep 18 21:28:10.313614 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.313589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.316641 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.316615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-fd993e-dockercfg-2c9dr\""
Sep 18 21:28:10.316784 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.316618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-fd993e\""
Sep 18 21:28:10.323981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.323954    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"]
Sep 18 21:28:10.368322 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.368287    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"]
Sep 18 21:28:10.371666 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.371642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.388325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.388291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"]
Sep 18 21:28:10.506576 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.506534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.506787 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.506601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gtjr\" (UniqueName: \"kubernetes.io/projected/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-kube-api-access-2gtjr\") pod \"payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.506787 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.506634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz2hf\" (UniqueName: \"kubernetes.io/projected/f40f609d-8ae9-438e-adbc-238dd78840fe-kube-api-access-zz2hf\") pod \"payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.506787 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.506659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f40f609d-8ae9-438e-adbc-238dd78840fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.607267 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.607230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gtjr\" (UniqueName: \"kubernetes.io/projected/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-kube-api-access-2gtjr\") pod \"payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.607481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.607275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz2hf\" (UniqueName: \"kubernetes.io/projected/f40f609d-8ae9-438e-adbc-238dd78840fe-kube-api-access-zz2hf\") pod \"payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.607481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.607299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f40f609d-8ae9-438e-adbc-238dd78840fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.607481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.607346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.608129 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.608100    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.608129 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.608118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f40f609d-8ae9-438e-adbc-238dd78840fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.622853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.622817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz2hf\" (UniqueName: \"kubernetes.io/projected/f40f609d-8ae9-438e-adbc-238dd78840fe-kube-api-access-zz2hf\") pod \"payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.623497 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.623477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gtjr\" (UniqueName: \"kubernetes.io/projected/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-kube-api-access-2gtjr\") pod \"payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.625324 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.625303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:10.683430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.683030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:10.911173 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.911145    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"]
Sep 18 21:28:10.913711 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:28:10.913679    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40f609d_8ae9_438e_adbc_238dd78840fe.slice/crio-f7855385af7974e0501a6aecd631cc20d50455b14909b75489ab984ac6821763 WatchSource:0}: Error finding container f7855385af7974e0501a6aecd631cc20d50455b14909b75489ab984ac6821763: Status 404 returned error can't find the container with id f7855385af7974e0501a6aecd631cc20d50455b14909b75489ab984ac6821763
Sep 18 21:28:10.968713 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:10.968676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"]
Sep 18 21:28:10.972291 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:28:10.972253    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc1cf34_fa8b_4928_85c8_38066ce9dbed.slice/crio-a67b56043ca91f2a8f12632b95e3c765d0314771bc3576a78ff9446621809722 WatchSource:0}: Error finding container a67b56043ca91f2a8f12632b95e3c765d0314771bc3576a78ff9446621809722: Status 404 returned error can't find the container with id a67b56043ca91f2a8f12632b95e3c765d0314771bc3576a78ff9446621809722
Sep 18 21:28:11.438405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.438347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh" event={"ID":"9fc1cf34-fa8b-4928-85c8-38066ce9dbed","Type":"ContainerStarted","Data":"01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9"}
Sep 18 21:28:11.438924 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.438467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh" event={"ID":"9fc1cf34-fa8b-4928-85c8-38066ce9dbed","Type":"ContainerStarted","Data":"a67b56043ca91f2a8f12632b95e3c765d0314771bc3576a78ff9446621809722"}
Sep 18 21:28:11.438924 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.438501    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:11.440114 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.440085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds" event={"ID":"f40f609d-8ae9-438e-adbc-238dd78840fe","Type":"ContainerStarted","Data":"2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36"}
Sep 18 21:28:11.440241 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.440134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds" event={"ID":"f40f609d-8ae9-438e-adbc-238dd78840fe","Type":"ContainerStarted","Data":"f7855385af7974e0501a6aecd631cc20d50455b14909b75489ab984ac6821763"}
Sep 18 21:28:11.440241 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.440192    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:11.461712 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.461654    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh" podStartSLOduration=1.461635081 podStartE2EDuration="1.461635081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:28:11.459813883 +0000 UTC m=+1324.922593354" watchObservedRunningTime="2026-09-18 21:28:11.461635081 +0000 UTC m=+1324.924414429"
Sep 18 21:28:11.478879 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:11.478821    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds" podStartSLOduration=1.478797085 podStartE2EDuration="1.478797085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:28:11.477600012 +0000 UTC m=+1324.940379371" watchObservedRunningTime="2026-09-18 21:28:11.478797085 +0000 UTC m=+1324.941576443"
Sep 18 21:28:22.447987 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:22.447950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:28:22.448405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:22.448038    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:28:35.431636 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:35.431545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:28:44.534325 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.534277    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"]
Sep 18 21:28:44.538018 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.537985    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.548062 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.548039    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-cad5cf\"/\"kube-root-ca.crt\""
Sep 18 21:28:44.548206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.548081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-cad5cf\"/\"default-dockercfg-8qzpg\""
Sep 18 21:28:44.548206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.548083    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-cad5cf\"/\"openshift-service-ca.crt\""
Sep 18 21:28:44.555434 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.555406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-cad5cf\"/\"auth-test-model-cad5cf-kserve-self-signed-certs\""
Sep 18 21:28:44.566443 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.566411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"]
Sep 18 21:28:44.606715 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.606674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzpvn\" (UniqueName: \"kubernetes.io/projected/65adf407-0dda-4a3f-9428-c662bfcd369e-kube-api-access-vzpvn\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.606964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.606724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-home\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.606964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.606799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-model-cache\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.606964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.606833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65adf407-0dda-4a3f-9428-c662bfcd369e-tls-certs\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.606964 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.606856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-tmp-dir\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.607139 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.606964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-dshm\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707445 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-dshm\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzpvn\" (UniqueName: \"kubernetes.io/projected/65adf407-0dda-4a3f-9428-c662bfcd369e-kube-api-access-vzpvn\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-home\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-model-cache\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65adf407-0dda-4a3f-9428-c662bfcd369e-tls-certs\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-tmp-dir\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.707966 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-model-cache\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.708083 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.707974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-tmp-dir\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.708083 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.708016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-home\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.709834 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.709808    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-dshm\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.710008 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.709991    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65adf407-0dda-4a3f-9428-c662bfcd369e-tls-certs\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.718483 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.718458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzpvn\" (UniqueName: \"kubernetes.io/projected/65adf407-0dda-4a3f-9428-c662bfcd369e-kube-api-access-vzpvn\") pod \"auth-test-model-cad5cf-kserve-7d99585d99-7p4p8\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") " pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:44.847800 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:44.847761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:45.140765 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:45.140736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"]
Sep 18 21:28:45.141487 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:28:45.141461    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65adf407_0dda_4a3f_9428_c662bfcd369e.slice/crio-2552336a78824b1c5273c74fb33fdfc681c8bb51865580fd66152ca7d724e502 WatchSource:0}: Error finding container 2552336a78824b1c5273c74fb33fdfc681c8bb51865580fd66152ca7d724e502: Status 404 returned error can't find the container with id 2552336a78824b1c5273c74fb33fdfc681c8bb51865580fd66152ca7d724e502
Sep 18 21:28:45.618086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:45.618030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8" event={"ID":"65adf407-0dda-4a3f-9428-c662bfcd369e","Type":"ContainerStarted","Data":"4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9"}
Sep 18 21:28:45.618086 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:45.618089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8" event={"ID":"65adf407-0dda-4a3f-9428-c662bfcd369e","Type":"ContainerStarted","Data":"2552336a78824b1c5273c74fb33fdfc681c8bb51865580fd66152ca7d724e502"}
Sep 18 21:28:45.655180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:45.655114    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8" podStartSLOduration=1.655096178 podStartE2EDuration="1.655096178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:28:45.653478568 +0000 UTC m=+1359.116257926" watchObservedRunningTime="2026-09-18 21:28:45.655096178 +0000 UTC m=+1359.117875536"
Sep 18 21:28:54.848745 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:54.848702    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:54.849257 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:54.848769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:54.862397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:54.862357    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:55.681274 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:55.681240    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:28:59.953427 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:28:59.953387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:29:08.898483 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:08.898447    2576 scope.go:117] "RemoveContainer" containerID="2e64c29e167d8dde7c3723238d31fc7b2ce538350204241291f4d6a36c615429"
Sep 18 21:29:22.711404 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:22.711364    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"]
Sep 18 21:29:22.712039 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:22.711629    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz" podUID="27e08e05-0bf8-4be4-92e5-3bc146ae23a9" containerName="payload-processing" containerID="cri-o://db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88" gracePeriod=30
Sep 18 21:29:22.715204 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:22.715167    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"]
Sep 18 21:29:22.715499 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:22.715439    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7" podUID="a6c349f5-726a-4770-814e-3295915ab524" containerName="payload-pre-processing" containerID="cri-o://44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a" gracePeriod=30
Sep 18 21:29:23.000679 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.000653    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:29:23.012173 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.012145    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:29:23.043298 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.043261    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c349f5-726a-4770-814e-3295915ab524-plugins-config-volume\") pod \"a6c349f5-726a-4770-814e-3295915ab524\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") "
Sep 18 21:29:23.043606 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.043344    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-plugins-config-volume\") pod \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") "
Sep 18 21:29:23.043606 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.043398    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5svcc\" (UniqueName: \"kubernetes.io/projected/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-kube-api-access-5svcc\") pod \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\" (UID: \"27e08e05-0bf8-4be4-92e5-3bc146ae23a9\") "
Sep 18 21:29:23.043606 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.043476    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djgzx\" (UniqueName: \"kubernetes.io/projected/a6c349f5-726a-4770-814e-3295915ab524-kube-api-access-djgzx\") pod \"a6c349f5-726a-4770-814e-3295915ab524\" (UID: \"a6c349f5-726a-4770-814e-3295915ab524\") "
Sep 18 21:29:23.044432 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.044369    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c349f5-726a-4770-814e-3295915ab524-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6c349f5-726a-4770-814e-3295915ab524" (UID: "a6c349f5-726a-4770-814e-3295915ab524"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:29:23.044675 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.044605    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27e08e05-0bf8-4be4-92e5-3bc146ae23a9" (UID: "27e08e05-0bf8-4be4-92e5-3bc146ae23a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:29:23.046445 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.046415    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c349f5-726a-4770-814e-3295915ab524-kube-api-access-djgzx" (OuterVolumeSpecName: "kube-api-access-djgzx") pod "a6c349f5-726a-4770-814e-3295915ab524" (UID: "a6c349f5-726a-4770-814e-3295915ab524"). InnerVolumeSpecName "kube-api-access-djgzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:29:23.046567 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.046418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-kube-api-access-5svcc" (OuterVolumeSpecName: "kube-api-access-5svcc") pod "27e08e05-0bf8-4be4-92e5-3bc146ae23a9" (UID: "27e08e05-0bf8-4be4-92e5-3bc146ae23a9"). InnerVolumeSpecName "kube-api-access-5svcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:29:23.144962 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.144922    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djgzx\" (UniqueName: \"kubernetes.io/projected/a6c349f5-726a-4770-814e-3295915ab524-kube-api-access-djgzx\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:29:23.144962 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.144954    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c349f5-726a-4770-814e-3295915ab524-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:29:23.144962 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.144964    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:29:23.144962 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.144973    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5svcc\" (UniqueName: \"kubernetes.io/projected/27e08e05-0bf8-4be4-92e5-3bc146ae23a9-kube-api-access-5svcc\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:29:23.811306 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.811272    2576 generic.go:356] "Generic (PLEG): container finished" podID="27e08e05-0bf8-4be4-92e5-3bc146ae23a9" containerID="db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88" exitCode=0
Sep 18 21:29:23.811793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.811326    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"
Sep 18 21:29:23.811793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.811360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz" event={"ID":"27e08e05-0bf8-4be4-92e5-3bc146ae23a9","Type":"ContainerDied","Data":"db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88"}
Sep 18 21:29:23.811793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.811415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz" event={"ID":"27e08e05-0bf8-4be4-92e5-3bc146ae23a9","Type":"ContainerDied","Data":"999c789a6ee51480c13a68671c58e9fb192633547414fa3fd9b3992932d985e4"}
Sep 18 21:29:23.811793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.811445    2576 scope.go:117] "RemoveContainer" containerID="db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88"
Sep 18 21:29:23.812997 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.812814    2576 generic.go:356] "Generic (PLEG): container finished" podID="a6c349f5-726a-4770-814e-3295915ab524" containerID="44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a" exitCode=0
Sep 18 21:29:23.812997 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.812856    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"
Sep 18 21:29:23.812997 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.812920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7" event={"ID":"a6c349f5-726a-4770-814e-3295915ab524","Type":"ContainerDied","Data":"44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a"}
Sep 18 21:29:23.812997 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.812971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7" event={"ID":"a6c349f5-726a-4770-814e-3295915ab524","Type":"ContainerDied","Data":"33e9bc89134a8a1627f26c4bd73f6798f04ea21e8cfe6233062b400ea8213ab2"}
Sep 18 21:29:23.821095 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.821071    2576 scope.go:117] "RemoveContainer" containerID="db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88"
Sep 18 21:29:23.821433 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:29:23.821413    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88\": container with ID starting with db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88 not found: ID does not exist" containerID="db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88"
Sep 18 21:29:23.821481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.821444    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88"} err="failed to get container status \"db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88\": rpc error: code = NotFound desc = could not find container \"db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88\": container with ID starting with db289021cb1ee7c458968cce83a7af9a9c91d24160dfcac271a7e83c00961f88 not found: ID does not exist"
Sep 18 21:29:23.821481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.821460    2576 scope.go:117] "RemoveContainer" containerID="44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a"
Sep 18 21:29:23.830349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.830328    2576 scope.go:117] "RemoveContainer" containerID="44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a"
Sep 18 21:29:23.830684 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:29:23.830662    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a\": container with ID starting with 44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a not found: ID does not exist" containerID="44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a"
Sep 18 21:29:23.830738 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.830694    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a"} err="failed to get container status \"44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a\": rpc error: code = NotFound desc = could not find container \"44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a\": container with ID starting with 44be0c1f04393421e60c1412f311933d04a5751773f8b1a7e3728b4abb77c02a not found: ID does not exist"
Sep 18 21:29:23.840322 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.840291    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"]
Sep 18 21:29:23.843558 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.843530    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz"]
Sep 18 21:29:23.862508 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.862475    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"]
Sep 18 21:29:23.870954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:23.870923    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7"]
Sep 18 21:29:24.747769 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:24.747730    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e08e05-0bf8-4be4-92e5-3bc146ae23a9" path="/var/lib/kubelet/pods/27e08e05-0bf8-4be4-92e5-3bc146ae23a9/volumes"
Sep 18 21:29:24.748161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:24.748145    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c349f5-726a-4770-814e-3295915ab524" path="/var/lib/kubelet/pods/a6c349f5-726a-4770-814e-3295915ab524/volumes"
Sep 18 21:29:32.415026 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:29:32.414983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:30:00.165467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165368    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"]
Sep 18 21:30:00.165984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165800    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c349f5-726a-4770-814e-3295915ab524" containerName="payload-pre-processing"
Sep 18 21:30:00.165984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165811    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c349f5-726a-4770-814e-3295915ab524" containerName="payload-pre-processing"
Sep 18 21:30:00.165984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165819    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e08e05-0bf8-4be4-92e5-3bc146ae23a9" containerName="payload-processing"
Sep 18 21:30:00.165984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165824    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e08e05-0bf8-4be4-92e5-3bc146ae23a9" containerName="payload-processing"
Sep 18 21:30:00.165984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165905    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6c349f5-726a-4770-814e-3295915ab524" containerName="payload-pre-processing"
Sep 18 21:30:00.165984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.165915    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e08e05-0bf8-4be4-92e5-3bc146ae23a9" containerName="payload-processing"
Sep 18 21:30:00.169164 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.169140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"
Sep 18 21:30:00.172384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.172356    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:30:00.173744 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.173712    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"]
Sep 18 21:30:00.177582 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.177559    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"]
Sep 18 21:30:00.177713 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.177694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"
Sep 18 21:30:00.180317 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.180294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"
Sep 18 21:30:00.181003 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.180984    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"
Sep 18 21:30:00.186197 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.186167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"]
Sep 18 21:30:00.207687 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.207573    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"]
Sep 18 21:30:00.211137 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.210171    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"]
Sep 18 21:30:00.212389 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.212361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"
Sep 18 21:30:00.221688 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.221630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"
Sep 18 21:30:00.483424 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.483393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"]
Sep 18 21:30:00.485490 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:30:00.485457    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5a0d6b_7fbe_45a1_aa5e_7fb3a7dee1d6.slice/crio-870d8f3b52934f9c94daa2930f7fc727e3e5d8e467262830a0da2d4da8cf9289 WatchSource:0}: Error finding container 870d8f3b52934f9c94daa2930f7fc727e3e5d8e467262830a0da2d4da8cf9289: Status 404 returned error can't find the container with id 870d8f3b52934f9c94daa2930f7fc727e3e5d8e467262830a0da2d4da8cf9289
Sep 18 21:30:00.516392 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.516364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"]
Sep 18 21:30:00.519151 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:30:00.519112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb305ef1_4ed1_4460_b881_a5ec61916180.slice/crio-20a184141963dd5fb1bd386341766df41d3015a2f9003bc30826095fd2b56e0d WatchSource:0}: Error finding container 20a184141963dd5fb1bd386341766df41d3015a2f9003bc30826095fd2b56e0d: Status 404 returned error can't find the container with id 20a184141963dd5fb1bd386341766df41d3015a2f9003bc30826095fd2b56e0d
Sep 18 21:30:00.522581 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.522424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"]
Sep 18 21:30:00.525102 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:30:00.525073    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4f073d_08bf_451c_9cbc_9a97fc85640d.slice/crio-df5be3de69cd294b2d51632d2aee9909035a2fdbdc4fc9968623c936d1dc06e8 WatchSource:0}: Error finding container df5be3de69cd294b2d51632d2aee9909035a2fdbdc4fc9968623c936d1dc06e8: Status 404 returned error can't find the container with id df5be3de69cd294b2d51632d2aee9909035a2fdbdc4fc9968623c936d1dc06e8
Sep 18 21:30:00.999203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.999097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp" event={"ID":"eb305ef1-4ed1-4460-b881-a5ec61916180","Type":"ContainerStarted","Data":"2ae4c0eb445b7305d1135a4479bb12c27b4ad0359155d5e50036404d3db535f8"}
Sep 18 21:30:00.999203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:00.999162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp" event={"ID":"eb305ef1-4ed1-4460-b881-a5ec61916180","Type":"ContainerStarted","Data":"20a184141963dd5fb1bd386341766df41d3015a2f9003bc30826095fd2b56e0d"}
Sep 18 21:30:01.000948 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.000917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c" event={"ID":"ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6","Type":"ContainerStarted","Data":"a23c97be1f2a1f3fd045733ff1da7fa80f8d968a0b01cf42ea1b521012f64020"}
Sep 18 21:30:01.001120 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.000967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c" event={"ID":"ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6","Type":"ContainerStarted","Data":"870d8f3b52934f9c94daa2930f7fc727e3e5d8e467262830a0da2d4da8cf9289"}
Sep 18 21:30:01.002580 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.002550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9" event={"ID":"0a4f073d-08bf-451c-9cbc-9a97fc85640d","Type":"ContainerStarted","Data":"67c712fa9bf9e8c4d747c63f8fcc210b2f2ac55c7fc4be0c719a71174dd85b41"}
Sep 18 21:30:01.002692 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.002606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9" event={"ID":"0a4f073d-08bf-451c-9cbc-9a97fc85640d","Type":"ContainerStarted","Data":"df5be3de69cd294b2d51632d2aee9909035a2fdbdc4fc9968623c936d1dc06e8"}
Sep 18 21:30:01.038847 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.038784    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c" podStartSLOduration=1.038765773 podStartE2EDuration="1.038765773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:30:01.038451176 +0000 UTC m=+1434.501230547" watchObservedRunningTime="2026-09-18 21:30:01.038765773 +0000 UTC m=+1434.501545127"
Sep 18 21:30:01.040123 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.040079    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp" podStartSLOduration=1.040065093 podStartE2EDuration="1.040065093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:30:01.021515904 +0000 UTC m=+1434.484295253" watchObservedRunningTime="2026-09-18 21:30:01.040065093 +0000 UTC m=+1434.502844478"
Sep 18 21:30:01.056429 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:01.056368    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9" podStartSLOduration=1.05634908 podStartE2EDuration="1.05634908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:30:01.054826237 +0000 UTC m=+1434.517605597" watchObservedRunningTime="2026-09-18 21:30:01.05634908 +0000 UTC m=+1434.519128438"
Sep 18 21:30:02.009872 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:02.009778    2576 generic.go:356] "Generic (PLEG): container finished" podID="eb305ef1-4ed1-4460-b881-a5ec61916180" containerID="2ae4c0eb445b7305d1135a4479bb12c27b4ad0359155d5e50036404d3db535f8" exitCode=0
Sep 18 21:30:02.010305 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:02.009857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp" event={"ID":"eb305ef1-4ed1-4460-b881-a5ec61916180","Type":"ContainerDied","Data":"2ae4c0eb445b7305d1135a4479bb12c27b4ad0359155d5e50036404d3db535f8"}
Sep 18 21:30:02.011524 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:02.011501    2576 generic.go:356] "Generic (PLEG): container finished" podID="ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6" containerID="a23c97be1f2a1f3fd045733ff1da7fa80f8d968a0b01cf42ea1b521012f64020" exitCode=0
Sep 18 21:30:02.011633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:02.011593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c" event={"ID":"ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6","Type":"ContainerDied","Data":"a23c97be1f2a1f3fd045733ff1da7fa80f8d968a0b01cf42ea1b521012f64020"}
Sep 18 21:30:02.013099 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:02.013079    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a4f073d-08bf-451c-9cbc-9a97fc85640d" containerID="67c712fa9bf9e8c4d747c63f8fcc210b2f2ac55c7fc4be0c719a71174dd85b41" exitCode=0
Sep 18 21:30:02.013180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:02.013159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9" event={"ID":"0a4f073d-08bf-451c-9cbc-9a97fc85640d","Type":"ContainerDied","Data":"67c712fa9bf9e8c4d747c63f8fcc210b2f2ac55c7fc4be0c719a71174dd85b41"}
Sep 18 21:30:03.167490 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:03.167453    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"
Sep 18 21:30:03.215948 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:03.215920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"
Sep 18 21:30:03.219341 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:03.219311    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"
Sep 18 21:30:04.024097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.024063    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp"
Sep 18 21:30:04.024301 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.024058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829450-kgsfp" event={"ID":"eb305ef1-4ed1-4460-b881-a5ec61916180","Type":"ContainerDied","Data":"20a184141963dd5fb1bd386341766df41d3015a2f9003bc30826095fd2b56e0d"}
Sep 18 21:30:04.024301 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.024206    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20a184141963dd5fb1bd386341766df41d3015a2f9003bc30826095fd2b56e0d"
Sep 18 21:30:04.025572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.025551    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"
Sep 18 21:30:04.025674 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.025586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c" event={"ID":"ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6","Type":"ContainerDied","Data":"870d8f3b52934f9c94daa2930f7fc727e3e5d8e467262830a0da2d4da8cf9289"}
Sep 18 21:30:04.025674 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.025626    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="870d8f3b52934f9c94daa2930f7fc727e3e5d8e467262830a0da2d4da8cf9289"
Sep 18 21:30:04.027122 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.027095    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"
Sep 18 21:30:04.027122 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.027109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9" event={"ID":"0a4f073d-08bf-451c-9cbc-9a97fc85640d","Type":"ContainerDied","Data":"df5be3de69cd294b2d51632d2aee9909035a2fdbdc4fc9968623c936d1dc06e8"}
Sep 18 21:30:04.027264 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.027145    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df5be3de69cd294b2d51632d2aee9909035a2fdbdc4fc9968623c936d1dc06e8"
Sep 18 21:30:04.093916 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:04.093865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:30:08.920553 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:08.920521    2576 scope.go:117] "RemoveContainer" containerID="8cf3a3fd3362fbcecd93da9c466468c2356faffeb3137763935d470d0f7f0058"
Sep 18 21:30:29.716512 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:29.716468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:30:50.999997 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:50.999957    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"]
Sep 18 21:30:51.000504 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.000233    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7" podUID="7d4ab885-0bce-4046-8c46-7fdebbe70f9b" containerName="payload-processing" containerID="cri-o://a6d6536d9d239fb14c6d6abeb4c3ac649f91ddcf158402470e4ba5fd65f399cd" gracePeriod=30
Sep 18 21:30:51.010950 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.010912    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"]
Sep 18 21:30:51.011178 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.011153    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g" podUID="1efce641-0555-4c50-a8ea-0c27bf84f72f" containerName="payload-pre-processing" containerID="cri-o://4ca952a1b197682833d048e75088b571b4f5a6d48fdcc41b57a04957ce3c4a94" gracePeriod=30
Sep 18 21:30:51.273118 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.273008    2576 generic.go:356] "Generic (PLEG): container finished" podID="1efce641-0555-4c50-a8ea-0c27bf84f72f" containerID="4ca952a1b197682833d048e75088b571b4f5a6d48fdcc41b57a04957ce3c4a94" exitCode=0
Sep 18 21:30:51.273118 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.273061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g" event={"ID":"1efce641-0555-4c50-a8ea-0c27bf84f72f","Type":"ContainerDied","Data":"4ca952a1b197682833d048e75088b571b4f5a6d48fdcc41b57a04957ce3c4a94"}
Sep 18 21:30:51.274693 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.274666    2576 generic.go:356] "Generic (PLEG): container finished" podID="7d4ab885-0bce-4046-8c46-7fdebbe70f9b" containerID="a6d6536d9d239fb14c6d6abeb4c3ac649f91ddcf158402470e4ba5fd65f399cd" exitCode=0
Sep 18 21:30:51.274831 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.274743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7" event={"ID":"7d4ab885-0bce-4046-8c46-7fdebbe70f9b","Type":"ContainerDied","Data":"a6d6536d9d239fb14c6d6abeb4c3ac649f91ddcf158402470e4ba5fd65f399cd"}
Sep 18 21:30:51.303047 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.303020    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:30:51.305941 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.305920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:30:51.349420 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.349381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-plugins-config-volume\") pod \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") "
Sep 18 21:30:51.349594 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.349457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5g65\" (UniqueName: \"kubernetes.io/projected/1efce641-0555-4c50-a8ea-0c27bf84f72f-kube-api-access-d5g65\") pod \"1efce641-0555-4c50-a8ea-0c27bf84f72f\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") "
Sep 18 21:30:51.349594 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.349557    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efce641-0555-4c50-a8ea-0c27bf84f72f-plugins-config-volume\") pod \"1efce641-0555-4c50-a8ea-0c27bf84f72f\" (UID: \"1efce641-0555-4c50-a8ea-0c27bf84f72f\") "
Sep 18 21:30:51.349722 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.349598    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6xrv\" (UniqueName: \"kubernetes.io/projected/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-kube-api-access-d6xrv\") pod \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\" (UID: \"7d4ab885-0bce-4046-8c46-7fdebbe70f9b\") "
Sep 18 21:30:51.349870 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.349845    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d4ab885-0bce-4046-8c46-7fdebbe70f9b" (UID: "7d4ab885-0bce-4046-8c46-7fdebbe70f9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:30:51.350013 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.349987    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1efce641-0555-4c50-a8ea-0c27bf84f72f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1efce641-0555-4c50-a8ea-0c27bf84f72f" (UID: "1efce641-0555-4c50-a8ea-0c27bf84f72f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:30:51.351574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.351554    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1efce641-0555-4c50-a8ea-0c27bf84f72f-kube-api-access-d5g65" (OuterVolumeSpecName: "kube-api-access-d5g65") pod "1efce641-0555-4c50-a8ea-0c27bf84f72f" (UID: "1efce641-0555-4c50-a8ea-0c27bf84f72f"). InnerVolumeSpecName "kube-api-access-d5g65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:30:51.351678 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.351658    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-kube-api-access-d6xrv" (OuterVolumeSpecName: "kube-api-access-d6xrv") pod "7d4ab885-0bce-4046-8c46-7fdebbe70f9b" (UID: "7d4ab885-0bce-4046-8c46-7fdebbe70f9b"). InnerVolumeSpecName "kube-api-access-d6xrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:30:51.450853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.450813    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6xrv\" (UniqueName: \"kubernetes.io/projected/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-kube-api-access-d6xrv\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:30:51.450853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.450845    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4ab885-0bce-4046-8c46-7fdebbe70f9b-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:30:51.450853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.450855    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5g65\" (UniqueName: \"kubernetes.io/projected/1efce641-0555-4c50-a8ea-0c27bf84f72f-kube-api-access-d5g65\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:30:51.450853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:51.450864    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1efce641-0555-4c50-a8ea-0c27bf84f72f-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:30:52.287348 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.287250    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"
Sep 18 21:30:52.287348 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.287245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g" event={"ID":"1efce641-0555-4c50-a8ea-0c27bf84f72f","Type":"ContainerDied","Data":"b91815f661d959c050044596d072a56ea39ad8de835a813e27c48961c3041f40"}
Sep 18 21:30:52.287874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.287415    2576 scope.go:117] "RemoveContainer" containerID="4ca952a1b197682833d048e75088b571b4f5a6d48fdcc41b57a04957ce3c4a94"
Sep 18 21:30:52.288919 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.288869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7" event={"ID":"7d4ab885-0bce-4046-8c46-7fdebbe70f9b","Type":"ContainerDied","Data":"83e027a433d6f5504bdfe5462615359e7ea682d11f289bccc5c661e18feace83"}
Sep 18 21:30:52.289003 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.288929    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"
Sep 18 21:30:52.298277 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.298250    2576 scope.go:117] "RemoveContainer" containerID="a6d6536d9d239fb14c6d6abeb4c3ac649f91ddcf158402470e4ba5fd65f399cd"
Sep 18 21:30:52.326541 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.326505    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"]
Sep 18 21:30:52.337349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.337313    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g"]
Sep 18 21:30:52.364263 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.364222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"]
Sep 18 21:30:52.370163 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.370133    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7"]
Sep 18 21:30:52.741168 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.741127    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1efce641-0555-4c50-a8ea-0c27bf84f72f" path="/var/lib/kubelet/pods/1efce641-0555-4c50-a8ea-0c27bf84f72f/volumes"
Sep 18 21:30:52.741532 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:52.741518    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4ab885-0bce-4046-8c46-7fdebbe70f9b" path="/var/lib/kubelet/pods/7d4ab885-0bce-4046-8c46-7fdebbe70f9b/volumes"
Sep 18 21:30:55.410353 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:30:55.410317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:31:08.949327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:08.949291    2576 scope.go:117] "RemoveContainer" containerID="373707f0e775dbfb4daaf261f9ce45745bac78c9577489727a6fba961fa2745a"
Sep 18 21:31:15.832611 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:15.832572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:31:23.169407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169368    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"]
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169732    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a4f073d-08bf-451c-9cbc-9a97fc85640d" containerName="cleanup"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169743    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a4f073d-08bf-451c-9cbc-9a97fc85640d" containerName="cleanup"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169754    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1efce641-0555-4c50-a8ea-0c27bf84f72f" containerName="payload-pre-processing"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169759    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1efce641-0555-4c50-a8ea-0c27bf84f72f" containerName="payload-pre-processing"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169772    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6" containerName="cleanup"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169778    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6" containerName="cleanup"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169786    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4ab885-0bce-4046-8c46-7fdebbe70f9b" containerName="payload-processing"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169792    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4ab885-0bce-4046-8c46-7fdebbe70f9b" containerName="payload-processing"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169798    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb305ef1-4ed1-4460-b881-a5ec61916180" containerName="cleanup"
Sep 18 21:31:23.169942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.169804    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb305ef1-4ed1-4460-b881-a5ec61916180" containerName="cleanup"
Sep 18 21:31:23.172406 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.170512    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4ab885-0bce-4046-8c46-7fdebbe70f9b" containerName="payload-processing"
Sep 18 21:31:23.172406 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.170548    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb305ef1-4ed1-4460-b881-a5ec61916180" containerName="cleanup"
Sep 18 21:31:23.172406 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.170569    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a4f073d-08bf-451c-9cbc-9a97fc85640d" containerName="cleanup"
Sep 18 21:31:23.172406 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.170580    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6" containerName="cleanup"
Sep 18 21:31:23.172406 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.170599    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1efce641-0555-4c50-a8ea-0c27bf84f72f" containerName="payload-pre-processing"
Sep 18 21:31:23.176582 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.176537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.179795 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.179770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-8424a6-dockercfg-8tfrp\""
Sep 18 21:31:23.179979 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.179960    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-8424a6\""
Sep 18 21:31:23.191254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.191222    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"]
Sep 18 21:31:23.247180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.247149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a939cb-c077-4e44-a2db-9827b03db65c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8424a6-65555f889c-xn48f\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.247374 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.247208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wcvk\" (UniqueName: \"kubernetes.io/projected/93a939cb-c077-4e44-a2db-9827b03db65c-kube-api-access-5wcvk\") pod \"payload-processing-e2e-api-a-8424a6-65555f889c-xn48f\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.348600 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.348568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcvk\" (UniqueName: \"kubernetes.io/projected/93a939cb-c077-4e44-a2db-9827b03db65c-kube-api-access-5wcvk\") pod \"payload-processing-e2e-api-a-8424a6-65555f889c-xn48f\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.348802 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.348653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a939cb-c077-4e44-a2db-9827b03db65c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8424a6-65555f889c-xn48f\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.349367 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.349349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a939cb-c077-4e44-a2db-9827b03db65c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8424a6-65555f889c-xn48f\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.359996 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.359964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wcvk\" (UniqueName: \"kubernetes.io/projected/93a939cb-c077-4e44-a2db-9827b03db65c-kube-api-access-5wcvk\") pod \"payload-processing-e2e-api-a-8424a6-65555f889c-xn48f\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.487870 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.487782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:23.765201 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:23.765173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"]
Sep 18 21:31:23.767417 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:31:23.767388    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a939cb_c077_4e44_a2db_9827b03db65c.slice/crio-44ede562117322242cfa8e46599c620e7fc3928ccb06b8343a83ce3b4da30e21 WatchSource:0}: Error finding container 44ede562117322242cfa8e46599c620e7fc3928ccb06b8343a83ce3b4da30e21: Status 404 returned error can't find the container with id 44ede562117322242cfa8e46599c620e7fc3928ccb06b8343a83ce3b4da30e21
Sep 18 21:31:24.457666 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:24.457629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f" event={"ID":"93a939cb-c077-4e44-a2db-9827b03db65c","Type":"ContainerStarted","Data":"289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f"}
Sep 18 21:31:24.457666 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:24.457685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f" event={"ID":"93a939cb-c077-4e44-a2db-9827b03db65c","Type":"ContainerStarted","Data":"44ede562117322242cfa8e46599c620e7fc3928ccb06b8343a83ce3b4da30e21"}
Sep 18 21:31:24.458178 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:24.457706    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:24.478039 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:24.477972    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f" podStartSLOduration=1.477954147 podStartE2EDuration="1.477954147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:31:24.475632077 +0000 UTC m=+1517.938411435" watchObservedRunningTime="2026-09-18 21:31:24.477954147 +0000 UTC m=+1517.940733504"
Sep 18 21:31:35.465066 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:35.465034    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:31:40.595224 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:40.595187    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:31:54.288231 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:54.288187    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"]
Sep 18 21:31:57.935207 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:57.935165    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:31:58.009620 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.009582    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"]
Sep 18 21:31:58.013124 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.013100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.015853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.015807    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9e75fb\""
Sep 18 21:31:58.016008 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.015941    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9e75fb-dockercfg-4jt5p\""
Sep 18 21:31:58.025138 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.025111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"]
Sep 18 21:31:58.098294 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.098259    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"]
Sep 18 21:31:58.102301 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.102273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.112512 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.112454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"]
Sep 18 21:31:58.168018 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.167979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcq5k\" (UniqueName: \"kubernetes.io/projected/9f790790-63d8-4b44-8d6d-da559f398069-kube-api-access-kcq5k\") pod \"payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.168212 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.168065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f790790-63d8-4b44-8d6d-da559f398069-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.268593 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.268502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2e682dd-a9c1-4176-befa-ce08acd09c01-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.268593 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.268554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcq5k\" (UniqueName: \"kubernetes.io/projected/9f790790-63d8-4b44-8d6d-da559f398069-kube-api-access-kcq5k\") pod \"payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.268593 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.268582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76kz\" (UniqueName: \"kubernetes.io/projected/c2e682dd-a9c1-4176-befa-ce08acd09c01-kube-api-access-x76kz\") pod \"payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.268827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.268622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f790790-63d8-4b44-8d6d-da559f398069-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.269390 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.269369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f790790-63d8-4b44-8d6d-da559f398069-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.277798 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.277772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcq5k\" (UniqueName: \"kubernetes.io/projected/9f790790-63d8-4b44-8d6d-da559f398069-kube-api-access-kcq5k\") pod \"payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.324127 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.324084    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:58.369237 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.369201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2e682dd-a9c1-4176-befa-ce08acd09c01-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.369414 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.369262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x76kz\" (UniqueName: \"kubernetes.io/projected/c2e682dd-a9c1-4176-befa-ce08acd09c01-kube-api-access-x76kz\") pod \"payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.370222 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.370198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2e682dd-a9c1-4176-befa-ce08acd09c01-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.378337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.378246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76kz\" (UniqueName: \"kubernetes.io/projected/c2e682dd-a9c1-4176-befa-ce08acd09c01-kube-api-access-x76kz\") pod \"payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.415065 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.415029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:58.609150 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.609086    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"]
Sep 18 21:31:58.611546 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:31:58.611520    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f790790_63d8_4b44_8d6d_da559f398069.slice/crio-483414696ac2275be3f50ce4fe41f106ebe801df499efade8853b89040c41aab WatchSource:0}: Error finding container 483414696ac2275be3f50ce4fe41f106ebe801df499efade8853b89040c41aab: Status 404 returned error can't find the container with id 483414696ac2275be3f50ce4fe41f106ebe801df499efade8853b89040c41aab
Sep 18 21:31:58.637031 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.636994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw" event={"ID":"9f790790-63d8-4b44-8d6d-da559f398069","Type":"ContainerStarted","Data":"483414696ac2275be3f50ce4fe41f106ebe801df499efade8853b89040c41aab"}
Sep 18 21:31:58.697327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:58.697285    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"]
Sep 18 21:31:58.700465 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:31:58.700424    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e682dd_a9c1_4176_befa_ce08acd09c01.slice/crio-6dc8dbb837a3bfdf2f37138bce7c1175b7fc72a337e9e2d7f26644f4ab19f60f WatchSource:0}: Error finding container 6dc8dbb837a3bfdf2f37138bce7c1175b7fc72a337e9e2d7f26644f4ab19f60f: Status 404 returned error can't find the container with id 6dc8dbb837a3bfdf2f37138bce7c1175b7fc72a337e9e2d7f26644f4ab19f60f
Sep 18 21:31:59.644234 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.644191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv" event={"ID":"c2e682dd-a9c1-4176-befa-ce08acd09c01","Type":"ContainerStarted","Data":"2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85"}
Sep 18 21:31:59.644702 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.644292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv" event={"ID":"c2e682dd-a9c1-4176-befa-ce08acd09c01","Type":"ContainerStarted","Data":"6dc8dbb837a3bfdf2f37138bce7c1175b7fc72a337e9e2d7f26644f4ab19f60f"}
Sep 18 21:31:59.644702 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.644328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:31:59.645880 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.645851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw" event={"ID":"9f790790-63d8-4b44-8d6d-da559f398069","Type":"ContainerStarted","Data":"e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63"}
Sep 18 21:31:59.646053 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.645923    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:31:59.682341 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.682282    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv" podStartSLOduration=1.68226524 podStartE2EDuration="1.68226524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:31:59.680412774 +0000 UTC m=+1553.143192132" watchObservedRunningTime="2026-09-18 21:31:59.68226524 +0000 UTC m=+1553.145044597"
Sep 18 21:31:59.732222 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:31:59.732145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw" podStartSLOduration=2.732121697 podStartE2EDuration="2.732121697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:31:59.729578431 +0000 UTC m=+1553.192357788" watchObservedRunningTime="2026-09-18 21:31:59.732121697 +0000 UTC m=+1553.194901056"
Sep 18 21:32:08.977149 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:08.977110    2576 scope.go:117] "RemoveContainer" containerID="eb0bcfa8bd7044a9b701b1f0a25d0beb4f5f5f649da52b36fd5ff32fec398798"
Sep 18 21:32:09.307937 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.307813    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8" podUID="65adf407-0dda-4a3f-9428-c662bfcd369e" containerName="main" containerID="cri-o://4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9" gracePeriod=45
Sep 18 21:32:09.561268 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.561193    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:32:09.674403 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674362    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-dshm\") pod \"65adf407-0dda-4a3f-9428-c662bfcd369e\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") "
Sep 18 21:32:09.674403 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674406    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-home\") pod \"65adf407-0dda-4a3f-9428-c662bfcd369e\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") "
Sep 18 21:32:09.674643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674427    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65adf407-0dda-4a3f-9428-c662bfcd369e-tls-certs\") pod \"65adf407-0dda-4a3f-9428-c662bfcd369e\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") "
Sep 18 21:32:09.674643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674454    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-tmp-dir\") pod \"65adf407-0dda-4a3f-9428-c662bfcd369e\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") "
Sep 18 21:32:09.674643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674580    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzpvn\" (UniqueName: \"kubernetes.io/projected/65adf407-0dda-4a3f-9428-c662bfcd369e-kube-api-access-vzpvn\") pod \"65adf407-0dda-4a3f-9428-c662bfcd369e\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") "
Sep 18 21:32:09.674643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-model-cache\") pod \"65adf407-0dda-4a3f-9428-c662bfcd369e\" (UID: \"65adf407-0dda-4a3f-9428-c662bfcd369e\") "
Sep 18 21:32:09.674854 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674717    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65adf407-0dda-4a3f-9428-c662bfcd369e" (UID: "65adf407-0dda-4a3f-9428-c662bfcd369e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:32:09.674854 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-home" (OuterVolumeSpecName: "home") pod "65adf407-0dda-4a3f-9428-c662bfcd369e" (UID: "65adf407-0dda-4a3f-9428-c662bfcd369e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:32:09.675004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674937    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-model-cache" (OuterVolumeSpecName: "model-cache") pod "65adf407-0dda-4a3f-9428-c662bfcd369e" (UID: "65adf407-0dda-4a3f-9428-c662bfcd369e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:32:09.675004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674950    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-home\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:09.675004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.674981    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-tmp-dir\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:09.676731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.676696    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-dshm" (OuterVolumeSpecName: "dshm") pod "65adf407-0dda-4a3f-9428-c662bfcd369e" (UID: "65adf407-0dda-4a3f-9428-c662bfcd369e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:32:09.676847 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.676724    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65adf407-0dda-4a3f-9428-c662bfcd369e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65adf407-0dda-4a3f-9428-c662bfcd369e" (UID: "65adf407-0dda-4a3f-9428-c662bfcd369e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:32:09.676847 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.676758    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65adf407-0dda-4a3f-9428-c662bfcd369e-kube-api-access-vzpvn" (OuterVolumeSpecName: "kube-api-access-vzpvn") pod "65adf407-0dda-4a3f-9428-c662bfcd369e" (UID: "65adf407-0dda-4a3f-9428-c662bfcd369e"). InnerVolumeSpecName "kube-api-access-vzpvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:32:09.698337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.698304    2576 generic.go:356] "Generic (PLEG): container finished" podID="65adf407-0dda-4a3f-9428-c662bfcd369e" containerID="4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9" exitCode=0
Sep 18 21:32:09.698517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.698345    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"
Sep 18 21:32:09.698517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.698378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8" event={"ID":"65adf407-0dda-4a3f-9428-c662bfcd369e","Type":"ContainerDied","Data":"4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9"}
Sep 18 21:32:09.698517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.698422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8" event={"ID":"65adf407-0dda-4a3f-9428-c662bfcd369e","Type":"ContainerDied","Data":"2552336a78824b1c5273c74fb33fdfc681c8bb51865580fd66152ca7d724e502"}
Sep 18 21:32:09.698517 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.698439    2576 scope.go:117] "RemoveContainer" containerID="4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9"
Sep 18 21:32:09.708285 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.708262    2576 scope.go:117] "RemoveContainer" containerID="4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9"
Sep 18 21:32:09.708625 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:32:09.708603    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9\": container with ID starting with 4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9 not found: ID does not exist" containerID="4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9"
Sep 18 21:32:09.708697 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.708634    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9"} err="failed to get container status \"4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9\": rpc error: code = NotFound desc = could not find container \"4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9\": container with ID starting with 4ba5251ece6307591edcee6e29b907ccde9aa1ad955656f119e4931582c2edd9 not found: ID does not exist"
Sep 18 21:32:09.720045 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.720006    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"]
Sep 18 21:32:09.725776 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.725736    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-cad5cf/auth-test-model-cad5cf-kserve-7d99585d99-7p4p8"]
Sep 18 21:32:09.776209 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.776161    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-dshm\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:09.776209 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.776196    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65adf407-0dda-4a3f-9428-c662bfcd369e-tls-certs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:09.776209 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.776210    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzpvn\" (UniqueName: \"kubernetes.io/projected/65adf407-0dda-4a3f-9428-c662bfcd369e-kube-api-access-vzpvn\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:09.776466 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:09.776222    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65adf407-0dda-4a3f-9428-c662bfcd369e-model-cache\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:10.654115 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:10.654077    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:32:10.654536 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:10.654348    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:32:10.746916 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:10.746844    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65adf407-0dda-4a3f-9428-c662bfcd369e" path="/var/lib/kubelet/pods/65adf407-0dda-4a3f-9428-c662bfcd369e/volumes"
Sep 18 21:32:13.520587 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:13.520541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:32:26.814731 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:26.814683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:32:41.470400 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.470360    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"]
Sep 18 21:32:41.470992 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.470659    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f" podUID="93a939cb-c077-4e44-a2db-9827b03db65c" containerName="payload-processing" containerID="cri-o://289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f" gracePeriod=30
Sep 18 21:32:41.732098 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.732016    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:32:41.858945 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.858910    2576 generic.go:356] "Generic (PLEG): container finished" podID="93a939cb-c077-4e44-a2db-9827b03db65c" containerID="289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f" exitCode=0
Sep 18 21:32:41.859148 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.858959    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"
Sep 18 21:32:41.859148 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.858981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f" event={"ID":"93a939cb-c077-4e44-a2db-9827b03db65c","Type":"ContainerDied","Data":"289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f"}
Sep 18 21:32:41.859148 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.859041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f" event={"ID":"93a939cb-c077-4e44-a2db-9827b03db65c","Type":"ContainerDied","Data":"44ede562117322242cfa8e46599c620e7fc3928ccb06b8343a83ce3b4da30e21"}
Sep 18 21:32:41.859148 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.859063    2576 scope.go:117] "RemoveContainer" containerID="289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f"
Sep 18 21:32:41.860247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.860125    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a939cb-c077-4e44-a2db-9827b03db65c-plugins-config-volume\") pod \"93a939cb-c077-4e44-a2db-9827b03db65c\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") "
Sep 18 21:32:41.860247 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.860209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wcvk\" (UniqueName: \"kubernetes.io/projected/93a939cb-c077-4e44-a2db-9827b03db65c-kube-api-access-5wcvk\") pod \"93a939cb-c077-4e44-a2db-9827b03db65c\" (UID: \"93a939cb-c077-4e44-a2db-9827b03db65c\") "
Sep 18 21:32:41.860509 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.860482    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a939cb-c077-4e44-a2db-9827b03db65c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93a939cb-c077-4e44-a2db-9827b03db65c" (UID: "93a939cb-c077-4e44-a2db-9827b03db65c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:32:41.862568 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.862537    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a939cb-c077-4e44-a2db-9827b03db65c-kube-api-access-5wcvk" (OuterVolumeSpecName: "kube-api-access-5wcvk") pod "93a939cb-c077-4e44-a2db-9827b03db65c" (UID: "93a939cb-c077-4e44-a2db-9827b03db65c"). InnerVolumeSpecName "kube-api-access-5wcvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:32:41.875688 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.875669    2576 scope.go:117] "RemoveContainer" containerID="289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f"
Sep 18 21:32:41.876069 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:32:41.876047    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f\": container with ID starting with 289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f not found: ID does not exist" containerID="289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f"
Sep 18 21:32:41.876121 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.876080    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f"} err="failed to get container status \"289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f\": rpc error: code = NotFound desc = could not find container \"289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f\": container with ID starting with 289afcc213e97e66c869f5d6a313f63a59a2872e0a288eaa37ba34b55511646f not found: ID does not exist"
Sep 18 21:32:41.961229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.961188    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wcvk\" (UniqueName: \"kubernetes.io/projected/93a939cb-c077-4e44-a2db-9827b03db65c-kube-api-access-5wcvk\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:41.961229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:41.961221    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a939cb-c077-4e44-a2db-9827b03db65c-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:32:42.183147 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:42.183032    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"]
Sep 18 21:32:42.185042 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:42.185014    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f"]
Sep 18 21:32:42.741180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:42.741147    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a939cb-c077-4e44-a2db-9827b03db65c" path="/var/lib/kubelet/pods/93a939cb-c077-4e44-a2db-9827b03db65c/volumes"
Sep 18 21:32:46.907255 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:32:46.907215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:33:04.095366 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:04.095287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:33:05.278206 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.278169    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"]
Sep 18 21:33:05.278692 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.278434    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw" podUID="9f790790-63d8-4b44-8d6d-da559f398069" containerName="payload-processing" containerID="cri-o://e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63" gracePeriod=30
Sep 18 21:33:05.283378 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.283338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"]
Sep 18 21:33:05.283642 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.283602    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv" podUID="c2e682dd-a9c1-4176-befa-ce08acd09c01" containerName="payload-pre-processing" containerID="cri-o://2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85" gracePeriod=30
Sep 18 21:33:05.562093 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.562049    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:33:05.565189 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.565164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:33:05.663291 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.663256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x76kz\" (UniqueName: \"kubernetes.io/projected/c2e682dd-a9c1-4176-befa-ce08acd09c01-kube-api-access-x76kz\") pod \"c2e682dd-a9c1-4176-befa-ce08acd09c01\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") "
Sep 18 21:33:05.663503 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.663340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcq5k\" (UniqueName: \"kubernetes.io/projected/9f790790-63d8-4b44-8d6d-da559f398069-kube-api-access-kcq5k\") pod \"9f790790-63d8-4b44-8d6d-da559f398069\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") "
Sep 18 21:33:05.663503 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.663361    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f790790-63d8-4b44-8d6d-da559f398069-plugins-config-volume\") pod \"9f790790-63d8-4b44-8d6d-da559f398069\" (UID: \"9f790790-63d8-4b44-8d6d-da559f398069\") "
Sep 18 21:33:05.663503 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.663388    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2e682dd-a9c1-4176-befa-ce08acd09c01-plugins-config-volume\") pod \"c2e682dd-a9c1-4176-befa-ce08acd09c01\" (UID: \"c2e682dd-a9c1-4176-befa-ce08acd09c01\") "
Sep 18 21:33:05.663737 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.663713    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f790790-63d8-4b44-8d6d-da559f398069-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f790790-63d8-4b44-8d6d-da559f398069" (UID: "9f790790-63d8-4b44-8d6d-da559f398069"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:05.663822 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.663802    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2e682dd-a9c1-4176-befa-ce08acd09c01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2e682dd-a9c1-4176-befa-ce08acd09c01" (UID: "c2e682dd-a9c1-4176-befa-ce08acd09c01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:05.665568 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.665540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f790790-63d8-4b44-8d6d-da559f398069-kube-api-access-kcq5k" (OuterVolumeSpecName: "kube-api-access-kcq5k") pod "9f790790-63d8-4b44-8d6d-da559f398069" (UID: "9f790790-63d8-4b44-8d6d-da559f398069"). InnerVolumeSpecName "kube-api-access-kcq5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:05.665568 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.665540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e682dd-a9c1-4176-befa-ce08acd09c01-kube-api-access-x76kz" (OuterVolumeSpecName: "kube-api-access-x76kz") pod "c2e682dd-a9c1-4176-befa-ce08acd09c01" (UID: "c2e682dd-a9c1-4176-befa-ce08acd09c01"). InnerVolumeSpecName "kube-api-access-x76kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:05.764384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.764348    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcq5k\" (UniqueName: \"kubernetes.io/projected/9f790790-63d8-4b44-8d6d-da559f398069-kube-api-access-kcq5k\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:05.764384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.764376    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f790790-63d8-4b44-8d6d-da559f398069-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:05.764384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.764386    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2e682dd-a9c1-4176-befa-ce08acd09c01-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:05.764384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.764395    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x76kz\" (UniqueName: \"kubernetes.io/projected/c2e682dd-a9c1-4176-befa-ce08acd09c01-kube-api-access-x76kz\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:05.986953 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.986911    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f790790-63d8-4b44-8d6d-da559f398069" containerID="e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63" exitCode=0
Sep 18 21:33:05.987142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.986966    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"
Sep 18 21:33:05.987142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.986993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw" event={"ID":"9f790790-63d8-4b44-8d6d-da559f398069","Type":"ContainerDied","Data":"e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63"}
Sep 18 21:33:05.987142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.987077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw" event={"ID":"9f790790-63d8-4b44-8d6d-da559f398069","Type":"ContainerDied","Data":"483414696ac2275be3f50ce4fe41f106ebe801df499efade8853b89040c41aab"}
Sep 18 21:33:05.987142 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.987101    2576 scope.go:117] "RemoveContainer" containerID="e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63"
Sep 18 21:33:05.988644 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.988614    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e682dd-a9c1-4176-befa-ce08acd09c01" containerID="2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85" exitCode=0
Sep 18 21:33:05.988769 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.988670    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv" event={"ID":"c2e682dd-a9c1-4176-befa-ce08acd09c01","Type":"ContainerDied","Data":"2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85"}
Sep 18 21:33:05.988769 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.988689    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"
Sep 18 21:33:05.988769 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.988716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv" event={"ID":"c2e682dd-a9c1-4176-befa-ce08acd09c01","Type":"ContainerDied","Data":"6dc8dbb837a3bfdf2f37138bce7c1175b7fc72a337e9e2d7f26644f4ab19f60f"}
Sep 18 21:33:05.996268 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.996247    2576 scope.go:117] "RemoveContainer" containerID="e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63"
Sep 18 21:33:05.996614 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:05.996587    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63\": container with ID starting with e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63 not found: ID does not exist" containerID="e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63"
Sep 18 21:33:05.996699 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.996630    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63"} err="failed to get container status \"e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63\": rpc error: code = NotFound desc = could not find container \"e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63\": container with ID starting with e763ed637f97d84cb461afddf0cbe9b5740c3781b5a76b7cfc9734415260ec63 not found: ID does not exist"
Sep 18 21:33:05.996699 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:05.996656    2576 scope.go:117] "RemoveContainer" containerID="2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85"
Sep 18 21:33:06.005498 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.005468    2576 scope.go:117] "RemoveContainer" containerID="2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85"
Sep 18 21:33:06.005790 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:06.005770    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85\": container with ID starting with 2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85 not found: ID does not exist" containerID="2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85"
Sep 18 21:33:06.005861 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.005797    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85"} err="failed to get container status \"2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85\": rpc error: code = NotFound desc = could not find container \"2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85\": container with ID starting with 2dc2d7d23037d4bf6bce6a04228537be17e9ce0ea0627364ee26fcd80643ae85 not found: ID does not exist"
Sep 18 21:33:06.014792 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.014760    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"]
Sep 18 21:33:06.019125 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.019100    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw"]
Sep 18 21:33:06.030354 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.030314    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"]
Sep 18 21:33:06.036660 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.036632    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv"]
Sep 18 21:33:06.741006 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.740974    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f790790-63d8-4b44-8d6d-da559f398069" path="/var/lib/kubelet/pods/9f790790-63d8-4b44-8d6d-da559f398069/volumes"
Sep 18 21:33:06.741389 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:06.741344    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e682dd-a9c1-4176-befa-ce08acd09c01" path="/var/lib/kubelet/pods/c2e682dd-a9c1-4176-befa-ce08acd09c01/volumes"
Sep 18 21:33:08.998782 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:08.998748    2576 scope.go:117] "RemoveContainer" containerID="bb5abaa076781d8cd3d28bbd32aade0d1135a18e58052479dff961ff814ac919"
Sep 18 21:33:09.007471 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:09.007447    2576 scope.go:117] "RemoveContainer" containerID="4f2c44dca538f20b312fb1eca160a788a79ec872f4a5031148df93104cd40036"
Sep 18 21:33:12.971260 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971224    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"]
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971574    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f790790-63d8-4b44-8d6d-da559f398069" containerName="payload-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971585    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f790790-63d8-4b44-8d6d-da559f398069" containerName="payload-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971597    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65adf407-0dda-4a3f-9428-c662bfcd369e" containerName="main"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971602    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65adf407-0dda-4a3f-9428-c662bfcd369e" containerName="main"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971608    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a939cb-c077-4e44-a2db-9827b03db65c" containerName="payload-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971614    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a939cb-c077-4e44-a2db-9827b03db65c" containerName="payload-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971624    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e682dd-a9c1-4176-befa-ce08acd09c01" containerName="payload-pre-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971630    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e682dd-a9c1-4176-befa-ce08acd09c01" containerName="payload-pre-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971682    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a939cb-c077-4e44-a2db-9827b03db65c" containerName="payload-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971688    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f790790-63d8-4b44-8d6d-da559f398069" containerName="payload-processing"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971695    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="65adf407-0dda-4a3f-9428-c662bfcd369e" containerName="main"
Sep 18 21:33:12.971732 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.971700    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e682dd-a9c1-4176-befa-ce08acd09c01" containerName="payload-pre-processing"
Sep 18 21:33:12.976397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.976377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:12.981793 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.981770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:33:12.982001 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.981983    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:33:12.997283 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:12.997242    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"]
Sep 18 21:33:13.031648 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:13.031612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f78752-f1fb-4f01-8c8c-acd435849fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk\" (UID: \"c8f78752-f1fb-4f01-8c8c-acd435849fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:13.133048 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:13.133003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f78752-f1fb-4f01-8c8c-acd435849fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk\" (UID: \"c8f78752-f1fb-4f01-8c8c-acd435849fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:13.133649 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:13.133630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f78752-f1fb-4f01-8c8c-acd435849fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk\" (UID: \"c8f78752-f1fb-4f01-8c8c-acd435849fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:13.286683 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:13.286600    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:13.570115 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:13.570082    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"]
Sep 18 21:33:13.572169 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:33:13.572139    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f78752_f1fb_4f01_8c8c_acd435849fa3.slice/crio-daf1a2782b70a0d0ad777f519642a29cdbbbf3abbb46ba51d66ee9ea88606b8d WatchSource:0}: Error finding container daf1a2782b70a0d0ad777f519642a29cdbbbf3abbb46ba51d66ee9ea88606b8d: Status 404 returned error can't find the container with id daf1a2782b70a0d0ad777f519642a29cdbbbf3abbb46ba51d66ee9ea88606b8d
Sep 18 21:33:14.028307 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:14.028270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk" event={"ID":"c8f78752-f1fb-4f01-8c8c-acd435849fa3","Type":"ContainerStarted","Data":"8c0b6daf05d774cabf15c9b7e99096ac4b3806c54d042cc1898f1253283fc3ff"}
Sep 18 21:33:14.028696 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:14.028325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk" event={"ID":"c8f78752-f1fb-4f01-8c8c-acd435849fa3","Type":"ContainerStarted","Data":"daf1a2782b70a0d0ad777f519642a29cdbbbf3abbb46ba51d66ee9ea88606b8d"}
Sep 18 21:33:14.045860 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:14.045805    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk" podStartSLOduration=2.045782923 podStartE2EDuration="2.045782923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:33:14.044613093 +0000 UTC m=+1627.507392448" watchObservedRunningTime="2026-09-18 21:33:14.045782923 +0000 UTC m=+1627.508562281"
Sep 18 21:33:15.035161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:15.035116    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8f78752-f1fb-4f01-8c8c-acd435849fa3" containerID="8c0b6daf05d774cabf15c9b7e99096ac4b3806c54d042cc1898f1253283fc3ff" exitCode=0
Sep 18 21:33:15.035550 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:15.035212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk" event={"ID":"c8f78752-f1fb-4f01-8c8c-acd435849fa3","Type":"ContainerDied","Data":"8c0b6daf05d774cabf15c9b7e99096ac4b3806c54d042cc1898f1253283fc3ff"}
Sep 18 21:33:16.172533 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:16.172505    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:16.261683 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:16.261644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f78752-f1fb-4f01-8c8c-acd435849fa3-maas-api-service-ca\") pod \"c8f78752-f1fb-4f01-8c8c-acd435849fa3\" (UID: \"c8f78752-f1fb-4f01-8c8c-acd435849fa3\") "
Sep 18 21:33:16.262044 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:16.262018    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f78752-f1fb-4f01-8c8c-acd435849fa3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8f78752-f1fb-4f01-8c8c-acd435849fa3" (UID: "c8f78752-f1fb-4f01-8c8c-acd435849fa3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:16.362678 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:16.362634    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f78752-f1fb-4f01-8c8c-acd435849fa3-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:17.046638 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:17.046561    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"
Sep 18 21:33:17.046638 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:17.046590    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk" event={"ID":"c8f78752-f1fb-4f01-8c8c-acd435849fa3","Type":"ContainerDied","Data":"daf1a2782b70a0d0ad777f519642a29cdbbbf3abbb46ba51d66ee9ea88606b8d"}
Sep 18 21:33:17.046638 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:17.046632    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daf1a2782b70a0d0ad777f519642a29cdbbbf3abbb46ba51d66ee9ea88606b8d"
Sep 18 21:33:19.010029 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:19.009979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:33:23.911295 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:23.911253    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"]
Sep 18 21:33:23.911718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:23.911531    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx" podUID="787fe9aa-c105-4964-8c4a-e629e78c4208" containerName="payload-processing" containerID="cri-o://51cbf329964afb37388d84778e22c6f1647e366a629f751c00dc4831f9e25983" gracePeriod=30
Sep 18 21:33:23.919163 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:23.919137    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"]
Sep 18 21:33:23.919376 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:23.919336    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p" podUID="5489e4f9-9686-4895-8073-737ec60adbbf" containerName="payload-pre-processing" containerID="cri-o://aef17a57e46979f67ea4eb4a944b759736b5a5d72439978b9cd938468aee31ae" gracePeriod=30
Sep 18 21:33:24.083224 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.083191    2576 generic.go:356] "Generic (PLEG): container finished" podID="787fe9aa-c105-4964-8c4a-e629e78c4208" containerID="51cbf329964afb37388d84778e22c6f1647e366a629f751c00dc4831f9e25983" exitCode=0
Sep 18 21:33:24.083397 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.083272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx" event={"ID":"787fe9aa-c105-4964-8c4a-e629e78c4208","Type":"ContainerDied","Data":"51cbf329964afb37388d84778e22c6f1647e366a629f751c00dc4831f9e25983"}
Sep 18 21:33:24.085119 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.085093    2576 generic.go:356] "Generic (PLEG): container finished" podID="5489e4f9-9686-4895-8073-737ec60adbbf" containerID="aef17a57e46979f67ea4eb4a944b759736b5a5d72439978b9cd938468aee31ae" exitCode=0
Sep 18 21:33:24.085254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.085164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p" event={"ID":"5489e4f9-9686-4895-8073-737ec60adbbf","Type":"ContainerDied","Data":"aef17a57e46979f67ea4eb4a944b759736b5a5d72439978b9cd938468aee31ae"}
Sep 18 21:33:24.207654 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.207616    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:33:24.210934 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.210910    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:33:24.246392 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.246357    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"]
Sep 18 21:33:24.271016 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.270981    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1b65ac-fkbxk"]
Sep 18 21:33:24.336855 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.336819    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7l4m\" (UniqueName: \"kubernetes.io/projected/5489e4f9-9686-4895-8073-737ec60adbbf-kube-api-access-v7l4m\") pod \"5489e4f9-9686-4895-8073-737ec60adbbf\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") "
Sep 18 21:33:24.337048 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.336898    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787fe9aa-c105-4964-8c4a-e629e78c4208-plugins-config-volume\") pod \"787fe9aa-c105-4964-8c4a-e629e78c4208\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") "
Sep 18 21:33:24.337048 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.336926    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5489e4f9-9686-4895-8073-737ec60adbbf-plugins-config-volume\") pod \"5489e4f9-9686-4895-8073-737ec60adbbf\" (UID: \"5489e4f9-9686-4895-8073-737ec60adbbf\") "
Sep 18 21:33:24.337048 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.336980    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlvvd\" (UniqueName: \"kubernetes.io/projected/787fe9aa-c105-4964-8c4a-e629e78c4208-kube-api-access-nlvvd\") pod \"787fe9aa-c105-4964-8c4a-e629e78c4208\" (UID: \"787fe9aa-c105-4964-8c4a-e629e78c4208\") "
Sep 18 21:33:24.337331 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.337301    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/787fe9aa-c105-4964-8c4a-e629e78c4208-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "787fe9aa-c105-4964-8c4a-e629e78c4208" (UID: "787fe9aa-c105-4964-8c4a-e629e78c4208"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:24.337405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.337301    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5489e4f9-9686-4895-8073-737ec60adbbf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5489e4f9-9686-4895-8073-737ec60adbbf" (UID: "5489e4f9-9686-4895-8073-737ec60adbbf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:24.339239 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.339202    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787fe9aa-c105-4964-8c4a-e629e78c4208-kube-api-access-nlvvd" (OuterVolumeSpecName: "kube-api-access-nlvvd") pod "787fe9aa-c105-4964-8c4a-e629e78c4208" (UID: "787fe9aa-c105-4964-8c4a-e629e78c4208"). InnerVolumeSpecName "kube-api-access-nlvvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:24.339353 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.339249    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5489e4f9-9686-4895-8073-737ec60adbbf-kube-api-access-v7l4m" (OuterVolumeSpecName: "kube-api-access-v7l4m") pod "5489e4f9-9686-4895-8073-737ec60adbbf" (UID: "5489e4f9-9686-4895-8073-737ec60adbbf"). InnerVolumeSpecName "kube-api-access-v7l4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:24.437903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.437779    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787fe9aa-c105-4964-8c4a-e629e78c4208-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:24.437903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.437827    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5489e4f9-9686-4895-8073-737ec60adbbf-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:24.437903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.437840    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlvvd\" (UniqueName: \"kubernetes.io/projected/787fe9aa-c105-4964-8c4a-e629e78c4208-kube-api-access-nlvvd\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:24.437903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.437853    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7l4m\" (UniqueName: \"kubernetes.io/projected/5489e4f9-9686-4895-8073-737ec60adbbf-kube-api-access-v7l4m\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:24.742513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:24.742432    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f78752-f1fb-4f01-8c8c-acd435849fa3" path="/var/lib/kubelet/pods/c8f78752-f1fb-4f01-8c8c-acd435849fa3/volumes"
Sep 18 21:33:25.091533 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.091503    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"
Sep 18 21:33:25.092050 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.091532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx" event={"ID":"787fe9aa-c105-4964-8c4a-e629e78c4208","Type":"ContainerDied","Data":"cb1d00075525566507702570e481e2c184246768c18f52aa3745b500335884ef"}
Sep 18 21:33:25.092050 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.091614    2576 scope.go:117] "RemoveContainer" containerID="51cbf329964afb37388d84778e22c6f1647e366a629f751c00dc4831f9e25983"
Sep 18 21:33:25.093286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.093264    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"
Sep 18 21:33:25.093365 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.093260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p" event={"ID":"5489e4f9-9686-4895-8073-737ec60adbbf","Type":"ContainerDied","Data":"1bc24dbd375f253f719df222acad64cf4912066c2d60e64d2be5b8b6d3416c2f"}
Sep 18 21:33:25.101061 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.101041    2576 scope.go:117] "RemoveContainer" containerID="aef17a57e46979f67ea4eb4a944b759736b5a5d72439978b9cd938468aee31ae"
Sep 18 21:33:25.136050 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.136013    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"]
Sep 18 21:33:25.146605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.146569    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx"]
Sep 18 21:33:25.173345 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.173302    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"]
Sep 18 21:33:25.175104 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:25.175075    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p"]
Sep 18 21:33:26.740574 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:26.740536    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5489e4f9-9686-4895-8073-737ec60adbbf" path="/var/lib/kubelet/pods/5489e4f9-9686-4895-8073-737ec60adbbf/volumes"
Sep 18 21:33:26.741118 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:26.741084    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="787fe9aa-c105-4964-8c4a-e629e78c4208" path="/var/lib/kubelet/pods/787fe9aa-c105-4964-8c4a-e629e78c4208/volumes"
Sep 18 21:33:30.974695 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.974651    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"]
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975008    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787fe9aa-c105-4964-8c4a-e629e78c4208" containerName="payload-processing"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975020    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="787fe9aa-c105-4964-8c4a-e629e78c4208" containerName="payload-processing"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975029    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5489e4f9-9686-4895-8073-737ec60adbbf" containerName="payload-pre-processing"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975036    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5489e4f9-9686-4895-8073-737ec60adbbf" containerName="payload-pre-processing"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975049    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f78752-f1fb-4f01-8c8c-acd435849fa3" containerName="revoke-keys"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975055    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f78752-f1fb-4f01-8c8c-acd435849fa3" containerName="revoke-keys"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975103    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="787fe9aa-c105-4964-8c4a-e629e78c4208" containerName="payload-processing"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975112    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f78752-f1fb-4f01-8c8c-acd435849fa3" containerName="revoke-keys"
Sep 18 21:33:30.975229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.975120    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5489e4f9-9686-4895-8073-737ec60adbbf" containerName="payload-pre-processing"
Sep 18 21:33:30.979770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.979743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:30.982603 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.982575    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:33:30.982603 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.982594    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:33:30.987919 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:30.987189    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"]
Sep 18 21:33:31.101978 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.101940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75b0e282-632b-4ab7-b359-433f096baf96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm\" (UID: \"75b0e282-632b-4ab7-b359-433f096baf96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:31.202538 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.202495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75b0e282-632b-4ab7-b359-433f096baf96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm\" (UID: \"75b0e282-632b-4ab7-b359-433f096baf96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:31.203147 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.203125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75b0e282-632b-4ab7-b359-433f096baf96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm\" (UID: \"75b0e282-632b-4ab7-b359-433f096baf96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:31.291420 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.291339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:31.487817 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.487779    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-907674"]
Sep 18 21:33:31.492404 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.492384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:31.495500 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.495482    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zrg6b\""
Sep 18 21:33:31.506067 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.506016    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-907674"]
Sep 18 21:33:31.571390 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.571362    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"]
Sep 18 21:33:31.573280 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:33:31.573245    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b0e282_632b_4ab7_b359_433f096baf96.slice/crio-149c4cab1099987a88273a8d4e6d94acbe5bdcee88595594c4e9154cd642f9e1 WatchSource:0}: Error finding container 149c4cab1099987a88273a8d4e6d94acbe5bdcee88595594c4e9154cd642f9e1: Status 404 returned error can't find the container with id 149c4cab1099987a88273a8d4e6d94acbe5bdcee88595594c4e9154cd642f9e1
Sep 18 21:33:31.607005 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.606974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsb9\" (UniqueName: \"kubernetes.io/projected/0a6d72b5-9ba9-4ea8-9593-98b114417118-kube-api-access-6wsb9\") pod \"test-curl-7870-907674\" (UID: \"0a6d72b5-9ba9-4ea8-9593-98b114417118\") " pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:31.708365 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.708322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsb9\" (UniqueName: \"kubernetes.io/projected/0a6d72b5-9ba9-4ea8-9593-98b114417118-kube-api-access-6wsb9\") pod \"test-curl-7870-907674\" (UID: \"0a6d72b5-9ba9-4ea8-9593-98b114417118\") " pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:31.716831 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.716796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsb9\" (UniqueName: \"kubernetes.io/projected/0a6d72b5-9ba9-4ea8-9593-98b114417118-kube-api-access-6wsb9\") pod \"test-curl-7870-907674\" (UID: \"0a6d72b5-9ba9-4ea8-9593-98b114417118\") " pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:31.801331 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:31.801285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:32.074792 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:32.074764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-907674"]
Sep 18 21:33:32.077034 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:33:32.077007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a6d72b5_9ba9_4ea8_9593_98b114417118.slice/crio-8e8e4ca2114232c48c59c1d6d9f7bc6facddec0582be37d76136ee2c1463262b WatchSource:0}: Error finding container 8e8e4ca2114232c48c59c1d6d9f7bc6facddec0582be37d76136ee2c1463262b: Status 404 returned error can't find the container with id 8e8e4ca2114232c48c59c1d6d9f7bc6facddec0582be37d76136ee2c1463262b
Sep 18 21:33:32.131835 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:32.131802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-907674" event={"ID":"0a6d72b5-9ba9-4ea8-9593-98b114417118","Type":"ContainerStarted","Data":"8e8e4ca2114232c48c59c1d6d9f7bc6facddec0582be37d76136ee2c1463262b"}
Sep 18 21:33:32.133629 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:32.133595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm" event={"ID":"75b0e282-632b-4ab7-b359-433f096baf96","Type":"ContainerStarted","Data":"3383f00e25fdca0a2e988c860d3f53519895d7aacd6ab45f97f7db5f070abf8d"}
Sep 18 21:33:32.133764 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:32.133660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm" event={"ID":"75b0e282-632b-4ab7-b359-433f096baf96","Type":"ContainerStarted","Data":"149c4cab1099987a88273a8d4e6d94acbe5bdcee88595594c4e9154cd642f9e1"}
Sep 18 21:33:32.152405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:32.152346    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm" podStartSLOduration=2.152326659 podStartE2EDuration="2.152326659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:33:32.150424346 +0000 UTC m=+1645.613203700" watchObservedRunningTime="2026-09-18 21:33:32.152326659 +0000 UTC m=+1645.615106072"
Sep 18 21:33:33.140448 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.140414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-907674" event={"ID":"0a6d72b5-9ba9-4ea8-9593-98b114417118","Type":"ContainerStarted","Data":"0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a"}
Sep 18 21:33:33.142031 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.141995    2576 generic.go:356] "Generic (PLEG): container finished" podID="75b0e282-632b-4ab7-b359-433f096baf96" containerID="3383f00e25fdca0a2e988c860d3f53519895d7aacd6ab45f97f7db5f070abf8d" exitCode=0
Sep 18 21:33:33.142145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.142091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm" event={"ID":"75b0e282-632b-4ab7-b359-433f096baf96","Type":"ContainerDied","Data":"3383f00e25fdca0a2e988c860d3f53519895d7aacd6ab45f97f7db5f070abf8d"}
Sep 18 21:33:33.156022 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.155967    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7870-907674" podStartSLOduration=2.155951898 podStartE2EDuration="2.155951898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:33:33.155751584 +0000 UTC m=+1646.618530940" watchObservedRunningTime="2026-09-18 21:33:33.155951898 +0000 UTC m=+1646.618731265"
Sep 18 21:33:33.783954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.783910    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-907674"]
Sep 18 21:33:33.788415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.788386    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-907674"]
Sep 18 21:33:33.908906 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.908854    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-572248"]
Sep 18 21:33:33.909733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.909699    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" containerName="test-curl-7870-907674"
Sep 18 21:33:33.909733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.909726    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" containerName="test-curl-7870-907674"
Sep 18 21:33:33.909920 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.909877    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" containerName="test-curl-7870-907674"
Sep 18 21:33:33.913716 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.913691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:33.918868 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.918836    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-572248"]
Sep 18 21:33:33.930329 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:33.930296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h52ks\" (UniqueName: \"kubernetes.io/projected/18074e60-0d19-4b72-8041-ba63eb58e50e-kube-api-access-h52ks\") pod \"test-curl-7870-572248\" (UID: \"18074e60-0d19-4b72-8041-ba63eb58e50e\") " pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:34.031215 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.031179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h52ks\" (UniqueName: \"kubernetes.io/projected/18074e60-0d19-4b72-8041-ba63eb58e50e-kube-api-access-h52ks\") pod \"test-curl-7870-572248\" (UID: \"18074e60-0d19-4b72-8041-ba63eb58e50e\") " pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:34.040460 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.040425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h52ks\" (UniqueName: \"kubernetes.io/projected/18074e60-0d19-4b72-8041-ba63eb58e50e-kube-api-access-h52ks\") pod \"test-curl-7870-572248\" (UID: \"18074e60-0d19-4b72-8041-ba63eb58e50e\") " pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:34.147195 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:34.147157    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7870-907674" container="test-curl-7870-907674"
Sep 18 21:33:34.225184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.225139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:34.286807 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.286776    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:34.332826 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.332789    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75b0e282-632b-4ab7-b359-433f096baf96-maas-api-service-ca\") pod \"75b0e282-632b-4ab7-b359-433f096baf96\" (UID: \"75b0e282-632b-4ab7-b359-433f096baf96\") "
Sep 18 21:33:34.333179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.333155    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b0e282-632b-4ab7-b359-433f096baf96-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "75b0e282-632b-4ab7-b359-433f096baf96" (UID: "75b0e282-632b-4ab7-b359-433f096baf96"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:34.433589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.433553    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75b0e282-632b-4ab7-b359-433f096baf96-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:34.501770 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:34.501742    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-572248"]
Sep 18 21:33:34.503701 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:33:34.503671    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18074e60_0d19_4b72_8041_ba63eb58e50e.slice/crio-6532fe60c28b708705d7e862e8c2e1e97a452ec3e95b64856addbf7fe227fd6f WatchSource:0}: Error finding container 6532fe60c28b708705d7e862e8c2e1e97a452ec3e95b64856addbf7fe227fd6f: Status 404 returned error can't find the container with id 6532fe60c28b708705d7e862e8c2e1e97a452ec3e95b64856addbf7fe227fd6f
Sep 18 21:33:35.153378 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.153342    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-572248" event={"ID":"18074e60-0d19-4b72-8041-ba63eb58e50e","Type":"ContainerStarted","Data":"f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4"}
Sep 18 21:33:35.153378 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.153384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-572248" event={"ID":"18074e60-0d19-4b72-8041-ba63eb58e50e","Type":"ContainerStarted","Data":"6532fe60c28b708705d7e862e8c2e1e97a452ec3e95b64856addbf7fe227fd6f"}
Sep 18 21:33:35.154871 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.154848    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"
Sep 18 21:33:35.154973 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.154878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm" event={"ID":"75b0e282-632b-4ab7-b359-433f096baf96","Type":"ContainerDied","Data":"149c4cab1099987a88273a8d4e6d94acbe5bdcee88595594c4e9154cd642f9e1"}
Sep 18 21:33:35.154973 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.154944    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="149c4cab1099987a88273a8d4e6d94acbe5bdcee88595594c4e9154cd642f9e1"
Sep 18 21:33:35.154973 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.154938    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7870-907674" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" containerName="test-curl-7870-907674" containerID="cri-o://0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a" gracePeriod=2
Sep 18 21:33:35.179245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.179186    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7870-572248" podStartSLOduration=2.179168762 podStartE2EDuration="2.179168762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:33:35.178513642 +0000 UTC m=+1648.641293000" watchObservedRunningTime="2026-09-18 21:33:35.179168762 +0000 UTC m=+1648.641948117"
Sep 18 21:33:35.818290 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.818200    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-572248"]
Sep 18 21:33:35.826764 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:35.826733    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-572248"]
Sep 18 21:33:36.159981 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:36.159950    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7870-572248" container="test-curl-7870-572248"
Sep 18 21:33:36.602052 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:36.602000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:33:37.164603 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:37.164566    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7870-572248" podUID="18074e60-0d19-4b72-8041-ba63eb58e50e" containerName="test-curl-7870-572248" containerID="cri-o://f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4" gracePeriod=2
Sep 18 21:33:37.297302 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:37.297273    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:37.355633 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:37.355597    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wsb9\" (UniqueName: \"kubernetes.io/projected/0a6d72b5-9ba9-4ea8-9593-98b114417118-kube-api-access-6wsb9\") pod \"0a6d72b5-9ba9-4ea8-9593-98b114417118\" (UID: \"0a6d72b5-9ba9-4ea8-9593-98b114417118\") "
Sep 18 21:33:37.357767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:37.357734    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6d72b5-9ba9-4ea8-9593-98b114417118-kube-api-access-6wsb9" (OuterVolumeSpecName: "kube-api-access-6wsb9") pod "0a6d72b5-9ba9-4ea8-9593-98b114417118" (UID: "0a6d72b5-9ba9-4ea8-9593-98b114417118"). InnerVolumeSpecName "kube-api-access-6wsb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:37.456314 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:37.456217    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wsb9\" (UniqueName: \"kubernetes.io/projected/0a6d72b5-9ba9-4ea8-9593-98b114417118-kube-api-access-6wsb9\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:38.170734 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:38.170697    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a6d72b5-9ba9-4ea8-9593-98b114417118" containerID="0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a" exitCode=137
Sep 18 21:33:38.170734 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:38.170740    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:38.171246 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:38.170797    2576 scope.go:117] "RemoveContainer" containerID="0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a"
Sep 18 21:33:38.180394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:38.180374    2576 scope.go:117] "RemoveContainer" containerID="0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a"
Sep 18 21:33:38.180756 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:38.180735    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a\": container with ID starting with 0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a not found: ID does not exist" containerID="0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a"
Sep 18 21:33:38.180814 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:38.180768    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a"} err="failed to get container status \"0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a\": rpc error: code = NotFound desc = could not find container \"0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a\": container with ID starting with 0abb47d16ac4b61ad30eb4c2cf5a560e1c15a3555735640940ae13aec33b181a not found: ID does not exist"
Sep 18 21:33:38.181643 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:38.181618    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-907674\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:38.740791 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:38.740753    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-907674\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" pod="opendatahub/test-curl-7870-907674"
Sep 18 21:33:38.741935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:38.741911    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6d72b5-9ba9-4ea8-9593-98b114417118" path="/var/lib/kubelet/pods/0a6d72b5-9ba9-4ea8-9593-98b114417118/volumes"
Sep 18 21:33:39.352901 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:39.352860    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:39.370692 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:39.370658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h52ks\" (UniqueName: \"kubernetes.io/projected/18074e60-0d19-4b72-8041-ba63eb58e50e-kube-api-access-h52ks\") pod \"18074e60-0d19-4b72-8041-ba63eb58e50e\" (UID: \"18074e60-0d19-4b72-8041-ba63eb58e50e\") "
Sep 18 21:33:39.372771 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:39.372739    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18074e60-0d19-4b72-8041-ba63eb58e50e-kube-api-access-h52ks" (OuterVolumeSpecName: "kube-api-access-h52ks") pod "18074e60-0d19-4b72-8041-ba63eb58e50e" (UID: "18074e60-0d19-4b72-8041-ba63eb58e50e"). InnerVolumeSpecName "kube-api-access-h52ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:39.471532 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:39.471436    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h52ks\" (UniqueName: \"kubernetes.io/projected/18074e60-0d19-4b72-8041-ba63eb58e50e-kube-api-access-h52ks\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:40.182354 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:40.182312    2576 generic.go:356] "Generic (PLEG): container finished" podID="18074e60-0d19-4b72-8041-ba63eb58e50e" containerID="f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4" exitCode=137
Sep 18 21:33:40.182354 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:40.182358    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:40.182597 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:40.182416    2576 scope.go:117] "RemoveContainer" containerID="f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4"
Sep 18 21:33:40.191330 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:40.191309    2576 scope.go:117] "RemoveContainer" containerID="f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4"
Sep 18 21:33:40.191672 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:40.191655    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4\": container with ID starting with f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4 not found: ID does not exist" containerID="f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4"
Sep 18 21:33:40.191724 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:40.191682    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4"} err="failed to get container status \"f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4\": rpc error: code = NotFound desc = could not find container \"f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4\": container with ID starting with f1650f381f2565916782953b7c75b6b80b686798a376b443acc2fecb34f7d2c4 not found: ID does not exist"
Sep 18 21:33:40.192848 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:40.192826    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-572248\" is forbidden: User \"system:node:ip-10-0-132-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-35.ec2.internal' and this object" podUID="18074e60-0d19-4b72-8041-ba63eb58e50e" pod="opendatahub/test-curl-7870-572248"
Sep 18 21:33:40.740352 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:40.740311    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18074e60-0d19-4b72-8041-ba63eb58e50e" path="/var/lib/kubelet/pods/18074e60-0d19-4b72-8041-ba63eb58e50e/volumes"
Sep 18 21:33:41.768525 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:41.768481    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"]
Sep 18 21:33:41.769096 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:41.768755    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm" podUID="0d501008-3326-4c51-91d0-e99aaacd0098" containerName="payload-processing" containerID="cri-o://222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c" gracePeriod=30
Sep 18 21:33:41.774790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:41.774203    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"]
Sep 18 21:33:41.774790 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:41.774439    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n" podUID="ff70fb5c-81e0-4627-8007-f7529f0b8db3" containerName="payload-pre-processing" containerID="cri-o://e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4" gracePeriod=30
Sep 18 21:33:41.935939 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:41.935900    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"]
Sep 18 21:33:41.938193 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:41.938159    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-514a1a-rdvdm"]
Sep 18 21:33:42.058878 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.058851    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:33:42.061900 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.061861    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:33:42.193376 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.193341    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srhp4\" (UniqueName: \"kubernetes.io/projected/ff70fb5c-81e0-4627-8007-f7529f0b8db3-kube-api-access-srhp4\") pod \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") "
Sep 18 21:33:42.193376 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.193374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d501008-3326-4c51-91d0-e99aaacd0098-plugins-config-volume\") pod \"0d501008-3326-4c51-91d0-e99aaacd0098\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") "
Sep 18 21:33:42.193644 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.193411    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndqkn\" (UniqueName: \"kubernetes.io/projected/0d501008-3326-4c51-91d0-e99aaacd0098-kube-api-access-ndqkn\") pod \"0d501008-3326-4c51-91d0-e99aaacd0098\" (UID: \"0d501008-3326-4c51-91d0-e99aaacd0098\") "
Sep 18 21:33:42.193644 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.193591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff70fb5c-81e0-4627-8007-f7529f0b8db3-plugins-config-volume\") pod \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\" (UID: \"ff70fb5c-81e0-4627-8007-f7529f0b8db3\") "
Sep 18 21:33:42.193817 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.193789    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d501008-3326-4c51-91d0-e99aaacd0098-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d501008-3326-4c51-91d0-e99aaacd0098" (UID: "0d501008-3326-4c51-91d0-e99aaacd0098"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:42.194038 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.194013    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d501008-3326-4c51-91d0-e99aaacd0098-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:42.194038 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.194005    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff70fb5c-81e0-4627-8007-f7529f0b8db3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff70fb5c-81e0-4627-8007-f7529f0b8db3" (UID: "ff70fb5c-81e0-4627-8007-f7529f0b8db3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:33:42.195786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.195756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff70fb5c-81e0-4627-8007-f7529f0b8db3-kube-api-access-srhp4" (OuterVolumeSpecName: "kube-api-access-srhp4") pod "ff70fb5c-81e0-4627-8007-f7529f0b8db3" (UID: "ff70fb5c-81e0-4627-8007-f7529f0b8db3"). InnerVolumeSpecName "kube-api-access-srhp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:42.195937 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.195864    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d501008-3326-4c51-91d0-e99aaacd0098-kube-api-access-ndqkn" (OuterVolumeSpecName: "kube-api-access-ndqkn") pod "0d501008-3326-4c51-91d0-e99aaacd0098" (UID: "0d501008-3326-4c51-91d0-e99aaacd0098"). InnerVolumeSpecName "kube-api-access-ndqkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:33:42.196303 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.196280    2576 generic.go:356] "Generic (PLEG): container finished" podID="ff70fb5c-81e0-4627-8007-f7529f0b8db3" containerID="e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4" exitCode=0
Sep 18 21:33:42.196356 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.196329    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"
Sep 18 21:33:42.196393 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.196358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n" event={"ID":"ff70fb5c-81e0-4627-8007-f7529f0b8db3","Type":"ContainerDied","Data":"e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4"}
Sep 18 21:33:42.196434 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.196415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n" event={"ID":"ff70fb5c-81e0-4627-8007-f7529f0b8db3","Type":"ContainerDied","Data":"20b2a744810654315394d17937a4f0e9ccffb70f6e6f89d875708525949d0990"}
Sep 18 21:33:42.196470 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.196446    2576 scope.go:117] "RemoveContainer" containerID="e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4"
Sep 18 21:33:42.198061 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.198024    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d501008-3326-4c51-91d0-e99aaacd0098" containerID="222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c" exitCode=0
Sep 18 21:33:42.198172 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.198077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm" event={"ID":"0d501008-3326-4c51-91d0-e99aaacd0098","Type":"ContainerDied","Data":"222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c"}
Sep 18 21:33:42.198172 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.198119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"
Sep 18 21:33:42.198172 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.198123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm" event={"ID":"0d501008-3326-4c51-91d0-e99aaacd0098","Type":"ContainerDied","Data":"82366dab4f0f7a521776b4db34686f9bb2ed196f3eed7bad9f0493eead09569b"}
Sep 18 21:33:42.206750 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.206727    2576 scope.go:117] "RemoveContainer" containerID="e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4"
Sep 18 21:33:42.207150 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:42.207127    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4\": container with ID starting with e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4 not found: ID does not exist" containerID="e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4"
Sep 18 21:33:42.207275 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.207157    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4"} err="failed to get container status \"e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4\": rpc error: code = NotFound desc = could not find container \"e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4\": container with ID starting with e7ad53c3a8a7e5fc043a6f1ac43edbf435ed2d9ecf793203a24b063ddf7707d4 not found: ID does not exist"
Sep 18 21:33:42.207275 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.207178    2576 scope.go:117] "RemoveContainer" containerID="222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c"
Sep 18 21:33:42.216064 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.216045    2576 scope.go:117] "RemoveContainer" containerID="222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c"
Sep 18 21:33:42.216401 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:33:42.216381    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c\": container with ID starting with 222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c not found: ID does not exist" containerID="222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c"
Sep 18 21:33:42.216455 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.216411    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c"} err="failed to get container status \"222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c\": rpc error: code = NotFound desc = could not find container \"222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c\": container with ID starting with 222d7370033601f196ea242f63a926bd65cd4cc52c9686631a4277b4ead5ff8c not found: ID does not exist"
Sep 18 21:33:42.225454 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.225419    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"]
Sep 18 21:33:42.229752 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.229719    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm"]
Sep 18 21:33:42.242501 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.242468    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"]
Sep 18 21:33:42.252836 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.252800    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n"]
Sep 18 21:33:42.294767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.294673    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff70fb5c-81e0-4627-8007-f7529f0b8db3-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:42.294767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.294708    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srhp4\" (UniqueName: \"kubernetes.io/projected/ff70fb5c-81e0-4627-8007-f7529f0b8db3-kube-api-access-srhp4\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:42.294767 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.294718    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndqkn\" (UniqueName: \"kubernetes.io/projected/0d501008-3326-4c51-91d0-e99aaacd0098-kube-api-access-ndqkn\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:33:42.740983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.740945    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d501008-3326-4c51-91d0-e99aaacd0098" path="/var/lib/kubelet/pods/0d501008-3326-4c51-91d0-e99aaacd0098/volumes"
Sep 18 21:33:42.741294 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.741282    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b0e282-632b-4ab7-b359-433f096baf96" path="/var/lib/kubelet/pods/75b0e282-632b-4ab7-b359-433f096baf96/volumes"
Sep 18 21:33:42.741599 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:42.741585    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff70fb5c-81e0-4627-8007-f7529f0b8db3" path="/var/lib/kubelet/pods/ff70fb5c-81e0-4627-8007-f7529f0b8db3/volumes"
Sep 18 21:33:48.241149 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:33:48.241104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:34:05.324677 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:34:05.324638    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:34:46.723502 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:34:46.723455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:35:17.495363 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:17.495328    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:35:27.129292 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:27.129256    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:35:37.589560 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:37.589526    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:35:41.705760 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.705719    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"]
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706068    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d501008-3326-4c51-91d0-e99aaacd0098" containerName="payload-processing"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706081    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d501008-3326-4c51-91d0-e99aaacd0098" containerName="payload-processing"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706095    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff70fb5c-81e0-4627-8007-f7529f0b8db3" containerName="payload-pre-processing"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706101    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff70fb5c-81e0-4627-8007-f7529f0b8db3" containerName="payload-pre-processing"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706108    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18074e60-0d19-4b72-8041-ba63eb58e50e" containerName="test-curl-7870-572248"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706115    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18074e60-0d19-4b72-8041-ba63eb58e50e" containerName="test-curl-7870-572248"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706122    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b0e282-632b-4ab7-b359-433f096baf96" containerName="revoke-keys"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706127    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b0e282-632b-4ab7-b359-433f096baf96" containerName="revoke-keys"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706178    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff70fb5c-81e0-4627-8007-f7529f0b8db3" containerName="payload-pre-processing"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706186    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d501008-3326-4c51-91d0-e99aaacd0098" containerName="payload-processing"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706193    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="75b0e282-632b-4ab7-b359-433f096baf96" containerName="revoke-keys"
Sep 18 21:35:41.706203 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.706198    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="18074e60-0d19-4b72-8041-ba63eb58e50e" containerName="test-curl-7870-572248"
Sep 18 21:35:41.709226 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.709205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:41.711759 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.711733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-5888e6-dockercfg-4wc8k\""
Sep 18 21:35:41.711904 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.711801    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-5888e6\""
Sep 18 21:35:41.724963 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.724934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"]
Sep 18 21:35:41.738171 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.738140    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"]
Sep 18 21:35:41.741258 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.741240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:41.751125 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.751094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"]
Sep 18 21:35:41.895446 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.895409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcbbl\" (UniqueName: \"kubernetes.io/projected/dbbef7fd-4b40-401c-bd29-e0759669e174-kube-api-access-gcbbl\") pod \"payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:41.895446 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.895449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsmd\" (UniqueName: \"kubernetes.io/projected/870b185d-f72c-416f-9d95-37e105a74807-kube-api-access-8dsmd\") pod \"payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:41.895699 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.895469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870b185d-f72c-416f-9d95-37e105a74807-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:41.895699 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.895517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbbef7fd-4b40-401c-bd29-e0759669e174-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:41.996853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.996749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbbl\" (UniqueName: \"kubernetes.io/projected/dbbef7fd-4b40-401c-bd29-e0759669e174-kube-api-access-gcbbl\") pod \"payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:41.996853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.996790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsmd\" (UniqueName: \"kubernetes.io/projected/870b185d-f72c-416f-9d95-37e105a74807-kube-api-access-8dsmd\") pod \"payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:41.996853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.996811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870b185d-f72c-416f-9d95-37e105a74807-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:41.997130 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.996927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbbef7fd-4b40-401c-bd29-e0759669e174-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:41.997659 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.997641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbbef7fd-4b40-401c-bd29-e0759669e174-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:41.997697 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:41.997648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870b185d-f72c-416f-9d95-37e105a74807-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:42.005496 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.005457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsmd\" (UniqueName: \"kubernetes.io/projected/870b185d-f72c-416f-9d95-37e105a74807-kube-api-access-8dsmd\") pod \"payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:42.005619 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.005459    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcbbl\" (UniqueName: \"kubernetes.io/projected/dbbef7fd-4b40-401c-bd29-e0759669e174-kube-api-access-gcbbl\") pod \"payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:42.019292 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.019259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:42.052661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.052623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:42.301803 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.301770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"]
Sep 18 21:35:42.304138 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:35:42.304110    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870b185d_f72c_416f_9d95_37e105a74807.slice/crio-2347e189bcd6ca30bd470bef5db36c6fb83dff0c89ce8ed8823d243ac5c3e026 WatchSource:0}: Error finding container 2347e189bcd6ca30bd470bef5db36c6fb83dff0c89ce8ed8823d243ac5c3e026: Status 404 returned error can't find the container with id 2347e189bcd6ca30bd470bef5db36c6fb83dff0c89ce8ed8823d243ac5c3e026
Sep 18 21:35:42.335954 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.335925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"]
Sep 18 21:35:42.341121 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:35:42.341086    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbef7fd_4b40_401c_bd29_e0759669e174.slice/crio-1f15e4cbb58141a3b79d543b56c08f2ab02a87597c6d95341123209a65c1a65e WatchSource:0}: Error finding container 1f15e4cbb58141a3b79d543b56c08f2ab02a87597c6d95341123209a65c1a65e: Status 404 returned error can't find the container with id 1f15e4cbb58141a3b79d543b56c08f2ab02a87597c6d95341123209a65c1a65e
Sep 18 21:35:42.773554 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.773512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf" event={"ID":"dbbef7fd-4b40-401c-bd29-e0759669e174","Type":"ContainerStarted","Data":"613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872"}
Sep 18 21:35:42.774092 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.773584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf" event={"ID":"dbbef7fd-4b40-401c-bd29-e0759669e174","Type":"ContainerStarted","Data":"1f15e4cbb58141a3b79d543b56c08f2ab02a87597c6d95341123209a65c1a65e"}
Sep 18 21:35:42.774092 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.773626    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:42.775284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.775261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc" event={"ID":"870b185d-f72c-416f-9d95-37e105a74807","Type":"ContainerStarted","Data":"4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e"}
Sep 18 21:35:42.775394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.775305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc" event={"ID":"870b185d-f72c-416f-9d95-37e105a74807","Type":"ContainerStarted","Data":"2347e189bcd6ca30bd470bef5db36c6fb83dff0c89ce8ed8823d243ac5c3e026"}
Sep 18 21:35:42.775394 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.775368    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:35:42.792645 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.792590    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf" podStartSLOduration=1.7925727500000002 podStartE2EDuration="1.79257275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:35:42.791078924 +0000 UTC m=+1776.253858283" watchObservedRunningTime="2026-09-18 21:35:42.79257275 +0000 UTC m=+1776.255352107"
Sep 18 21:35:42.807837 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:42.807774    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc" podStartSLOduration=1.807757209 podStartE2EDuration="1.807757209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:35:42.806936332 +0000 UTC m=+1776.269715687" watchObservedRunningTime="2026-09-18 21:35:42.807757209 +0000 UTC m=+1776.270536567"
Sep 18 21:35:53.293359 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:53.293319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:35:53.782422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:53.782387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:35:53.782601 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:35:53.782574    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:36:12.987460 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:12.987426    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"]
Sep 18 21:36:12.990937 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:12.990915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:12.993813 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:12.993783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-deac7a\""
Sep 18 21:36:12.993980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:12.993829    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-deac7a-dockercfg-9lfq5\""
Sep 18 21:36:13.003601 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.003570    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"]
Sep 18 21:36:13.037643 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.037601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15df7c39-73df-4072-a603-c4aa0a4fb7fa-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.037830 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.037707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrj56\" (UniqueName: \"kubernetes.io/projected/15df7c39-73df-4072-a603-c4aa0a4fb7fa-kube-api-access-mrj56\") pod \"payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.051281 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.051249    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"]
Sep 18 21:36:13.054488 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.054470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.065446 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.065415    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"]
Sep 18 21:36:13.138684 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.138643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d286df4a-fd60-464b-a234-e05e2604791f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.138874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.138695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15df7c39-73df-4072-a603-c4aa0a4fb7fa-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.138874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.138825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdqvx\" (UniqueName: \"kubernetes.io/projected/d286df4a-fd60-464b-a234-e05e2604791f-kube-api-access-sdqvx\") pod \"payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.138874 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.138859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrj56\" (UniqueName: \"kubernetes.io/projected/15df7c39-73df-4072-a603-c4aa0a4fb7fa-kube-api-access-mrj56\") pod \"payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.139403 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.139387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15df7c39-73df-4072-a603-c4aa0a4fb7fa-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.147180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.147149    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrj56\" (UniqueName: \"kubernetes.io/projected/15df7c39-73df-4072-a603-c4aa0a4fb7fa-kube-api-access-mrj56\") pod \"payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.240187 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.240098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdqvx\" (UniqueName: \"kubernetes.io/projected/d286df4a-fd60-464b-a234-e05e2604791f-kube-api-access-sdqvx\") pod \"payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.240187 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.240141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d286df4a-fd60-464b-a234-e05e2604791f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.240819 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.240799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d286df4a-fd60-464b-a234-e05e2604791f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.248121 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.248089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdqvx\" (UniqueName: \"kubernetes.io/projected/d286df4a-fd60-464b-a234-e05e2604791f-kube-api-access-sdqvx\") pod \"payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.302016 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.301979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.365245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.365209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.578598 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.578566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"]
Sep 18 21:36:13.581124 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:36:13.581092    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15df7c39_73df_4072_a603_c4aa0a4fb7fa.slice/crio-86e3d3c6a871dd4d10bafb340ddef05d025cd5e74233a20bcadb67be6e56288e WatchSource:0}: Error finding container 86e3d3c6a871dd4d10bafb340ddef05d025cd5e74233a20bcadb67be6e56288e: Status 404 returned error can't find the container with id 86e3d3c6a871dd4d10bafb340ddef05d025cd5e74233a20bcadb67be6e56288e
Sep 18 21:36:13.645585 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.645553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"]
Sep 18 21:36:13.648508 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:36:13.648478    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd286df4a_fd60_464b_a234_e05e2604791f.slice/crio-2e8ef2373e0d02e13614c60d36b0c43a11e648ba4bdd20447c757547478b2340 WatchSource:0}: Error finding container 2e8ef2373e0d02e13614c60d36b0c43a11e648ba4bdd20447c757547478b2340: Status 404 returned error can't find the container with id 2e8ef2373e0d02e13614c60d36b0c43a11e648ba4bdd20447c757547478b2340
Sep 18 21:36:13.928626 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.928512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd" event={"ID":"15df7c39-73df-4072-a603-c4aa0a4fb7fa","Type":"ContainerStarted","Data":"281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8"}
Sep 18 21:36:13.928626 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.928584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd" event={"ID":"15df7c39-73df-4072-a603-c4aa0a4fb7fa","Type":"ContainerStarted","Data":"86e3d3c6a871dd4d10bafb340ddef05d025cd5e74233a20bcadb67be6e56288e"}
Sep 18 21:36:13.928626 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.928618    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:13.930271 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.930240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j" event={"ID":"d286df4a-fd60-464b-a234-e05e2604791f","Type":"ContainerStarted","Data":"dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591"}
Sep 18 21:36:13.930415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.930295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j" event={"ID":"d286df4a-fd60-464b-a234-e05e2604791f","Type":"ContainerStarted","Data":"2e8ef2373e0d02e13614c60d36b0c43a11e648ba4bdd20447c757547478b2340"}
Sep 18 21:36:13.930415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.930323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:13.952842 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.952790    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd" podStartSLOduration=1.9527732549999999 podStartE2EDuration="1.952773255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:36:13.95177649 +0000 UTC m=+1807.414555852" watchObservedRunningTime="2026-09-18 21:36:13.952773255 +0000 UTC m=+1807.415552612"
Sep 18 21:36:13.970417 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:13.970363    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j" podStartSLOduration=0.970345183 podStartE2EDuration="970.345183ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:36:13.968332521 +0000 UTC m=+1807.431111871" watchObservedRunningTime="2026-09-18 21:36:13.970345183 +0000 UTC m=+1807.433124592"
Sep 18 21:36:16.439231 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:16.439193    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:36:24.936626 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:24.936597    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:36:24.937137 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:24.936857    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:36:43.013477 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:43.013431    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd_15df7c39-73df-4072-a603-c4aa0a4fb7fa/payload-processing/0.log"
Sep 18 21:36:54.707128 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:36:54.707087    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:37:12.781169 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:12.781125    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:37:18.979701 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:18.979666    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf_dbbef7fd-4b40-401c-bd29-e0759669e174/payload-processing/0.log"
Sep 18 21:37:19.236374 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:19.236284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd_15df7c39-73df-4072-a603-c4aa0a4fb7fa/payload-processing/0.log"
Sep 18 21:37:19.349735 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:19.349706    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd_15df7c39-73df-4072-a603-c4aa0a4fb7fa/payload-processing/0.log"
Sep 18 21:37:27.414338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.414255    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"]
Sep 18 21:37:27.417845 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.417824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.421081 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.421059    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-b3d150\""
Sep 18 21:37:27.440873 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.440839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"]
Sep 18 21:37:27.491019 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.490975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr7fx\" (UniqueName: \"kubernetes.io/projected/46e7c555-4067-48e5-bbcf-0f66e1b11721-kube-api-access-zr7fx\") pod \"payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.491213 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.491074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e7c555-4067-48e5-bbcf-0f66e1b11721-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.592065 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.592026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e7c555-4067-48e5-bbcf-0f66e1b11721-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.592249 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.592093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr7fx\" (UniqueName: \"kubernetes.io/projected/46e7c555-4067-48e5-bbcf-0f66e1b11721-kube-api-access-zr7fx\") pod \"payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.592824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.592796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e7c555-4067-48e5-bbcf-0f66e1b11721-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.602310 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.602282    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr7fx\" (UniqueName: \"kubernetes.io/projected/46e7c555-4067-48e5-bbcf-0f66e1b11721-kube-api-access-zr7fx\") pod \"payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:27.728286 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:27.728191    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:28.018145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:28.018115    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"]
Sep 18 21:37:28.020378 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:37:28.020348    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e7c555_4067_48e5_bbcf_0f66e1b11721.slice/crio-4ee7b5d6b14e8c7fa7ab759f589d7bbbf542440b6feef99cb3456e36bbdc37d7 WatchSource:0}: Error finding container 4ee7b5d6b14e8c7fa7ab759f589d7bbbf542440b6feef99cb3456e36bbdc37d7: Status 404 returned error can't find the container with id 4ee7b5d6b14e8c7fa7ab759f589d7bbbf542440b6feef99cb3456e36bbdc37d7
Sep 18 21:37:28.290867 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:28.290767    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl" event={"ID":"46e7c555-4067-48e5-bbcf-0f66e1b11721","Type":"ContainerStarted","Data":"635f08c3ad787c0f86e23d743e18a97a8e552e767e8adc7e21ef22ee17f76ff6"}
Sep 18 21:37:28.290867 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:28.290823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl" event={"ID":"46e7c555-4067-48e5-bbcf-0f66e1b11721","Type":"ContainerStarted","Data":"4ee7b5d6b14e8c7fa7ab759f589d7bbbf542440b6feef99cb3456e36bbdc37d7"}
Sep 18 21:37:28.291126 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:28.290984    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:37:28.313194 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:28.313138    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl" podStartSLOduration=1.313107414 podStartE2EDuration="1.313107414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:37:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:37:28.311553383 +0000 UTC m=+1881.774332744" watchObservedRunningTime="2026-09-18 21:37:28.313107414 +0000 UTC m=+1881.775886795"
Sep 18 21:37:33.098154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:33.098114    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:37:39.298780 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:37:39.298744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:38:05.286287 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.286249    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"]
Sep 18 21:38:05.286850 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.286544    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl" podUID="46e7c555-4067-48e5-bbcf-0f66e1b11721" containerName="payload-processing" containerID="cri-o://635f08c3ad787c0f86e23d743e18a97a8e552e767e8adc7e21ef22ee17f76ff6" gracePeriod=30
Sep 18 21:38:05.485877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.485844    2576 generic.go:356] "Generic (PLEG): container finished" podID="46e7c555-4067-48e5-bbcf-0f66e1b11721" containerID="635f08c3ad787c0f86e23d743e18a97a8e552e767e8adc7e21ef22ee17f76ff6" exitCode=0
Sep 18 21:38:05.486083 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.485929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl" event={"ID":"46e7c555-4067-48e5-bbcf-0f66e1b11721","Type":"ContainerDied","Data":"635f08c3ad787c0f86e23d743e18a97a8e552e767e8adc7e21ef22ee17f76ff6"}
Sep 18 21:38:05.547073 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.546976    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:38:05.623656 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.623628    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr7fx\" (UniqueName: \"kubernetes.io/projected/46e7c555-4067-48e5-bbcf-0f66e1b11721-kube-api-access-zr7fx\") pod \"46e7c555-4067-48e5-bbcf-0f66e1b11721\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") "
Sep 18 21:38:05.623821 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.623665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e7c555-4067-48e5-bbcf-0f66e1b11721-plugins-config-volume\") pod \"46e7c555-4067-48e5-bbcf-0f66e1b11721\" (UID: \"46e7c555-4067-48e5-bbcf-0f66e1b11721\") "
Sep 18 21:38:05.624102 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.624078    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46e7c555-4067-48e5-bbcf-0f66e1b11721-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46e7c555-4067-48e5-bbcf-0f66e1b11721" (UID: "46e7c555-4067-48e5-bbcf-0f66e1b11721"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:38:05.625935 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.625875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46e7c555-4067-48e5-bbcf-0f66e1b11721-kube-api-access-zr7fx" (OuterVolumeSpecName: "kube-api-access-zr7fx") pod "46e7c555-4067-48e5-bbcf-0f66e1b11721" (UID: "46e7c555-4067-48e5-bbcf-0f66e1b11721"). InnerVolumeSpecName "kube-api-access-zr7fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:38:05.724748 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.724705    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr7fx\" (UniqueName: \"kubernetes.io/projected/46e7c555-4067-48e5-bbcf-0f66e1b11721-kube-api-access-zr7fx\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:05.724748 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:05.724738    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46e7c555-4067-48e5-bbcf-0f66e1b11721-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:06.496942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:06.493942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl" event={"ID":"46e7c555-4067-48e5-bbcf-0f66e1b11721","Type":"ContainerDied","Data":"4ee7b5d6b14e8c7fa7ab759f589d7bbbf542440b6feef99cb3456e36bbdc37d7"}
Sep 18 21:38:06.496942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:06.494116    2576 scope.go:117] "RemoveContainer" containerID="635f08c3ad787c0f86e23d743e18a97a8e552e767e8adc7e21ef22ee17f76ff6"
Sep 18 21:38:06.496942 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:06.494355    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"
Sep 18 21:38:06.527984 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:06.527943    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"]
Sep 18 21:38:06.531067 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:06.531036    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl"]
Sep 18 21:38:06.740968 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:06.740934    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46e7c555-4067-48e5-bbcf-0f66e1b11721" path="/var/lib/kubelet/pods/46e7c555-4067-48e5-bbcf-0f66e1b11721/volumes"
Sep 18 21:38:09.823648 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:09.823608    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:38:16.361219 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.361180    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"]
Sep 18 21:38:16.361653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.361521    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e7c555-4067-48e5-bbcf-0f66e1b11721" containerName="payload-processing"
Sep 18 21:38:16.361653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.361533    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e7c555-4067-48e5-bbcf-0f66e1b11721" containerName="payload-processing"
Sep 18 21:38:16.361653 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.361593    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e7c555-4067-48e5-bbcf-0f66e1b11721" containerName="payload-processing"
Sep 18 21:38:16.365752 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.365734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:16.368913 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.368875    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:38:16.369174 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.369157    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:38:16.376319 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.376293    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"]
Sep 18 21:38:16.417450 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.417412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8601db-3b84-41df-80a0-1a717a0f2f1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7\" (UID: \"4c8601db-3b84-41df-80a0-1a717a0f2f1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:16.518265 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.518229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8601db-3b84-41df-80a0-1a717a0f2f1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7\" (UID: \"4c8601db-3b84-41df-80a0-1a717a0f2f1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:16.518834 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.518814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8601db-3b84-41df-80a0-1a717a0f2f1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7\" (UID: \"4c8601db-3b84-41df-80a0-1a717a0f2f1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:16.677353 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.677242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:16.974144 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:16.974119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"]
Sep 18 21:38:16.976824 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:38:16.976794    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8601db_3b84_41df_80a0_1a717a0f2f1f.slice/crio-261e8714dd822bc22c480560da62090462f8fada2a17e97561818d3fb551ba07 WatchSource:0}: Error finding container 261e8714dd822bc22c480560da62090462f8fada2a17e97561818d3fb551ba07: Status 404 returned error can't find the container with id 261e8714dd822bc22c480560da62090462f8fada2a17e97561818d3fb551ba07
Sep 18 21:38:17.550054 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:17.549969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7" event={"ID":"4c8601db-3b84-41df-80a0-1a717a0f2f1f","Type":"ContainerStarted","Data":"792e2466cd630494d08f0111d159c1aad3938a44d931f1470750c6088929e416"}
Sep 18 21:38:17.550054 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:17.550020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7" event={"ID":"4c8601db-3b84-41df-80a0-1a717a0f2f1f","Type":"ContainerStarted","Data":"261e8714dd822bc22c480560da62090462f8fada2a17e97561818d3fb551ba07"}
Sep 18 21:38:18.556787 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:18.556749    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c8601db-3b84-41df-80a0-1a717a0f2f1f" containerID="792e2466cd630494d08f0111d159c1aad3938a44d931f1470750c6088929e416" exitCode=0
Sep 18 21:38:18.557191 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:18.556827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7" event={"ID":"4c8601db-3b84-41df-80a0-1a717a0f2f1f","Type":"ContainerDied","Data":"792e2466cd630494d08f0111d159c1aad3938a44d931f1470750c6088929e416"}
Sep 18 21:38:19.697785 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:19.697748    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:19.747585 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:19.747547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8601db-3b84-41df-80a0-1a717a0f2f1f-maas-api-service-ca\") pod \"4c8601db-3b84-41df-80a0-1a717a0f2f1f\" (UID: \"4c8601db-3b84-41df-80a0-1a717a0f2f1f\") "
Sep 18 21:38:19.747980 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:19.747950    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c8601db-3b84-41df-80a0-1a717a0f2f1f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c8601db-3b84-41df-80a0-1a717a0f2f1f" (UID: "4c8601db-3b84-41df-80a0-1a717a0f2f1f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:38:19.848962 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:19.848919    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c8601db-3b84-41df-80a0-1a717a0f2f1f-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:20.569568 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:20.569538    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"
Sep 18 21:38:20.569756 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:20.569535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7" event={"ID":"4c8601db-3b84-41df-80a0-1a717a0f2f1f","Type":"ContainerDied","Data":"261e8714dd822bc22c480560da62090462f8fada2a17e97561818d3fb551ba07"}
Sep 18 21:38:20.569756 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:20.569660    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="261e8714dd822bc22c480560da62090462f8fada2a17e97561818d3fb551ba07"
Sep 18 21:38:30.207316 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:30.207273    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:38:32.577351 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.577309    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"]
Sep 18 21:38:32.577763 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.577592    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf" podUID="dbbef7fd-4b40-401c-bd29-e0759669e174" containerName="payload-processing" containerID="cri-o://613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872" gracePeriod=30
Sep 18 21:38:32.586956 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.586925    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"]
Sep 18 21:38:32.587154 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.587125    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc" podUID="870b185d-f72c-416f-9d95-37e105a74807" containerName="payload-pre-processing" containerID="cri-o://4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e" gracePeriod=30
Sep 18 21:38:32.881360 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.881332    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:38:32.883622 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.883595    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:38:32.950752 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.950720    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"]
Sep 18 21:38:32.955609 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.955578    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5888e6-rlbw7"]
Sep 18 21:38:32.976137 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.976107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dsmd\" (UniqueName: \"kubernetes.io/projected/870b185d-f72c-416f-9d95-37e105a74807-kube-api-access-8dsmd\") pod \"870b185d-f72c-416f-9d95-37e105a74807\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") "
Sep 18 21:38:32.976137 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.976143    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcbbl\" (UniqueName: \"kubernetes.io/projected/dbbef7fd-4b40-401c-bd29-e0759669e174-kube-api-access-gcbbl\") pod \"dbbef7fd-4b40-401c-bd29-e0759669e174\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") "
Sep 18 21:38:32.976337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.976181    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870b185d-f72c-416f-9d95-37e105a74807-plugins-config-volume\") pod \"870b185d-f72c-416f-9d95-37e105a74807\" (UID: \"870b185d-f72c-416f-9d95-37e105a74807\") "
Sep 18 21:38:32.976337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.976275    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbbef7fd-4b40-401c-bd29-e0759669e174-plugins-config-volume\") pod \"dbbef7fd-4b40-401c-bd29-e0759669e174\" (UID: \"dbbef7fd-4b40-401c-bd29-e0759669e174\") "
Sep 18 21:38:32.976585 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.976563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/870b185d-f72c-416f-9d95-37e105a74807-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "870b185d-f72c-416f-9d95-37e105a74807" (UID: "870b185d-f72c-416f-9d95-37e105a74807"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:38:32.976657 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.976635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbbef7fd-4b40-401c-bd29-e0759669e174-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dbbef7fd-4b40-401c-bd29-e0759669e174" (UID: "dbbef7fd-4b40-401c-bd29-e0759669e174"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:38:32.978331 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.978309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870b185d-f72c-416f-9d95-37e105a74807-kube-api-access-8dsmd" (OuterVolumeSpecName: "kube-api-access-8dsmd") pod "870b185d-f72c-416f-9d95-37e105a74807" (UID: "870b185d-f72c-416f-9d95-37e105a74807"). InnerVolumeSpecName "kube-api-access-8dsmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:38:32.978605 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:32.978585    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbef7fd-4b40-401c-bd29-e0759669e174-kube-api-access-gcbbl" (OuterVolumeSpecName: "kube-api-access-gcbbl") pod "dbbef7fd-4b40-401c-bd29-e0759669e174" (UID: "dbbef7fd-4b40-401c-bd29-e0759669e174"). InnerVolumeSpecName "kube-api-access-gcbbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:38:33.077545 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.077501    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dsmd\" (UniqueName: \"kubernetes.io/projected/870b185d-f72c-416f-9d95-37e105a74807-kube-api-access-8dsmd\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:33.077545 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.077535    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcbbl\" (UniqueName: \"kubernetes.io/projected/dbbef7fd-4b40-401c-bd29-e0759669e174-kube-api-access-gcbbl\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:33.077545 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.077545    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870b185d-f72c-416f-9d95-37e105a74807-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:33.077545 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.077553    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbbef7fd-4b40-401c-bd29-e0759669e174-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:38:33.632619 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.632584    2576 generic.go:356] "Generic (PLEG): container finished" podID="870b185d-f72c-416f-9d95-37e105a74807" containerID="4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e" exitCode=0
Sep 18 21:38:33.633074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.632679    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"
Sep 18 21:38:33.633074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.632738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc" event={"ID":"870b185d-f72c-416f-9d95-37e105a74807","Type":"ContainerDied","Data":"4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e"}
Sep 18 21:38:33.633074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.632790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc" event={"ID":"870b185d-f72c-416f-9d95-37e105a74807","Type":"ContainerDied","Data":"2347e189bcd6ca30bd470bef5db36c6fb83dff0c89ce8ed8823d243ac5c3e026"}
Sep 18 21:38:33.633074 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.632814    2576 scope.go:117] "RemoveContainer" containerID="4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e"
Sep 18 21:38:33.634178 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.634154    2576 generic.go:356] "Generic (PLEG): container finished" podID="dbbef7fd-4b40-401c-bd29-e0759669e174" containerID="613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872" exitCode=0
Sep 18 21:38:33.634245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.634194    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"
Sep 18 21:38:33.634245 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.634203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf" event={"ID":"dbbef7fd-4b40-401c-bd29-e0759669e174","Type":"ContainerDied","Data":"613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872"}
Sep 18 21:38:33.634321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.634243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf" event={"ID":"dbbef7fd-4b40-401c-bd29-e0759669e174","Type":"ContainerDied","Data":"1f15e4cbb58141a3b79d543b56c08f2ab02a87597c6d95341123209a65c1a65e"}
Sep 18 21:38:33.642337 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.642312    2576 scope.go:117] "RemoveContainer" containerID="4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e"
Sep 18 21:38:33.642791 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:38:33.642654    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e\": container with ID starting with 4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e not found: ID does not exist" containerID="4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e"
Sep 18 21:38:33.642791 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.642688    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e"} err="failed to get container status \"4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e\": rpc error: code = NotFound desc = could not find container \"4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e\": container with ID starting with 4be34c73d67df45de7462db6e06780d0168249c14b417b72cc0876d8ff7b720e not found: ID does not exist"
Sep 18 21:38:33.642791 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.642712    2576 scope.go:117] "RemoveContainer" containerID="613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872"
Sep 18 21:38:33.650727 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.650709    2576 scope.go:117] "RemoveContainer" containerID="613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872"
Sep 18 21:38:33.651056 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:38:33.651032    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872\": container with ID starting with 613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872 not found: ID does not exist" containerID="613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872"
Sep 18 21:38:33.651158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.651064    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872"} err="failed to get container status \"613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872\": rpc error: code = NotFound desc = could not find container \"613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872\": container with ID starting with 613a8ac79c89295859983cdce9b52b54cfad79d875c637a8239e9071ef1c1872 not found: ID does not exist"
Sep 18 21:38:33.672616 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.672580    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"]
Sep 18 21:38:33.675025 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.675000    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc"]
Sep 18 21:38:33.696840 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.696805    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"]
Sep 18 21:38:33.716521 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:33.716483    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf"]
Sep 18 21:38:34.740903 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:34.740863    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c8601db-3b84-41df-80a0-1a717a0f2f1f" path="/var/lib/kubelet/pods/4c8601db-3b84-41df-80a0-1a717a0f2f1f/volumes"
Sep 18 21:38:34.741335 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:34.741222    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="870b185d-f72c-416f-9d95-37e105a74807" path="/var/lib/kubelet/pods/870b185d-f72c-416f-9d95-37e105a74807/volumes"
Sep 18 21:38:34.741528 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:34.741515    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbbef7fd-4b40-401c-bd29-e0759669e174" path="/var/lib/kubelet/pods/dbbef7fd-4b40-401c-bd29-e0759669e174/volumes"
Sep 18 21:38:44.207193 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:38:44.207155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:39:23.428576 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428539    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"]
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428897    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8601db-3b84-41df-80a0-1a717a0f2f1f" containerName="revoke-keys"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428911    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8601db-3b84-41df-80a0-1a717a0f2f1f" containerName="revoke-keys"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428921    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="870b185d-f72c-416f-9d95-37e105a74807" containerName="payload-pre-processing"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428927    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="870b185d-f72c-416f-9d95-37e105a74807" containerName="payload-pre-processing"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428936    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbef7fd-4b40-401c-bd29-e0759669e174" containerName="payload-processing"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428942    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbef7fd-4b40-401c-bd29-e0759669e174" containerName="payload-processing"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.428996    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbef7fd-4b40-401c-bd29-e0759669e174" containerName="payload-processing"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.429005    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c8601db-3b84-41df-80a0-1a717a0f2f1f" containerName="revoke-keys"
Sep 18 21:39:23.429046 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.429012    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="870b185d-f72c-416f-9d95-37e105a74807" containerName="payload-pre-processing"
Sep 18 21:39:23.433562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.433541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:23.436693 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.436670    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:39:23.437324 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.437308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:39:23.442801 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.442768    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"]
Sep 18 21:39:23.605442 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.605399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d63d5a-603d-4cb0-8704-73f27aec423d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s\" (UID: \"c5d63d5a-603d-4cb0-8704-73f27aec423d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:23.706370 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.706287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d63d5a-603d-4cb0-8704-73f27aec423d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s\" (UID: \"c5d63d5a-603d-4cb0-8704-73f27aec423d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:23.706866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.706845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d63d5a-603d-4cb0-8704-73f27aec423d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s\" (UID: \"c5d63d5a-603d-4cb0-8704-73f27aec423d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:23.745495 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:23.745457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:24.024621 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:24.024592    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"]
Sep 18 21:39:24.025708 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:39:24.025684    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d63d5a_603d_4cb0_8704_73f27aec423d.slice/crio-193e8f909ae36ca7976f9dcb2578b55c396a06289a23f9580e6725b23ba5e727 WatchSource:0}: Error finding container 193e8f909ae36ca7976f9dcb2578b55c396a06289a23f9580e6725b23ba5e727: Status 404 returned error can't find the container with id 193e8f909ae36ca7976f9dcb2578b55c396a06289a23f9580e6725b23ba5e727
Sep 18 21:39:24.875971 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:24.875879    2576 generic.go:356] "Generic (PLEG): container finished" podID="c5d63d5a-603d-4cb0-8704-73f27aec423d" containerID="46ef0710a728658319b4e4258bd6e0622d32b36e4f6eac574ade2dc601e7686d" exitCode=0
Sep 18 21:39:24.876334 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:24.875993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s" event={"ID":"c5d63d5a-603d-4cb0-8704-73f27aec423d","Type":"ContainerDied","Data":"46ef0710a728658319b4e4258bd6e0622d32b36e4f6eac574ade2dc601e7686d"}
Sep 18 21:39:24.876334 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:24.876050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s" event={"ID":"c5d63d5a-603d-4cb0-8704-73f27aec423d","Type":"ContainerStarted","Data":"193e8f909ae36ca7976f9dcb2578b55c396a06289a23f9580e6725b23ba5e727"}
Sep 18 21:39:26.011321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.011289    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:26.128876 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.128841    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d63d5a-603d-4cb0-8704-73f27aec423d-maas-api-service-ca\") pod \"c5d63d5a-603d-4cb0-8704-73f27aec423d\" (UID: \"c5d63d5a-603d-4cb0-8704-73f27aec423d\") "
Sep 18 21:39:26.129226 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.129203    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d63d5a-603d-4cb0-8704-73f27aec423d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5d63d5a-603d-4cb0-8704-73f27aec423d" (UID: "c5d63d5a-603d-4cb0-8704-73f27aec423d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:39:26.230197 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.230103    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d63d5a-603d-4cb0-8704-73f27aec423d-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:26.887181 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.887150    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"
Sep 18 21:39:26.887181 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.887166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s" event={"ID":"c5d63d5a-603d-4cb0-8704-73f27aec423d","Type":"ContainerDied","Data":"193e8f909ae36ca7976f9dcb2578b55c396a06289a23f9580e6725b23ba5e727"}
Sep 18 21:39:26.887401 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:26.887215    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="193e8f909ae36ca7976f9dcb2578b55c396a06289a23f9580e6725b23ba5e727"
Sep 18 21:39:34.184145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.184105    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"]
Sep 18 21:39:34.184569 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.184347    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd" podUID="15df7c39-73df-4072-a603-c4aa0a4fb7fa" containerName="payload-processing" containerID="cri-o://281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8" gracePeriod=30
Sep 18 21:39:34.190825 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.190794    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"]
Sep 18 21:39:34.191090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.191063    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j" podUID="d286df4a-fd60-464b-a234-e05e2604791f" containerName="payload-pre-processing" containerID="cri-o://dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591" gracePeriod=30
Sep 18 21:39:34.447405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.447379    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:39:34.455958 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.455929    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"]
Sep 18 21:39:34.458419 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.458397    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:39:34.469272 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.469243    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-deac7a-ngb6s"]
Sep 18 21:39:34.491690 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.491650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15df7c39-73df-4072-a603-c4aa0a4fb7fa-plugins-config-volume\") pod \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") "
Sep 18 21:39:34.491928 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.491692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d286df4a-fd60-464b-a234-e05e2604791f-plugins-config-volume\") pod \"d286df4a-fd60-464b-a234-e05e2604791f\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") "
Sep 18 21:39:34.491928 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.491829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrj56\" (UniqueName: \"kubernetes.io/projected/15df7c39-73df-4072-a603-c4aa0a4fb7fa-kube-api-access-mrj56\") pod \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\" (UID: \"15df7c39-73df-4072-a603-c4aa0a4fb7fa\") "
Sep 18 21:39:34.492075 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.491963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdqvx\" (UniqueName: \"kubernetes.io/projected/d286df4a-fd60-464b-a234-e05e2604791f-kube-api-access-sdqvx\") pod \"d286df4a-fd60-464b-a234-e05e2604791f\" (UID: \"d286df4a-fd60-464b-a234-e05e2604791f\") "
Sep 18 21:39:34.492187 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.492098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15df7c39-73df-4072-a603-c4aa0a4fb7fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15df7c39-73df-4072-a603-c4aa0a4fb7fa" (UID: "15df7c39-73df-4072-a603-c4aa0a4fb7fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:39:34.492187 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.492147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d286df4a-fd60-464b-a234-e05e2604791f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d286df4a-fd60-464b-a234-e05e2604791f" (UID: "d286df4a-fd60-464b-a234-e05e2604791f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:39:34.492304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.492265    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15df7c39-73df-4072-a603-c4aa0a4fb7fa-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:34.492304 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.492285    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d286df4a-fd60-464b-a234-e05e2604791f-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:34.494774 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.494744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d286df4a-fd60-464b-a234-e05e2604791f-kube-api-access-sdqvx" (OuterVolumeSpecName: "kube-api-access-sdqvx") pod "d286df4a-fd60-464b-a234-e05e2604791f" (UID: "d286df4a-fd60-464b-a234-e05e2604791f"). InnerVolumeSpecName "kube-api-access-sdqvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:39:34.494913 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.494783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15df7c39-73df-4072-a603-c4aa0a4fb7fa-kube-api-access-mrj56" (OuterVolumeSpecName: "kube-api-access-mrj56") pod "15df7c39-73df-4072-a603-c4aa0a4fb7fa" (UID: "15df7c39-73df-4072-a603-c4aa0a4fb7fa"). InnerVolumeSpecName "kube-api-access-mrj56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:39:34.593401 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.593365    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdqvx\" (UniqueName: \"kubernetes.io/projected/d286df4a-fd60-464b-a234-e05e2604791f-kube-api-access-sdqvx\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:34.593401 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.593398    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrj56\" (UniqueName: \"kubernetes.io/projected/15df7c39-73df-4072-a603-c4aa0a4fb7fa-kube-api-access-mrj56\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:34.740719 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.740633    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d63d5a-603d-4cb0-8704-73f27aec423d" path="/var/lib/kubelet/pods/c5d63d5a-603d-4cb0-8704-73f27aec423d/volumes"
Sep 18 21:39:34.925600 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.925562    2576 generic.go:356] "Generic (PLEG): container finished" podID="15df7c39-73df-4072-a603-c4aa0a4fb7fa" containerID="281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8" exitCode=0
Sep 18 21:39:34.925820 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.925607    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"
Sep 18 21:39:34.925820 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.925643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd" event={"ID":"15df7c39-73df-4072-a603-c4aa0a4fb7fa","Type":"ContainerDied","Data":"281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8"}
Sep 18 21:39:34.925820 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.925707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd" event={"ID":"15df7c39-73df-4072-a603-c4aa0a4fb7fa","Type":"ContainerDied","Data":"86e3d3c6a871dd4d10bafb340ddef05d025cd5e74233a20bcadb67be6e56288e"}
Sep 18 21:39:34.925820 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.925735    2576 scope.go:117] "RemoveContainer" containerID="281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8"
Sep 18 21:39:34.927260 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.927235    2576 generic.go:356] "Generic (PLEG): container finished" podID="d286df4a-fd60-464b-a234-e05e2604791f" containerID="dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591" exitCode=0
Sep 18 21:39:34.927361 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.927278    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"
Sep 18 21:39:34.927361 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.927318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j" event={"ID":"d286df4a-fd60-464b-a234-e05e2604791f","Type":"ContainerDied","Data":"dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591"}
Sep 18 21:39:34.927471 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.927367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j" event={"ID":"d286df4a-fd60-464b-a234-e05e2604791f","Type":"ContainerDied","Data":"2e8ef2373e0d02e13614c60d36b0c43a11e648ba4bdd20447c757547478b2340"}
Sep 18 21:39:34.934845 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.934824    2576 scope.go:117] "RemoveContainer" containerID="281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8"
Sep 18 21:39:34.935202 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:39:34.935182    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8\": container with ID starting with 281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8 not found: ID does not exist" containerID="281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8"
Sep 18 21:39:34.935250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.935215    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8"} err="failed to get container status \"281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8\": rpc error: code = NotFound desc = could not find container \"281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8\": container with ID starting with 281e98873456a55e3fe0fbce877fd694b5b279bb49e277b916f8e423a61d8ea8 not found: ID does not exist"
Sep 18 21:39:34.935250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.935233    2576 scope.go:117] "RemoveContainer" containerID="dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591"
Sep 18 21:39:34.943463 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.943445    2576 scope.go:117] "RemoveContainer" containerID="dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591"
Sep 18 21:39:34.943804 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:39:34.943782    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591\": container with ID starting with dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591 not found: ID does not exist" containerID="dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591"
Sep 18 21:39:34.943923 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.943810    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591"} err="failed to get container status \"dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591\": rpc error: code = NotFound desc = could not find container \"dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591\": container with ID starting with dae8d16af41a63e3a0ddeb1c65cf921647c86f6c03f8cb4545e61e77d483d591 not found: ID does not exist"
Sep 18 21:39:34.977596 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.976669    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"]
Sep 18 21:39:34.990418 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:34.990387    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd"]
Sep 18 21:39:35.018826 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:35.018740    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"]
Sep 18 21:39:35.027480 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:35.027452    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j"]
Sep 18 21:39:36.740816 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:36.740776    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15df7c39-73df-4072-a603-c4aa0a4fb7fa" path="/var/lib/kubelet/pods/15df7c39-73df-4072-a603-c4aa0a4fb7fa/volumes"
Sep 18 21:39:36.741335 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:36.741309    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d286df4a-fd60-464b-a234-e05e2604791f" path="/var/lib/kubelet/pods/d286df4a-fd60-464b-a234-e05e2604791f/volumes"
Sep 18 21:39:37.569533 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:37.569490    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:39:42.955001 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.954967    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"]
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955267    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d63d5a-603d-4cb0-8704-73f27aec423d" containerName="revoke-keys"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955277    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d63d5a-603d-4cb0-8704-73f27aec423d" containerName="revoke-keys"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955287    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15df7c39-73df-4072-a603-c4aa0a4fb7fa" containerName="payload-processing"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955292    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="15df7c39-73df-4072-a603-c4aa0a4fb7fa" containerName="payload-processing"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955304    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d286df4a-fd60-464b-a234-e05e2604791f" containerName="payload-pre-processing"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955310    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d286df4a-fd60-464b-a234-e05e2604791f" containerName="payload-pre-processing"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955394    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d63d5a-603d-4cb0-8704-73f27aec423d" containerName="revoke-keys"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955402    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="15df7c39-73df-4072-a603-c4aa0a4fb7fa" containerName="payload-processing"
Sep 18 21:39:42.955486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.955409    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d286df4a-fd60-464b-a234-e05e2604791f" containerName="payload-pre-processing"
Sep 18 21:39:42.959562 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.959542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:42.962513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.962489    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:39:42.962513 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.962501    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:39:42.968421 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:42.968392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"]
Sep 18 21:39:43.061260 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.061213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2\" (UID: \"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:43.162427 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.162378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2\" (UID: \"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:43.163105 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.163085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2\" (UID: \"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:43.271159 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.271058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:43.576841 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.576815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"]
Sep 18 21:39:43.580690 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:39:43.580656    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2bd9c8_c6b0_4079_8792_d15f64e4d44a.slice/crio-5040382f8750e3ebbd71a41c8920b5485190bdbb5684134877c55d32785c5902 WatchSource:0}: Error finding container 5040382f8750e3ebbd71a41c8920b5485190bdbb5684134877c55d32785c5902: Status 404 returned error can't find the container with id 5040382f8750e3ebbd71a41c8920b5485190bdbb5684134877c55d32785c5902
Sep 18 21:39:43.972699 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.972662    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2" event={"ID":"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a","Type":"ContainerStarted","Data":"ca831df24149dde780c2d274869f6a24fa15bccb8b8f3a664c335fcc9fcd447e"}
Sep 18 21:39:43.973147 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.972716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2" event={"ID":"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a","Type":"ContainerStarted","Data":"5040382f8750e3ebbd71a41c8920b5485190bdbb5684134877c55d32785c5902"}
Sep 18 21:39:43.991113 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:43.991060    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2" podStartSLOduration=1.991041362 podStartE2EDuration="1.991041362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:39:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:39:43.989770226 +0000 UTC m=+2017.452549582" watchObservedRunningTime="2026-09-18 21:39:43.991041362 +0000 UTC m=+2017.453820717"
Sep 18 21:39:44.979111 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:44.979077    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb2bd9c8-c6b0-4079-8792-d15f64e4d44a" containerID="ca831df24149dde780c2d274869f6a24fa15bccb8b8f3a664c335fcc9fcd447e" exitCode=0
Sep 18 21:39:44.979507 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:44.979162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2" event={"ID":"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a","Type":"ContainerDied","Data":"ca831df24149dde780c2d274869f6a24fa15bccb8b8f3a664c335fcc9fcd447e"}
Sep 18 21:39:46.112733 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.112705    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:46.189273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.189230    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a-maas-api-service-ca\") pod \"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a\" (UID: \"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a\") "
Sep 18 21:39:46.189593 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.189569    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb2bd9c8-c6b0-4079-8792-d15f64e4d44a" (UID: "bb2bd9c8-c6b0-4079-8792-d15f64e4d44a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:39:46.289745 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.289671    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:46.990296 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.990266    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"
Sep 18 21:39:46.990469 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.990299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2" event={"ID":"bb2bd9c8-c6b0-4079-8792-d15f64e4d44a","Type":"ContainerDied","Data":"5040382f8750e3ebbd71a41c8920b5485190bdbb5684134877c55d32785c5902"}
Sep 18 21:39:46.990469 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:46.990365    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5040382f8750e3ebbd71a41c8920b5485190bdbb5684134877c55d32785c5902"
Sep 18 21:39:53.709804 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.709765    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"]
Sep 18 21:39:53.716702 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.716671    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-cad5cf-29829450-98h7c"]
Sep 18 21:39:53.747969 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.747928    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"]
Sep 18 21:39:53.748250 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.748199    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj" podUID="1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" containerName="payload-processing" containerID="cri-o://b30585c936dc0cc12b63c853b8fe5610eb575115efb1b59c79156e8ed283f92e" gracePeriod=30
Sep 18 21:39:53.763081 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.762815    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"]
Sep 18 21:39:53.763225 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.763139    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq" podUID="5436354e-de97-4f2f-a950-f29c90eb92ac" containerName="payload-pre-processing" containerID="cri-o://8e6836938e9ef16a4eb297b154315380639e9b222b428771b06564874039b991" gracePeriod=30
Sep 18 21:39:53.976144 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.976102    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"]
Sep 18 21:39:53.984315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:53.984275    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-cad5cf-j5dz2"]
Sep 18 21:39:54.024130 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.024064    2576 generic.go:356] "Generic (PLEG): container finished" podID="5436354e-de97-4f2f-a950-f29c90eb92ac" containerID="8e6836938e9ef16a4eb297b154315380639e9b222b428771b06564874039b991" exitCode=0
Sep 18 21:39:54.024130 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.024099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq" event={"ID":"5436354e-de97-4f2f-a950-f29c90eb92ac","Type":"ContainerDied","Data":"8e6836938e9ef16a4eb297b154315380639e9b222b428771b06564874039b991"}
Sep 18 21:39:54.025760 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.025737    2576 generic.go:356] "Generic (PLEG): container finished" podID="1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" containerID="b30585c936dc0cc12b63c853b8fe5610eb575115efb1b59c79156e8ed283f92e" exitCode=0
Sep 18 21:39:54.025865 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.025772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj" event={"ID":"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f","Type":"ContainerDied","Data":"b30585c936dc0cc12b63c853b8fe5610eb575115efb1b59c79156e8ed283f92e"}
Sep 18 21:39:54.025865 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.025805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj" event={"ID":"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f","Type":"ContainerDied","Data":"4d3e72a210fd4e2fb0d01a71bde5dea9b968c3705954acf29698d525b5224d39"}
Sep 18 21:39:54.025865 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.025827    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d3e72a210fd4e2fb0d01a71bde5dea9b968c3705954acf29698d525b5224d39"
Sep 18 21:39:54.040117 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.040084    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:39:54.042771 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.042751    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:39:54.152258 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.152220    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436354e-de97-4f2f-a950-f29c90eb92ac-plugins-config-volume\") pod \"5436354e-de97-4f2f-a950-f29c90eb92ac\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") "
Sep 18 21:39:54.152462 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.152276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgrjl\" (UniqueName: \"kubernetes.io/projected/5436354e-de97-4f2f-a950-f29c90eb92ac-kube-api-access-fgrjl\") pod \"5436354e-de97-4f2f-a950-f29c90eb92ac\" (UID: \"5436354e-de97-4f2f-a950-f29c90eb92ac\") "
Sep 18 21:39:54.152462 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.152302    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9r8q\" (UniqueName: \"kubernetes.io/projected/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-kube-api-access-s9r8q\") pod \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") "
Sep 18 21:39:54.152462 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.152423    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-plugins-config-volume\") pod \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\" (UID: \"1cc534b4-6b31-4867-aba9-a5aeb11e3e0f\") "
Sep 18 21:39:54.152756 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.152729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5436354e-de97-4f2f-a950-f29c90eb92ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5436354e-de97-4f2f-a950-f29c90eb92ac" (UID: "5436354e-de97-4f2f-a950-f29c90eb92ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:39:54.152853 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.152787    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" (UID: "1cc534b4-6b31-4867-aba9-a5aeb11e3e0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:39:54.154521 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.154492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-kube-api-access-s9r8q" (OuterVolumeSpecName: "kube-api-access-s9r8q") pod "1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" (UID: "1cc534b4-6b31-4867-aba9-a5aeb11e3e0f"). InnerVolumeSpecName "kube-api-access-s9r8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:39:54.154612 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.154525    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5436354e-de97-4f2f-a950-f29c90eb92ac-kube-api-access-fgrjl" (OuterVolumeSpecName: "kube-api-access-fgrjl") pod "5436354e-de97-4f2f-a950-f29c90eb92ac" (UID: "5436354e-de97-4f2f-a950-f29c90eb92ac"). InnerVolumeSpecName "kube-api-access-fgrjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:39:54.253273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.253173    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:54.253273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.253218    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436354e-de97-4f2f-a950-f29c90eb92ac-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:54.253273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.253227    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgrjl\" (UniqueName: \"kubernetes.io/projected/5436354e-de97-4f2f-a950-f29c90eb92ac-kube-api-access-fgrjl\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:54.253273 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.253236    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9r8q\" (UniqueName: \"kubernetes.io/projected/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f-kube-api-access-s9r8q\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:39:54.740419 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.740378    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2bd9c8-c6b0-4079-8792-d15f64e4d44a" path="/var/lib/kubelet/pods/bb2bd9c8-c6b0-4079-8792-d15f64e4d44a/volumes"
Sep 18 21:39:54.740920 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:54.740791    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6" path="/var/lib/kubelet/pods/ee5a0d6b-7fbe-45a1-aa5e-7fb3a7dee1d6/volumes"
Sep 18 21:39:55.032741 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.032635    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"
Sep 18 21:39:55.032741 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.032681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq" event={"ID":"5436354e-de97-4f2f-a950-f29c90eb92ac","Type":"ContainerDied","Data":"dcd2c97e1f764ea0e0b4d0ee48dbd070a511884dcc8a1861b6bdab0addfd9684"}
Sep 18 21:39:55.033003 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.032753    2576 scope.go:117] "RemoveContainer" containerID="8e6836938e9ef16a4eb297b154315380639e9b222b428771b06564874039b991"
Sep 18 21:39:55.033003 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.032852    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"
Sep 18 21:39:55.057338 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.057299    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"]
Sep 18 21:39:55.060922 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.060869    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq"]
Sep 18 21:39:55.080327 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.080296    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"]
Sep 18 21:39:55.082705 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:55.082673    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj"]
Sep 18 21:39:56.740593 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:56.740557    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" path="/var/lib/kubelet/pods/1cc534b4-6b31-4867-aba9-a5aeb11e3e0f/volumes"
Sep 18 21:39:56.741050 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:56.741032    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5436354e-de97-4f2f-a950-f29c90eb92ac" path="/var/lib/kubelet/pods/5436354e-de97-4f2f-a950-f29c90eb92ac/volumes"
Sep 18 21:39:56.812381 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:39:56.812347    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:40:02.019121 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019076    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"]
Sep 18 21:40:02.019589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019501    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5436354e-de97-4f2f-a950-f29c90eb92ac" containerName="payload-pre-processing"
Sep 18 21:40:02.019589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019520    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5436354e-de97-4f2f-a950-f29c90eb92ac" containerName="payload-pre-processing"
Sep 18 21:40:02.019589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019532    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2bd9c8-c6b0-4079-8792-d15f64e4d44a" containerName="revoke-keys"
Sep 18 21:40:02.019589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019541    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2bd9c8-c6b0-4079-8792-d15f64e4d44a" containerName="revoke-keys"
Sep 18 21:40:02.019589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019550    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" containerName="payload-processing"
Sep 18 21:40:02.019589 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019559    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" containerName="payload-processing"
Sep 18 21:40:02.019936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019657    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc534b4-6b31-4867-aba9-a5aeb11e3e0f" containerName="payload-processing"
Sep 18 21:40:02.019936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019670    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2bd9c8-c6b0-4079-8792-d15f64e4d44a" containerName="revoke-keys"
Sep 18 21:40:02.019936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.019680    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5436354e-de97-4f2f-a950-f29c90eb92ac" containerName="payload-pre-processing"
Sep 18 21:40:02.024233 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.024209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:02.032607 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.032583    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:40:02.032750 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.032621    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:40:02.047164 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.047131    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"]
Sep 18 21:40:02.117534 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.117493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42e33ae-715d-4ae5-93c0-085b29f16f88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf\" (UID: \"f42e33ae-715d-4ae5-93c0-085b29f16f88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:02.218735 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.218700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42e33ae-715d-4ae5-93c0-085b29f16f88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf\" (UID: \"f42e33ae-715d-4ae5-93c0-085b29f16f88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:02.219386 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.219359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42e33ae-715d-4ae5-93c0-085b29f16f88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf\" (UID: \"f42e33ae-715d-4ae5-93c0-085b29f16f88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:02.334055 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.334012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:02.608573 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:02.608545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"]
Sep 18 21:40:02.611447 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:40:02.611417    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42e33ae_715d_4ae5_93c0_085b29f16f88.slice/crio-85df28e9459f76e6e51d3243104cb08429c7f68088248c959680cc8fec28dfb4 WatchSource:0}: Error finding container 85df28e9459f76e6e51d3243104cb08429c7f68088248c959680cc8fec28dfb4: Status 404 returned error can't find the container with id 85df28e9459f76e6e51d3243104cb08429c7f68088248c959680cc8fec28dfb4
Sep 18 21:40:03.075182 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:03.075138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf" event={"ID":"f42e33ae-715d-4ae5-93c0-085b29f16f88","Type":"ContainerStarted","Data":"f1a1309faba44c9315518998318f3fe798b27df98d461fc0162b69c1e61813df"}
Sep 18 21:40:03.075572 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:03.075202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf" event={"ID":"f42e33ae-715d-4ae5-93c0-085b29f16f88","Type":"ContainerStarted","Data":"85df28e9459f76e6e51d3243104cb08429c7f68088248c959680cc8fec28dfb4"}
Sep 18 21:40:03.098546 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:03.098494    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf" podStartSLOduration=2.098476012 podStartE2EDuration="2.098476012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:40:03.096116622 +0000 UTC m=+2036.558895979" watchObservedRunningTime="2026-09-18 21:40:03.098476012 +0000 UTC m=+2036.561255368"
Sep 18 21:40:04.081478 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:04.081444    2576 generic.go:356] "Generic (PLEG): container finished" podID="f42e33ae-715d-4ae5-93c0-085b29f16f88" containerID="f1a1309faba44c9315518998318f3fe798b27df98d461fc0162b69c1e61813df" exitCode=0
Sep 18 21:40:04.081852 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:04.081491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf" event={"ID":"f42e33ae-715d-4ae5-93c0-085b29f16f88","Type":"ContainerDied","Data":"f1a1309faba44c9315518998318f3fe798b27df98d461fc0162b69c1e61813df"}
Sep 18 21:40:05.208957 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:05.208928    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:05.351195 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:05.351100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42e33ae-715d-4ae5-93c0-085b29f16f88-maas-api-service-ca\") pod \"f42e33ae-715d-4ae5-93c0-085b29f16f88\" (UID: \"f42e33ae-715d-4ae5-93c0-085b29f16f88\") "
Sep 18 21:40:05.351478 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:05.351452    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f42e33ae-715d-4ae5-93c0-085b29f16f88-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f42e33ae-715d-4ae5-93c0-085b29f16f88" (UID: "f42e33ae-715d-4ae5-93c0-085b29f16f88"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:40:05.451958 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:05.451919    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42e33ae-715d-4ae5-93c0-085b29f16f88-maas-api-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:40:06.091691 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:06.091662    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"
Sep 18 21:40:06.091864 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:06.091664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf" event={"ID":"f42e33ae-715d-4ae5-93c0-085b29f16f88","Type":"ContainerDied","Data":"85df28e9459f76e6e51d3243104cb08429c7f68088248c959680cc8fec28dfb4"}
Sep 18 21:40:06.091864 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:06.091789    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85df28e9459f76e6e51d3243104cb08429c7f68088248c959680cc8fec28dfb4"
Sep 18 21:40:09.133561 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:09.133520    2576 scope.go:117] "RemoveContainer" containerID="3383f00e25fdca0a2e988c860d3f53519895d7aacd6ab45f97f7db5f070abf8d"
Sep 18 21:40:09.141815 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:09.141792    2576 scope.go:117] "RemoveContainer" containerID="8c0b6daf05d774cabf15c9b7e99096ac4b3806c54d042cc1898f1253283fc3ff"
Sep 18 21:40:09.149581 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:09.149557    2576 scope.go:117] "RemoveContainer" containerID="a23c97be1f2a1f3fd045733ff1da7fa80f8d968a0b01cf42ea1b521012f64020"
Sep 18 21:40:09.156981 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:09.156956    2576 scope.go:117] "RemoveContainer" containerID="b30585c936dc0cc12b63c853b8fe5610eb575115efb1b59c79156e8ed283f92e"
Sep 18 21:40:12.769079 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:12.769044    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"]
Sep 18 21:40:12.779217 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:12.779188    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fd993e-29829450-nz5l9"]
Sep 18 21:40:12.815153 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:12.815115    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"]
Sep 18 21:40:12.829284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:12.829251    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"]
Sep 18 21:40:12.829483 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:12.829455    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds" podUID="f40f609d-8ae9-438e-adbc-238dd78840fe" containerName="payload-pre-processing" containerID="cri-o://2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36" gracePeriod=30
Sep 18 21:40:13.079775 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.079744    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"]
Sep 18 21:40:13.084701 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.084678    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:40:13.085361 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.085339    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-fd993e-dm8wf"]
Sep 18 21:40:13.127254 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.127221    2576 generic.go:356] "Generic (PLEG): container finished" podID="f40f609d-8ae9-438e-adbc-238dd78840fe" containerID="2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36" exitCode=0
Sep 18 21:40:13.127441 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.127260    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"
Sep 18 21:40:13.127441 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.127300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds" event={"ID":"f40f609d-8ae9-438e-adbc-238dd78840fe","Type":"ContainerDied","Data":"2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36"}
Sep 18 21:40:13.127441 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.127368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds" event={"ID":"f40f609d-8ae9-438e-adbc-238dd78840fe","Type":"ContainerDied","Data":"f7855385af7974e0501a6aecd631cc20d50455b14909b75489ab984ac6821763"}
Sep 18 21:40:13.127441 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.127410    2576 scope.go:117] "RemoveContainer" containerID="2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36"
Sep 18 21:40:13.127648 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.127510    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh" podUID="9fc1cf34-fa8b-4928-85c8-38066ce9dbed" containerName="payload-processing" containerID="cri-o://01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9" gracePeriod=30
Sep 18 21:40:13.139160 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.139135    2576 scope.go:117] "RemoveContainer" containerID="2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36"
Sep 18 21:40:13.139526 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:40:13.139493    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36\": container with ID starting with 2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36 not found: ID does not exist" containerID="2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36"
Sep 18 21:40:13.139616 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.139541    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36"} err="failed to get container status \"2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36\": rpc error: code = NotFound desc = could not find container \"2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36\": container with ID starting with 2f163069d139e7c206f49dd55aeb9f977a192a25521fb76d630f6825393b9e36 not found: ID does not exist"
Sep 18 21:40:13.221321 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.221283    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f40f609d-8ae9-438e-adbc-238dd78840fe-plugins-config-volume\") pod \"f40f609d-8ae9-438e-adbc-238dd78840fe\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") "
Sep 18 21:40:13.221495 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.221339    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz2hf\" (UniqueName: \"kubernetes.io/projected/f40f609d-8ae9-438e-adbc-238dd78840fe-kube-api-access-zz2hf\") pod \"f40f609d-8ae9-438e-adbc-238dd78840fe\" (UID: \"f40f609d-8ae9-438e-adbc-238dd78840fe\") "
Sep 18 21:40:13.221703 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.221680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40f609d-8ae9-438e-adbc-238dd78840fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f40f609d-8ae9-438e-adbc-238dd78840fe" (UID: "f40f609d-8ae9-438e-adbc-238dd78840fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:40:13.223508 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.223482    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40f609d-8ae9-438e-adbc-238dd78840fe-kube-api-access-zz2hf" (OuterVolumeSpecName: "kube-api-access-zz2hf") pod "f40f609d-8ae9-438e-adbc-238dd78840fe" (UID: "f40f609d-8ae9-438e-adbc-238dd78840fe"). InnerVolumeSpecName "kube-api-access-zz2hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:40:13.322336 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.322242    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f40f609d-8ae9-438e-adbc-238dd78840fe-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:40:13.322336 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.322276    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz2hf\" (UniqueName: \"kubernetes.io/projected/f40f609d-8ae9-438e-adbc-238dd78840fe-kube-api-access-zz2hf\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:40:13.372592 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.372562    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:40:13.461609 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.461573    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"]
Sep 18 21:40:13.465299 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.465265    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds"]
Sep 18 21:40:13.523784 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.523752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-plugins-config-volume\") pod \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") "
Sep 18 21:40:13.523999 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.523835    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gtjr\" (UniqueName: \"kubernetes.io/projected/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-kube-api-access-2gtjr\") pod \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\" (UID: \"9fc1cf34-fa8b-4928-85c8-38066ce9dbed\") "
Sep 18 21:40:13.524241 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.524214    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9fc1cf34-fa8b-4928-85c8-38066ce9dbed" (UID: "9fc1cf34-fa8b-4928-85c8-38066ce9dbed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:40:13.525951 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.525928    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-kube-api-access-2gtjr" (OuterVolumeSpecName: "kube-api-access-2gtjr") pod "9fc1cf34-fa8b-4928-85c8-38066ce9dbed" (UID: "9fc1cf34-fa8b-4928-85c8-38066ce9dbed"). InnerVolumeSpecName "kube-api-access-2gtjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:40:13.624422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.624385    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gtjr\" (UniqueName: \"kubernetes.io/projected/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-kube-api-access-2gtjr\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:40:13.624422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:13.624414    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc1cf34-fa8b-4928-85c8-38066ce9dbed-plugins-config-volume\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:40:14.132896 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.132849    2576 generic.go:356] "Generic (PLEG): container finished" podID="9fc1cf34-fa8b-4928-85c8-38066ce9dbed" containerID="01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9" exitCode=0
Sep 18 21:40:14.132896 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.132901    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"
Sep 18 21:40:14.133515 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.132942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh" event={"ID":"9fc1cf34-fa8b-4928-85c8-38066ce9dbed","Type":"ContainerDied","Data":"01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9"}
Sep 18 21:40:14.133515 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.132999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh" event={"ID":"9fc1cf34-fa8b-4928-85c8-38066ce9dbed","Type":"ContainerDied","Data":"a67b56043ca91f2a8f12632b95e3c765d0314771bc3576a78ff9446621809722"}
Sep 18 21:40:14.133515 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.133023    2576 scope.go:117] "RemoveContainer" containerID="01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9"
Sep 18 21:40:14.141360 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.141340    2576 scope.go:117] "RemoveContainer" containerID="01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9"
Sep 18 21:40:14.141645 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:40:14.141627    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9\": container with ID starting with 01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9 not found: ID does not exist" containerID="01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9"
Sep 18 21:40:14.141714 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.141651    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9"} err="failed to get container status \"01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9\": rpc error: code = NotFound desc = could not find container \"01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9\": container with ID starting with 01a6b5e91d4cbe13ddbf6e2851297d9fac90927196f4ba2c6625263417b608a9 not found: ID does not exist"
Sep 18 21:40:14.166012 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.165977    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"]
Sep 18 21:40:14.182792 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.182759    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh"]
Sep 18 21:40:14.739559 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.739526    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a4f073d-08bf-451c-9cbc-9a97fc85640d" path="/var/lib/kubelet/pods/0a4f073d-08bf-451c-9cbc-9a97fc85640d/volumes"
Sep 18 21:40:14.739848 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.739836    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc1cf34-fa8b-4928-85c8-38066ce9dbed" path="/var/lib/kubelet/pods/9fc1cf34-fa8b-4928-85c8-38066ce9dbed/volumes"
Sep 18 21:40:14.740180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.740167    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40f609d-8ae9-438e-adbc-238dd78840fe" path="/var/lib/kubelet/pods/f40f609d-8ae9-438e-adbc-238dd78840fe/volumes"
Sep 18 21:40:14.740440 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:14.740429    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f42e33ae-715d-4ae5-93c0-085b29f16f88" path="/var/lib/kubelet/pods/f42e33ae-715d-4ae5-93c0-085b29f16f88/volumes"
Sep 18 21:40:15.605842 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:15.605803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:40:25.809593 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:40:25.809503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:41:09.196315 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:41:09.196283    2576 scope.go:117] "RemoveContainer" containerID="67c712fa9bf9e8c4d747c63f8fcc210b2f2ac55c7fc4be0c719a71174dd85b41"
Sep 18 21:41:47.209301 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:41:47.209263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:42:32.199546 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:42:32.199504    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:42:40.252705 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:42:40.252665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:42:48.204504 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:42:48.204468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:43:03.045368 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:43:03.045328    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:43:11.000707 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:43:11.000667    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:44:41.906376 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:44:41.906330    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:44:49.025148 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:44:49.025109    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:44:57.933405 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:44:57.933312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:00.153936 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.153897    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"]
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154227    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40f609d-8ae9-438e-adbc-238dd78840fe" containerName="payload-pre-processing"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154238    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40f609d-8ae9-438e-adbc-238dd78840fe" containerName="payload-pre-processing"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154248    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42e33ae-715d-4ae5-93c0-085b29f16f88" containerName="revoke-keys"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154254    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42e33ae-715d-4ae5-93c0-085b29f16f88" containerName="revoke-keys"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154263    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc1cf34-fa8b-4928-85c8-38066ce9dbed" containerName="payload-processing"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154268    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc1cf34-fa8b-4928-85c8-38066ce9dbed" containerName="payload-processing"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154318    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc1cf34-fa8b-4928-85c8-38066ce9dbed" containerName="payload-processing"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154327    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f40f609d-8ae9-438e-adbc-238dd78840fe" containerName="payload-pre-processing"
Sep 18 21:45:00.154349 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.154334    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42e33ae-715d-4ae5-93c0-085b29f16f88" containerName="revoke-keys"
Sep 18 21:45:00.157300 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.157277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"
Sep 18 21:45:00.160573 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.160548    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52bhz\""
Sep 18 21:45:00.166522 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.166500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"
Sep 18 21:45:00.175111 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.174976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"]
Sep 18 21:45:00.460907 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:00.460806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"]
Sep 18 21:45:00.464536 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:45:00.464510    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d18b54_570a_48ac_a3fc_270d3925de5b.slice/crio-dc1453c076f8ff4d0b1917be2866cb3768681986e5837016474dc05f5233e757 WatchSource:0}: Error finding container dc1453c076f8ff4d0b1917be2866cb3768681986e5837016474dc05f5233e757: Status 404 returned error can't find the container with id dc1453c076f8ff4d0b1917be2866cb3768681986e5837016474dc05f5233e757
Sep 18 21:45:01.405176 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:01.405141    2576 generic.go:356] "Generic (PLEG): container finished" podID="46d18b54-570a-48ac-a3fc-270d3925de5b" containerID="ba6ba64cdc94fdda16ce92ce8b58f53df6240a5966593bdc36c7595ae3aec777" exitCode=0
Sep 18 21:45:01.405578 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:01.405220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd" event={"ID":"46d18b54-570a-48ac-a3fc-270d3925de5b","Type":"ContainerDied","Data":"ba6ba64cdc94fdda16ce92ce8b58f53df6240a5966593bdc36c7595ae3aec777"}
Sep 18 21:45:01.405578 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:01.405257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd" event={"ID":"46d18b54-570a-48ac-a3fc-270d3925de5b","Type":"ContainerStarted","Data":"dc1453c076f8ff4d0b1917be2866cb3768681986e5837016474dc05f5233e757"}
Sep 18 21:45:02.541270 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:02.541246    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"
Sep 18 21:45:03.415711 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:03.415674    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd" event={"ID":"46d18b54-570a-48ac-a3fc-270d3925de5b","Type":"ContainerDied","Data":"dc1453c076f8ff4d0b1917be2866cb3768681986e5837016474dc05f5233e757"}
Sep 18 21:45:03.415906 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:03.415721    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc1453c076f8ff4d0b1917be2866cb3768681986e5837016474dc05f5233e757"
Sep 18 21:45:03.415906 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:03.415690    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829465-7ctkd"
Sep 18 21:45:07.113265 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.113234    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"]
Sep 18 21:45:07.113642 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.113537    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d18b54-570a-48ac-a3fc-270d3925de5b" containerName="cleanup"
Sep 18 21:45:07.113642 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.113549    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d18b54-570a-48ac-a3fc-270d3925de5b" containerName="cleanup"
Sep 18 21:45:07.113642 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.113606    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d18b54-570a-48ac-a3fc-270d3925de5b" containerName="cleanup"
Sep 18 21:45:07.116551 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.116523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.120665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.120639    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-14f9af6a-kserve-self-signed-certs\""
Sep 18 21:45:07.132432 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.132401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"]
Sep 18 21:45:07.204261 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.204220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-dshm\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.204261 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.204273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g7bs\" (UniqueName: \"kubernetes.io/projected/7542da48-3025-466f-92c8-351e6908bde8-kube-api-access-5g7bs\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.204509 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.204330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-model-cache\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.204509 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.204360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7542da48-3025-466f-92c8-351e6908bde8-tls-certs\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.204509 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.204447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-tmp-dir\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.204509 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.204483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-home\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305288 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-model-cache\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305288 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7542da48-3025-466f-92c8-351e6908bde8-tls-certs\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-tmp-dir\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-home\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-dshm\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305531 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g7bs\" (UniqueName: \"kubernetes.io/projected/7542da48-3025-466f-92c8-351e6908bde8-kube-api-access-5g7bs\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305774 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-model-cache\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305836 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-home\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.305836 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.305810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-tmp-dir\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.307676 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.307652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-dshm\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.307992 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.307976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7542da48-3025-466f-92c8-351e6908bde8-tls-certs\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.315004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.314982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g7bs\" (UniqueName: \"kubernetes.io/projected/7542da48-3025-466f-92c8-351e6908bde8-kube-api-access-5g7bs\") pod \"e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") " pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.425813 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.425719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:07.702108 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:07.702081    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"]
Sep 18 21:45:07.703799 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:45:07.703771    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7542da48_3025_466f_92c8_351e6908bde8.slice/crio-da7e2cce8e7386a945c310472bee054a84921a443a8088da5ed5822b66e8e6e8 WatchSource:0}: Error finding container da7e2cce8e7386a945c310472bee054a84921a443a8088da5ed5822b66e8e6e8: Status 404 returned error can't find the container with id da7e2cce8e7386a945c310472bee054a84921a443a8088da5ed5822b66e8e6e8
Sep 18 21:45:08.437985 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:08.437947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5" event={"ID":"7542da48-3025-466f-92c8-351e6908bde8","Type":"ContainerStarted","Data":"8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29"}
Sep 18 21:45:08.437985 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:08.437992    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5" event={"ID":"7542da48-3025-466f-92c8-351e6908bde8","Type":"ContainerStarted","Data":"da7e2cce8e7386a945c310472bee054a84921a443a8088da5ed5822b66e8e6e8"}
Sep 18 21:45:08.469244 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:08.469189    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5" podStartSLOduration=1.469171046 podStartE2EDuration="1.469171046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:45:08.466931714 +0000 UTC m=+2341.929711069" watchObservedRunningTime="2026-09-18 21:45:08.469171046 +0000 UTC m=+2341.931950403"
Sep 18 21:45:09.240289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:09.240254    2576 scope.go:117] "RemoveContainer" containerID="792e2466cd630494d08f0111d159c1aad3938a44d931f1470750c6088929e416"
Sep 18 21:45:10.131938 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:10.131874    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:17.426672 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:17.426637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:17.427212 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:17.426962    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:17.439131 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:17.439101    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:17.489071 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:17.489039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:19.352828 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:19.352788    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:27.786024 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:27.785977    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"]
Sep 18 21:45:29.921918 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:29.921861    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:39.059978 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:39.059943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:42.804901 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:42.804830    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5" podUID="7542da48-3025-466f-92c8-351e6908bde8" containerName="main" containerID="cri-o://8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29" gracePeriod=45
Sep 18 21:45:43.052089 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.052063    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:43.112991 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.112950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7542da48-3025-466f-92c8-351e6908bde8-tls-certs\") pod \"7542da48-3025-466f-92c8-351e6908bde8\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") "
Sep 18 21:45:43.113184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-dshm\") pod \"7542da48-3025-466f-92c8-351e6908bde8\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") "
Sep 18 21:45:43.113184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113064    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-home\") pod \"7542da48-3025-466f-92c8-351e6908bde8\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") "
Sep 18 21:45:43.113184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113104    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-tmp-dir\") pod \"7542da48-3025-466f-92c8-351e6908bde8\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") "
Sep 18 21:45:43.113184 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113131    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g7bs\" (UniqueName: \"kubernetes.io/projected/7542da48-3025-466f-92c8-351e6908bde8-kube-api-access-5g7bs\") pod \"7542da48-3025-466f-92c8-351e6908bde8\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") "
Sep 18 21:45:43.113396 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-model-cache\") pod \"7542da48-3025-466f-92c8-351e6908bde8\" (UID: \"7542da48-3025-466f-92c8-351e6908bde8\") "
Sep 18 21:45:43.113396 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-home" (OuterVolumeSpecName: "home") pod "7542da48-3025-466f-92c8-351e6908bde8" (UID: "7542da48-3025-466f-92c8-351e6908bde8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:45:43.113487 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113385    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7542da48-3025-466f-92c8-351e6908bde8" (UID: "7542da48-3025-466f-92c8-351e6908bde8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:45:43.113596 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.113573    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-model-cache" (OuterVolumeSpecName: "model-cache") pod "7542da48-3025-466f-92c8-351e6908bde8" (UID: "7542da48-3025-466f-92c8-351e6908bde8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:45:43.115384 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.115359    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7542da48-3025-466f-92c8-351e6908bde8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7542da48-3025-466f-92c8-351e6908bde8" (UID: "7542da48-3025-466f-92c8-351e6908bde8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:45:43.115484 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.115402    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-dshm" (OuterVolumeSpecName: "dshm") pod "7542da48-3025-466f-92c8-351e6908bde8" (UID: "7542da48-3025-466f-92c8-351e6908bde8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:45:43.115536 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.115482    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7542da48-3025-466f-92c8-351e6908bde8-kube-api-access-5g7bs" (OuterVolumeSpecName: "kube-api-access-5g7bs") pod "7542da48-3025-466f-92c8-351e6908bde8" (UID: "7542da48-3025-466f-92c8-351e6908bde8"). InnerVolumeSpecName "kube-api-access-5g7bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:45:43.213786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.213749    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-tmp-dir\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:43.213786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.213780    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g7bs\" (UniqueName: \"kubernetes.io/projected/7542da48-3025-466f-92c8-351e6908bde8-kube-api-access-5g7bs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:43.213786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.213791    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-model-cache\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:43.213786 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.213799    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7542da48-3025-466f-92c8-351e6908bde8-tls-certs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:43.214097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.213807    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-dshm\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:43.214097 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.213814    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7542da48-3025-466f-92c8-351e6908bde8-home\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:43.600158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.600121    2576 generic.go:356] "Generic (PLEG): container finished" podID="7542da48-3025-466f-92c8-351e6908bde8" containerID="8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29" exitCode=0
Sep 18 21:45:43.600158 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.600162    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"
Sep 18 21:45:43.600385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.600208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5" event={"ID":"7542da48-3025-466f-92c8-351e6908bde8","Type":"ContainerDied","Data":"8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29"}
Sep 18 21:45:43.600385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.600251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5" event={"ID":"7542da48-3025-466f-92c8-351e6908bde8","Type":"ContainerDied","Data":"da7e2cce8e7386a945c310472bee054a84921a443a8088da5ed5822b66e8e6e8"}
Sep 18 21:45:43.600385 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.600267    2576 scope.go:117] "RemoveContainer" containerID="8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29"
Sep 18 21:45:43.609007 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.608988    2576 scope.go:117] "RemoveContainer" containerID="8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29"
Sep 18 21:45:43.609299 ip-10-0-132-35 kubenswrapper[2576]: E0918 21:45:43.609281    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29\": container with ID starting with 8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29 not found: ID does not exist" containerID="8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29"
Sep 18 21:45:43.609360 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.609307    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29"} err="failed to get container status \"8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29\": rpc error: code = NotFound desc = could not find container \"8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29\": container with ID starting with 8c06f61b13b45886f24a11a9ffeed67f899cbc19c37d8cd8d23992aafed61c29 not found: ID does not exist"
Sep 18 21:45:43.640005 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.639971    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"]
Sep 18 21:45:43.641771 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:43.641748    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-14f9af6a-kserve-59895d4f99-scct5"]
Sep 18 21:45:44.740686 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:44.740650    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7542da48-3025-466f-92c8-351e6908bde8" path="/var/lib/kubelet/pods/7542da48-3025-466f-92c8-351e6908bde8/volumes"
Sep 18 21:45:45.866877 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:45.866839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:46.073422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.073384    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"]
Sep 18 21:45:46.073791 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.073767    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7542da48-3025-466f-92c8-351e6908bde8" containerName="main"
Sep 18 21:45:46.073876 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.073793    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7542da48-3025-466f-92c8-351e6908bde8" containerName="main"
Sep 18 21:45:46.073876 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.073864    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7542da48-3025-466f-92c8-351e6908bde8" containerName="main"
Sep 18 21:45:46.078309 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.078286    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.092973 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.092937    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 21:45:46.092973 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.092967    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 21:45:46.093179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.092967    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 21:45:46.093179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.092971    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 21:45:46.093179 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.093066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dcnql\""
Sep 18 21:45:46.133915 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.133815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a557e9a5-3ddc-4763-a939-c96cc99d5d04-openshift-service-ca\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.134105 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.133917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-maas-api-tls\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.134105 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.134045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46xw\" (UniqueName: \"kubernetes.io/projected/a557e9a5-3ddc-4763-a939-c96cc99d5d04-kube-api-access-t46xw\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.134232 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.134117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-metrics-certs\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.134232 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.134178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"]
Sep 18 21:45:46.234950 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.234903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t46xw\" (UniqueName: \"kubernetes.io/projected/a557e9a5-3ddc-4763-a939-c96cc99d5d04-kube-api-access-t46xw\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.235161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.234975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-metrics-certs\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.235161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.235014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a557e9a5-3ddc-4763-a939-c96cc99d5d04-openshift-service-ca\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.235161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.235057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-maas-api-tls\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.235726 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.235701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a557e9a5-3ddc-4763-a939-c96cc99d5d04-openshift-service-ca\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.237468 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.237446    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-maas-api-tls\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.237563 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.237502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-metrics-certs\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.258161 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.258130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46xw\" (UniqueName: \"kubernetes.io/projected/a557e9a5-3ddc-4763-a939-c96cc99d5d04-kube-api-access-t46xw\") pod \"maas-api-5598d8c9fb-84cmh\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.388475 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.388380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:46.692670 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.692590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"]
Sep 18 21:45:46.695823 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:45:46.695796    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda557e9a5_3ddc_4763_a939_c96cc99d5d04.slice/crio-2217c5a3ee6115e327bdecd723828caac1c156c4d08710885ac5c7d59cad1229 WatchSource:0}: Error finding container 2217c5a3ee6115e327bdecd723828caac1c156c4d08710885ac5c7d59cad1229: Status 404 returned error can't find the container with id 2217c5a3ee6115e327bdecd723828caac1c156c4d08710885ac5c7d59cad1229
Sep 18 21:45:46.697378 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:46.697356    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 21:45:47.620535 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:47.620492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh" event={"ID":"a557e9a5-3ddc-4763-a939-c96cc99d5d04","Type":"ContainerStarted","Data":"2217c5a3ee6115e327bdecd723828caac1c156c4d08710885ac5c7d59cad1229"}
Sep 18 21:45:49.631430 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:49.631396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh" event={"ID":"a557e9a5-3ddc-4763-a939-c96cc99d5d04","Type":"ContainerStarted","Data":"7a92771e60072e05b635d707912411042c6b32777f35d19c3b6ad9a40725d1ec"}
Sep 18 21:45:49.631963 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:49.631536    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:49.661779 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:49.661728    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh" podStartSLOduration=1.360153919 podStartE2EDuration="3.661712644s" totalImagesPullingTime="2.301558725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:45:49.661074785 +0000 UTC m=+2383.123854141" watchObservedRunningTime="2026-09-18 21:45:49.661712644 +0000 UTC m=+2383.124492001"
Sep 18 21:45:53.428117 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.428076    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"]
Sep 18 21:45:53.428569 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.428268    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh" podUID="a557e9a5-3ddc-4763-a939-c96cc99d5d04" containerName="maas-api" containerID="cri-o://7a92771e60072e05b635d707912411042c6b32777f35d19c3b6ad9a40725d1ec" gracePeriod=30
Sep 18 21:45:53.652827 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.652788    2576 generic.go:356] "Generic (PLEG): container finished" podID="a557e9a5-3ddc-4763-a939-c96cc99d5d04" containerID="7a92771e60072e05b635d707912411042c6b32777f35d19c3b6ad9a40725d1ec" exitCode=0
Sep 18 21:45:53.652983 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.652847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh" event={"ID":"a557e9a5-3ddc-4763-a939-c96cc99d5d04","Type":"ContainerDied","Data":"7a92771e60072e05b635d707912411042c6b32777f35d19c3b6ad9a40725d1ec"}
Sep 18 21:45:53.668836 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.668808    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:53.689289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.689205    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-maas-api-tls\") pod \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") "
Sep 18 21:45:53.689289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.689251    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t46xw\" (UniqueName: \"kubernetes.io/projected/a557e9a5-3ddc-4763-a939-c96cc99d5d04-kube-api-access-t46xw\") pod \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") "
Sep 18 21:45:53.689289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.689266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-metrics-certs\") pod \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") "
Sep 18 21:45:53.689289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.689285    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a557e9a5-3ddc-4763-a939-c96cc99d5d04-openshift-service-ca\") pod \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\" (UID: \"a557e9a5-3ddc-4763-a939-c96cc99d5d04\") "
Sep 18 21:45:53.689743 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.689711    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a557e9a5-3ddc-4763-a939-c96cc99d5d04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a557e9a5-3ddc-4763-a939-c96cc99d5d04" (UID: "a557e9a5-3ddc-4763-a939-c96cc99d5d04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:45:53.691604 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.691566    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a557e9a5-3ddc-4763-a939-c96cc99d5d04" (UID: "a557e9a5-3ddc-4763-a939-c96cc99d5d04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:45:53.691604 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.691598    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a557e9a5-3ddc-4763-a939-c96cc99d5d04-kube-api-access-t46xw" (OuterVolumeSpecName: "kube-api-access-t46xw") pod "a557e9a5-3ddc-4763-a939-c96cc99d5d04" (UID: "a557e9a5-3ddc-4763-a939-c96cc99d5d04"). InnerVolumeSpecName "kube-api-access-t46xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:45:53.691768 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.691665    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a557e9a5-3ddc-4763-a939-c96cc99d5d04" (UID: "a557e9a5-3ddc-4763-a939-c96cc99d5d04"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:45:53.789741 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.789693    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-maas-api-tls\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:53.789741 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.789731    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t46xw\" (UniqueName: \"kubernetes.io/projected/a557e9a5-3ddc-4763-a939-c96cc99d5d04-kube-api-access-t46xw\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:53.789741 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.789745    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a557e9a5-3ddc-4763-a939-c96cc99d5d04-metrics-certs\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:53.790104 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.789758    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a557e9a5-3ddc-4763-a939-c96cc99d5d04-openshift-service-ca\") on node \"ip-10-0-132-35.ec2.internal\" DevicePath \"\""
Sep 18 21:45:53.950598 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:53.950512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:45:54.659053 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:54.659015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh" event={"ID":"a557e9a5-3ddc-4763-a939-c96cc99d5d04","Type":"ContainerDied","Data":"2217c5a3ee6115e327bdecd723828caac1c156c4d08710885ac5c7d59cad1229"}
Sep 18 21:45:54.659467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:54.659100    2576 scope.go:117] "RemoveContainer" containerID="7a92771e60072e05b635d707912411042c6b32777f35d19c3b6ad9a40725d1ec"
Sep 18 21:45:54.659467 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:54.659030    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"
Sep 18 21:45:54.684920 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:54.684871    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"]
Sep 18 21:45:54.690481 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:54.690450    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-84cmh"]
Sep 18 21:45:54.739718 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:45:54.739680    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a557e9a5-3ddc-4763-a939-c96cc99d5d04" path="/var/lib/kubelet/pods/a557e9a5-3ddc-4763-a939-c96cc99d5d04/volumes"
Sep 18 21:46:03.596033 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:03.596000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:46:09.261289 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:09.261251    2576 scope.go:117] "RemoveContainer" containerID="f1a1309faba44c9315518998318f3fe798b27df98d461fc0162b69c1e61813df"
Sep 18 21:46:09.270012 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:09.269983    2576 scope.go:117] "RemoveContainer" containerID="ca831df24149dde780c2d274869f6a24fa15bccb8b8f3a664c335fcc9fcd447e"
Sep 18 21:46:09.277465 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:09.277443    2576 scope.go:117] "RemoveContainer" containerID="46ef0710a728658319b4e4258bd6e0622d32b36e4f6eac574ade2dc601e7686d"
Sep 18 21:46:09.900294 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:09.900258    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:46:16.961020 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:16.960985    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-f64kw"]
Sep 18 21:46:25.640565 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:25.640492    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gqd27_05419066-c709-452e-b1c6-8ce023b52954/server/0.log"
Sep 18 21:46:25.789794 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:25.789759    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-b89p4_1d15df4e-84b2-4956-b864-e1463fd6af22/manager/0.log"
Sep 18 21:46:26.080628 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:26.080603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f94bc69c-kk28z_078bb7f5-0022-4579-9677-11866ed36e0d/copy-manifests/0.log"
Sep 18 21:46:26.104090 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:26.104066    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f94bc69c-kk28z_078bb7f5-0022-4579-9677-11866ed36e0d/manager/0.log"
Sep 18 21:46:26.864030 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:26.864004    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829450-kgsfp_eb305ef1-4ed1-4460-b881-a5ec61916180/cleanup/0.log"
Sep 18 21:46:27.005071 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:27.005043    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829465-7ctkd_46d18b54-570a-48ac-a3fc-270d3925de5b/cleanup/0.log"
Sep 18 21:46:28.619977 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:28.619947    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-f64kw_e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d/limitador/0.log"
Sep 18 21:46:29.258435 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:29.258399    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5vgzv_0094264d-0993-44e3-970c-07d4b81ee407/discovery/0.log"
Sep 18 21:46:30.065798 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:30.065767    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f75549b6d-nxsnx_2e9988a4-d39e-42e9-b9c8-ed88ceccd49e/router/0.log"
Sep 18 21:46:31.106506 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:31.106475    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-sfhfc_fb2660ed-f6d3-4eb2-8f68-266922629f56/main/0.log"
Sep 18 21:46:36.422347 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.422304    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s7tjl/must-gather-hnr8h"]
Sep 18 21:46:36.422823 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.422749    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a557e9a5-3ddc-4763-a939-c96cc99d5d04" containerName="maas-api"
Sep 18 21:46:36.422823 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.422768    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a557e9a5-3ddc-4763-a939-c96cc99d5d04" containerName="maas-api"
Sep 18 21:46:36.422979 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.422837    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a557e9a5-3ddc-4763-a939-c96cc99d5d04" containerName="maas-api"
Sep 18 21:46:36.428017 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.427993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.433514 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.433469    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s7tjl\"/\"openshift-service-ca.crt\""
Sep 18 21:46:36.433661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.433603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s7tjl\"/\"default-dockercfg-jr7nq\""
Sep 18 21:46:36.439813 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.439791    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s7tjl\"/\"kube-root-ca.crt\""
Sep 18 21:46:36.444243 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.444217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s7tjl/must-gather-hnr8h"]
Sep 18 21:46:36.543229 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.543190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0bf70ae3-3909-472c-8d73-d207d450dbbc-must-gather-output\") pod \"must-gather-hnr8h\" (UID: \"0bf70ae3-3909-472c-8d73-d207d450dbbc\") " pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.543422 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.543318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27dhf\" (UniqueName: \"kubernetes.io/projected/0bf70ae3-3909-472c-8d73-d207d450dbbc-kube-api-access-27dhf\") pod \"must-gather-hnr8h\" (UID: \"0bf70ae3-3909-472c-8d73-d207d450dbbc\") " pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.644534 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.644488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0bf70ae3-3909-472c-8d73-d207d450dbbc-must-gather-output\") pod \"must-gather-hnr8h\" (UID: \"0bf70ae3-3909-472c-8d73-d207d450dbbc\") " pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.644665 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.644572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27dhf\" (UniqueName: \"kubernetes.io/projected/0bf70ae3-3909-472c-8d73-d207d450dbbc-kube-api-access-27dhf\") pod \"must-gather-hnr8h\" (UID: \"0bf70ae3-3909-472c-8d73-d207d450dbbc\") " pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.644871 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.644836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0bf70ae3-3909-472c-8d73-d207d450dbbc-must-gather-output\") pod \"must-gather-hnr8h\" (UID: \"0bf70ae3-3909-472c-8d73-d207d450dbbc\") " pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.654645 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.654616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27dhf\" (UniqueName: \"kubernetes.io/projected/0bf70ae3-3909-472c-8d73-d207d450dbbc-kube-api-access-27dhf\") pod \"must-gather-hnr8h\" (UID: \"0bf70ae3-3909-472c-8d73-d207d450dbbc\") " pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:36.736413 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:36.736322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s7tjl/must-gather-hnr8h"
Sep 18 21:46:37.021100 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:37.021019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s7tjl/must-gather-hnr8h"]
Sep 18 21:46:37.024084 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:46:37.024051    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bf70ae3_3909_472c_8d73_d207d450dbbc.slice/crio-bcae4fe1d855f51729d9b1dd26b3fc2a359c89c0612907943fe136c07a7a65b9 WatchSource:0}: Error finding container bcae4fe1d855f51729d9b1dd26b3fc2a359c89c0612907943fe136c07a7a65b9: Status 404 returned error can't find the container with id bcae4fe1d855f51729d9b1dd26b3fc2a359c89c0612907943fe136c07a7a65b9
Sep 18 21:46:37.846145 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:37.846111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s7tjl/must-gather-hnr8h" event={"ID":"0bf70ae3-3909-472c-8d73-d207d450dbbc","Type":"ContainerStarted","Data":"b0b864e12db26f6377a03e9af75ec20b14b2f69985badcf5f957ac4928595a84"}
Sep 18 21:46:37.846661 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:37.846153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s7tjl/must-gather-hnr8h" event={"ID":"0bf70ae3-3909-472c-8d73-d207d450dbbc","Type":"ContainerStarted","Data":"bcae4fe1d855f51729d9b1dd26b3fc2a359c89c0612907943fe136c07a7a65b9"}
Sep 18 21:46:38.852926 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:38.852869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s7tjl/must-gather-hnr8h" event={"ID":"0bf70ae3-3909-472c-8d73-d207d450dbbc","Type":"ContainerStarted","Data":"cfb40add74ffc50761c1a65920598c096cd3d25408fd9a390003ec10a685c41e"}
Sep 18 21:46:38.878857 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:38.878769    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s7tjl/must-gather-hnr8h" podStartSLOduration=2.15342584 podStartE2EDuration="2.878732402s" totalImagesPullingTime="725.306562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:46:38.878499856 +0000 UTC m=+2432.341279219" watchObservedRunningTime="2026-09-18 21:46:38.878732402 +0000 UTC m=+2432.341511761"
Sep 18 21:46:39.773705 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:39.773677    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l5vwq_24082157-d36f-4cf7-8026-b253225d4152/global-pull-secret-syncer/0.log"
Sep 18 21:46:40.059822 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:40.059745    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cs4qk_072721b7-2162-4803-99b4-3ff1b3abc46f/konnectivity-agent/0.log"
Sep 18 21:46:40.229912 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:40.229856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-35.ec2.internal_1ea788e54b0bcc9e8cb0dd6d7a3cde7f/haproxy/0.log"
Sep 18 21:46:44.746451 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:44.746410    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-f64kw_e05f9495-b6c3-400b-ba7d-7ef9c5d30f2d/limitador/0.log"
Sep 18 21:46:48.450409 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:48.450364    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k84s9_50417478-fa32-4eb6-9366-fed81a11e123/node-exporter/0.log"
Sep 18 21:46:48.529080 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:48.529046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k84s9_50417478-fa32-4eb6-9366-fed81a11e123/kube-rbac-proxy/0.log"
Sep 18 21:46:48.596192 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:48.596170    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k84s9_50417478-fa32-4eb6-9366-fed81a11e123/init-textfile/0.log"
Sep 18 21:46:49.031852 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.031784    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"]
Sep 18 21:46:49.034800 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.034775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.058866 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.058822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"]
Sep 18 21:46:49.066824 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.066780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrj5\" (UniqueName: \"kubernetes.io/projected/30b837b7-53a1-4632-b52e-993e037cc3c9-kube-api-access-rnrj5\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.067004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.066906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-proc\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.067004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.066960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-sys\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.067004 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.066989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-podres\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.067180 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.067049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-lib-modules\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.167796 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.167762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-sys\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.167796 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.167798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-podres\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.167915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-sys\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.167927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-lib-modules\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.167966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-podres\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.168018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrj5\" (UniqueName: \"kubernetes.io/projected/30b837b7-53a1-4632-b52e-993e037cc3c9-kube-api-access-rnrj5\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.168047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-proc\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168069 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.168051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-lib-modules\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.168284 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.168124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30b837b7-53a1-4632-b52e-993e037cc3c9-proc\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.180132 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.180104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrj5\" (UniqueName: \"kubernetes.io/projected/30b837b7-53a1-4632-b52e-993e037cc3c9-kube-api-access-rnrj5\") pod \"perf-node-gather-daemonset-lwcpl\" (UID: \"30b837b7-53a1-4632-b52e-993e037cc3c9\") " pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.346464 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.346412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.669282 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.666977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"]
Sep 18 21:46:49.669972 ip-10-0-132-35 kubenswrapper[2576]: W0918 21:46:49.669936    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod30b837b7_53a1_4632_b52e_993e037cc3c9.slice/crio-fd95f9683c0767df6713e11dc7fb2c064397cb78b279b149a702337ee4ed4b21 WatchSource:0}: Error finding container fd95f9683c0767df6713e11dc7fb2c064397cb78b279b149a702337ee4ed4b21: Status 404 returned error can't find the container with id fd95f9683c0767df6713e11dc7fb2c064397cb78b279b149a702337ee4ed4b21
Sep 18 21:46:49.919164 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.919070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl" event={"ID":"30b837b7-53a1-4632-b52e-993e037cc3c9","Type":"ContainerStarted","Data":"34c4c9d41a383377c0d1db3504cd90e9136d5b9aab758c7844671d912cb5cf29"}
Sep 18 21:46:49.919164 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.919131    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl" event={"ID":"30b837b7-53a1-4632-b52e-993e037cc3c9","Type":"ContainerStarted","Data":"fd95f9683c0767df6713e11dc7fb2c064397cb78b279b149a702337ee4ed4b21"}
Sep 18 21:46:49.919407 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.919181    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:49.958410 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:49.958353    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl" podStartSLOduration=0.958334808 podStartE2EDuration="958.334808ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:46:49.957345417 +0000 UTC m=+2443.420124773" watchObservedRunningTime="2026-09-18 21:46:49.958334808 +0000 UTC m=+2443.421114165"
Sep 18 21:46:54.315014 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:54.314982    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-8jqcn_dfe498fb-6015-4a54-8ab1-8cd42b38a672/volume-data-source-validator/0.log"
Sep 18 21:46:55.699291 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:55.699255    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cp56w_bc0ad977-a226-4180-bf03-2073ead4e8ee/dns/0.log"
Sep 18 21:46:55.810415 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:55.810386    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cp56w_bc0ad977-a226-4180-bf03-2073ead4e8ee/kube-rbac-proxy/0.log"
Sep 18 21:46:55.934096 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:55.934068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s7tjl/perf-node-gather-daemonset-lwcpl"
Sep 18 21:46:56.329569 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:56.329535    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8f5mc_b796fb3a-f153-4c19-96b8-daaa56085f10/dns-node-resolver/0.log"
Sep 18 21:46:57.173663 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:57.173631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bllf_908f8b7e-ee99-4230-a68d-a9802c560b09/node-ca/0.log"
Sep 18 21:46:59.804782 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:46:59.804678    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5vgzv_0094264d-0993-44e3-970c-07d4b81ee407/discovery/0.log"
Sep 18 21:47:00.145519 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:00.145485    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f75549b6d-nxsnx_2e9988a4-d39e-42e9-b9c8-ed88ceccd49e/router/0.log"
Sep 18 21:47:01.151200 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:01.151105    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5vgzv_0094264d-0993-44e3-970c-07d4b81ee407/discovery/0.log"
Sep 18 21:47:01.509225 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:01.509178    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f75549b6d-nxsnx_2e9988a4-d39e-42e9-b9c8-ed88ceccd49e/router/0.log"
Sep 18 21:47:01.608735 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:01.608693    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jsgl9_e137c6da-eae6-42c9-a221-e0aa00d55d47/serve-healthcheck-canary/0.log"
Sep 18 21:47:02.702227 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:02.702196    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8tpw_aba8cc54-d4fb-439c-93df-89c220467462/kube-rbac-proxy/0.log"
Sep 18 21:47:02.781500 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:02.781473    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8tpw_aba8cc54-d4fb-439c-93df-89c220467462/exporter/0.log"
Sep 18 21:47:02.813652 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:02.813623    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8tpw_aba8cc54-d4fb-439c-93df-89c220467462/extractor/0.log"
Sep 18 21:47:03.559298 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:03.559259    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5vgzv_0094264d-0993-44e3-970c-07d4b81ee407/discovery/0.log"
Sep 18 21:47:03.922486 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:03.922449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f75549b6d-nxsnx_2e9988a4-d39e-42e9-b9c8-ed88ceccd49e/router/0.log"
Sep 18 21:47:06.244599 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:06.244567    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gqd27_05419066-c709-452e-b1c6-8ce023b52954/server/0.log"
Sep 18 21:47:06.413623 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:06.413589    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-b89p4_1d15df4e-84b2-4956-b864-e1463fd6af22/manager/0.log"
Sep 18 21:47:06.741020 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:06.740980    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f94bc69c-kk28z_078bb7f5-0022-4579-9677-11866ed36e0d/manager/0.log"
Sep 18 21:47:06.788456 ip-10-0-132-35 kubenswrapper[2576]: I0918 21:47:06.788428    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f94bc69c-kk28z_078bb7f5-0022-4579-9677-11866ed36e0d/copy-manifests/0.log"