Sep 19 11:33:47.706213 ip-10-0-133-160 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 11:33:48.086418 ip-10-0-133-160 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 11:33:48.086418 ip-10-0-133-160 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 11:33:48.086418 ip-10-0-133-160 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 11:33:48.086418 ip-10-0-133-160 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 11:33:48.086418 ip-10-0-133-160 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 11:33:48.087344 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.087258    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 11:33:48.091261 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091240    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 11:33:48.091261 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091257    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 11:33:48.091261 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091262    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 11:33:48.091261 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091266    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 11:33:48.091261 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091269    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091274    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091278    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091281    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091285    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091290    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091293    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091297    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091301    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091305    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091309    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091313    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091317    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091321    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091324    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091334    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091338    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091342    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091346    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091350    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 11:33:48.091554 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091354    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091358    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091362    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091366    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091370    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091374    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091377    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091381    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091386    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091390    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091394    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091398    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091402    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091409    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091417    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091422    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091427    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091431    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091436    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 11:33:48.092443 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091440    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091444    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091448    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091455    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091460    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091464    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091468    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091472    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091476    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091480    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091484    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091489    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091493    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091497    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091501    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091506    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091510    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091514    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091518    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091523    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 11:33:48.093276 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091527    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091531    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091538    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091543    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091548    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091552    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091558    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091565    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091572    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091577    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091581    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091585    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091590    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091594    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091598    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091603    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091607    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091611    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091615    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091619    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 11:33:48.094129 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091623    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091627    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091631    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091636    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091639    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091644    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091648    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091652    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091656    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091660    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091664    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091669    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091672    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091676    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091680    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.091684    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092806    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092815    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092819    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092824    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 11:33:48.095003 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092829    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092835    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092840    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092846    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092851    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092855    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092859    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092864    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092868    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092872    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092876    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092880    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092884    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092888    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092892    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092896    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092900    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092905    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092909    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 11:33:48.095856 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092912    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092917    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092940    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092945    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092949    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092953    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092957    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092962    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092966    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092970    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092974    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092978    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092987    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092993    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.092998    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093003    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093008    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093012    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093016    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 11:33:48.096481 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093021    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093026    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093030    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093035    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093038    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093042    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093047    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093051    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093055    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093059    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093063    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093067    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093072    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093075    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093080    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093084    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093088    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093092    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093097    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093101    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 11:33:48.097028 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093105    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093109    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093113    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093117    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093122    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093127    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093131    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093136    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093144    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093150    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093155    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093159    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093164    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093169    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093174    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093178    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093183    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093187    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093192    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093196    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 11:33:48.097664 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093201    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093205    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093209    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093213    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093218    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093222    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093226    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093230    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093234    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093238    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093243    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093247    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093251    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093255    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093259    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093263    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093267    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093836    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093845    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093849    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 11:33:48.098212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093854    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093860    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093864    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093869    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093873    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093878    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093882    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093886    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093891    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093895    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093900    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093904    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093917    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093936    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093941    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093945    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093950    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093953    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093958    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 11:33:48.098772 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093962    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093967    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093971    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093978    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093985    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093990    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093994    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.093999    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094003    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094007    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094015    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094020    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094024    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094029    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094034    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094040    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094044    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094048    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094052    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 11:33:48.099269 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094057    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094062    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094069    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094074    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094078    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094082    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094088    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094092    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094097    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094101    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094105    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094109    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094113    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094117    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094121    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094125    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094129    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094133    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094137    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094141    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 11:33:48.099730 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094145    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094149    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094153    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094158    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094162    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094169    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094173    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094177    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094181    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094186    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094191    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094195    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094199    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094203    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094207    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094211    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094215    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094219    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094225    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094231    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 11:33:48.100225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094237    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094241    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094246    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094250    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094255    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094259    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094264    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094269    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094273    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094278    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094282    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094287    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094291    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094296    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094300    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094305    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094310    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.094314    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094413    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094459    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094468    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 11:33:48.100705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094475    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094482    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094487    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094494    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094501    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094506    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094511    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094516    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094522    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094529    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094534    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094539    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094543    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094548    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094553    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094560    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094564    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094569    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094575    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094580    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094586    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094591    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094596    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 11:33:48.101319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094601    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094606    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094610    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094617    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094622    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094627    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094633    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094638    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094642    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094647    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094652    2582 flags.go:64] FLAG: --enable-server="true"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094658    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094665    2582 flags.go:64] FLAG: --event-burst="100"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094670    2582 flags.go:64] FLAG: --event-qps="50"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094674    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094679    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094684    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094689    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094696    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094700    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094705    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094710    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094715    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094720    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094724    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 11:33:48.101918 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094729    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094733    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094738    2582 flags.go:64] FLAG: --feature-gates=""
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094744    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094749    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094754    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094758    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094763    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094768    2582 flags.go:64] FLAG: --help="false"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094773    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094779    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094784    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094789    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094795    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094800    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094805    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094809    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094814    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094818    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094824    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094829    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094833    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094838    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094842    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 11:33:48.102556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094847    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094853    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094858    2582 flags.go:64] FLAG: --lock-file=""
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094862    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094867    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094872    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094880    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094885    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094889    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094894    2582 flags.go:64] FLAG: --logging-format="text"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094899    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094904    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094908    2582 flags.go:64] FLAG: --manifest-url=""
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094913    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094920    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094941    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094947    2582 flags.go:64] FLAG: --max-pods="110"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094952    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094958    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094963    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094968    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094972    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094977    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094982    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094992    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 11:33:48.103230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.094997    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095002    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095006    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095011    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095020    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095024    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095029    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095033    2582 flags.go:64] FLAG: --port="10250"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095040    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095045    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dfb40535285b3877"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095050    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095055    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095060    2582 flags.go:64] FLAG: --register-node="true"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095064    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095070    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095075    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095080    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095084    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095090    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095095    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095100    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095105    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095109    2582 flags.go:64] FLAG: --runonce="false"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095114    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095119    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 11:33:48.103824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095124    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095130    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095134    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095139    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095144    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095149    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095153    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095158    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095162    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095167    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095172    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095178    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095182    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095190    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095195    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095202    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095209    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095214    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095218    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095223    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095228    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095232    2582 flags.go:64] FLAG: --v="2"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095238    2582 flags.go:64] FLAG: --version="false"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095244    2582 flags.go:64] FLAG: --vmodule=""
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095250    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 11:33:48.104454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095255    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095422    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095428    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095432    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095436    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095441    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095445    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095449    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095456    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095460    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095464    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095468    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095472    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095476    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095481    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095486    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095490    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095494    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095498    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 11:33:48.105077 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095503    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095508    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095512    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095519    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095523    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095527    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095532    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095536    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095543    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095548    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095554    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095559    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095563    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095567    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095572    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095576    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095580    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095585    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095589    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 11:33:48.105567 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095593    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095597    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095604    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095608    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095612    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095617    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095621    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095626    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095630    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095634    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095638    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095642    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095647    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095652    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095657    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095664    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095672    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095677    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095681    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 11:33:48.106225 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095685    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095689    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095694    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095698    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095702    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095706    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095710    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095714    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095718    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095722    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095726    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095730    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095735    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095741    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095747    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095753    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095758    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095763    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095767    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095771    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 11:33:48.106784 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095775    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095780    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095784    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095788    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095792    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095797    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095801    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095805    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095810    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095816    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095820    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095824    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095828    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095833    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095836    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095841    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095844    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095848    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095853    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095857    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095861    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 11:33:48.107556 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095864    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.095868    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.095876    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.102815    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.102829    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.103401    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.103408    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103460    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103465    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103469    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103472    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103475    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103478    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103480    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103483    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 11:33:48.108098 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103486    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103489    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103491    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103494    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103497    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103500    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103502    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103505    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103508    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103510    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103513    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103516    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103518    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103521    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103524    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103527    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103530    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103533    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103536    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 11:33:48.108465 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103538    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103542    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103547    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103550    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103553    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103556    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103558    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103561    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103564    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103567    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103570    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103573    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103575    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103578    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103581    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103583    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103586    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103588    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103591    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103594    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 11:33:48.108978 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103596    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103599    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103601    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103606    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103610    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103613    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103616    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103619    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103622    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103625    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103627    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103630    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103633    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103636    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103639    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103642    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103645    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103647    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103650    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 11:33:48.109511 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103653    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103656    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103658    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103661    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103663    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103666    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103668    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103671    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103673    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103676    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103679    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103681    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103684    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103686    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103689    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103691    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103694    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103697    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103699    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103702    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103704    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 11:33:48.110006 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103707    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103710    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103713    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103716    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103719    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103723    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103727    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103730    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103734    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103737    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103740    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103742    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.103747    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103849    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 11:33:48.110513 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103853    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103857    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103859    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103862    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103865    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103868    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103870    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103873    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103876    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103878    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103881    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103885    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103889    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103892    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103896    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103899    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103902    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103905    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103908    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 11:33:48.110860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103911    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103914    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103917    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103919    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103935    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103939    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103942    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103944    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103948    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103951    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103953    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103956    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103959    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103961    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103964    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103966    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103969    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103972    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103974    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103977    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 11:33:48.111371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103979    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103982    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103984    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103987    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103990    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103992    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103995    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.103997    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104000    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104003    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104005    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104008    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104010    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104013    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104016    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104020    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104023    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104025    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104028    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 11:33:48.111851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104030    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104033    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104036    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104038    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104041    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104043    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104046    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104048    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104051    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104054    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104056    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104058    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104061    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104063    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104066    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104068    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104071    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104073    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104076    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104078    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 11:33:48.112371 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104080    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104083    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104085    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104088    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104090    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104093    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104096    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104099    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104102    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104104    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104107    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104109    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104112    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104115    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104117    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104120    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104123    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104125    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104128    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 11:33:48.112851 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:48.104130    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.104135    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.104224    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.108564    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.109283    2582 server.go:1019] "Starting client certificate rotation"
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.109378    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.109405    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.111315    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 11:33:48.113363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.113089    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 11:33:48.123764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.123748    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 19 11:33:48.126851 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.126834    2582 log.go:25] "Validated CRI v1 image API"
Sep 19 11:33:48.129043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.129029    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 11:33:48.131210 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.131188    2582 fs.go:135] Filesystem UUIDs: map[21a6e45e-d71f-4a48-8b8b-12710f2d3a7f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9ffb98cc-ec17-4811-bcb7-6830f5323352:/dev/nvme0n1p4]
Sep 19 11:33:48.131276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.131213    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 11:33:48.135431 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.135415    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 11:33:48.135878 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.135778    2582 manager.go:216] Machine: {Timestamp:2026-09-19 11:33:48.135236484 +0000 UTC m=+0.320262175 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100499 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec267e45be866d70cbe62740784b7dc4 SystemUUID:ec267e45-be86-6d70-cbe6-2740784b7dc4 BootID:8154d81a-83d8-42a7-bba8-af80a59c690d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d0:1b:4c:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d0:1b:4c:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:f1:02:10:82:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 11:33:48.135878 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.135874    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 11:33:48.135982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.135963    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 11:33:48.137600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.137579    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 11:33:48.137753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.137606    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 11:33:48.138258 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.138248    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 11:33:48.138296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.138261    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 11:33:48.138296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.138269    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 11:33:48.138892 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.138882    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 11:33:48.138978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.138969    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 11:33:48.141327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141316    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 11:33:48.141437 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141428    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 11:33:48.141467 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141460    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 11:33:48.141494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141473    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 11:33:48.141494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141483    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 11:33:48.141494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141493    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 19 11:33:48.141574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.141502    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 11:33:48.142291 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.142277    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 11:33:48.142344 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.142304    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 11:33:48.145383 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.145360    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 11:33:48.148029 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.148015    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 11:33:48.148084 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.148046    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 11:33:48.148982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.148971    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.148987    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.148993    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.148998    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149007    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149012    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149025    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149031    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 11:33:48.149034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149037    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 11:33:48.149238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149043    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 11:33:48.149238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149052    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 11:33:48.149238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149057    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 11:33:48.149733 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149720    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 11:33:48.149780 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.149736    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 11:33:48.151831 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.151805    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 11:33:48.151831 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.151805    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 11:33:48.153621 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.153609    2582 server.go:1268] "Started kubelet"
Sep 19 11:33:48.153700 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.153671    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 11:33:48.153814 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.153753    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 11:33:48.153860 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.153844    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 11:33:48.154632 ip-10-0-133-160 systemd[1]: Started Kubernetes Kubelet.
Sep 19 11:33:48.154917 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.154900    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 11:33:48.158598 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.158580    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 11:33:48.159556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.159536    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x8fq5"
Sep 19 11:33:48.159760 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.159744    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 11:33:48.163232 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.163215    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 11:33:48.163893 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.163880    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 11:33:48.164399 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.164383    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 11:33:48.164475 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.164466    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.164655 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.163235    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-160.ec2.internal.18d6b5a662d39b18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-160.ec2.internal,UID:ip-10-0-133-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-160.ec2.internal,},FirstTimestamp:2026-09-19 11:33:48.153584408 +0000 UTC m=+0.338610095,LastTimestamp:2026-09-19 11:33:48.153584408 +0000 UTC m=+0.338610095,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-160.ec2.internal,}"
Sep 19 11:33:48.164873 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.164857    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 11:33:48.164952 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.164875    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 11:33:48.165037 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165016    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 11:33:48.165037 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165027    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 11:33:48.165131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165093    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 11:33:48.165165 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165149    2582 factory.go:55] Registering systemd factory
Sep 19 11:33:48.165210 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165193    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 19 11:33:48.165426 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165412    2582 factory.go:153] Registering CRI-O factory
Sep 19 11:33:48.165478 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165427    2582 factory.go:223] Registration of the crio container factory successfully
Sep 19 11:33:48.165530 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165517    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 11:33:48.165591 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165532    2582 factory.go:103] Registering Raw factory
Sep 19 11:33:48.165591 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165542    2582 manager.go:1196] Started watching for new ooms in manager
Sep 19 11:33:48.165863 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165846    2582 manager.go:349] Starting recovery of all containers
Sep 19 11:33:48.165982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.165891    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x8fq5"
Sep 19 11:33:48.168165 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.168135    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 11:33:48.168165 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.168136    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 11:33:48.177718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.177524    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 11:33:48.178554 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.178540    2582 manager.go:354] Recovery completed
Sep 19 11:33:48.185001 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.184987    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.186906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.186888    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.186994 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.186920    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.186994 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.186949    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.187513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.187499    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 11:33:48.187513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.187510    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.187656 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.187511    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 11:33:48.187656 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.187619    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 11:33:48.188288 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.188269    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.188351 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.188298    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.188351 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.188310    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.188670 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.188659    2582 policy_none.go:49] "None policy: Start"
Sep 19 11:33:48.188713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.188675    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 11:33:48.188713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.188687    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 11:33:48.189779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.189764    2582 policy_none.go:47] "Start"
Sep 19 11:33:48.211632 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.211614    2582 manager.go:337] "Starting Device Plugin manager"
Sep 19 11:33:48.211714 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.211649    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 11:33:48.211714 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.211664    2582 server.go:87] "Starting device plugin registration server"
Sep 19 11:33:48.212003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.211985    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 11:33:48.212094 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.211998    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 11:33:48.212604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.212196    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 11:33:48.212604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.212275    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 11:33:48.212604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.212283    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 11:33:48.212764 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.212689    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 11:33:48.212764 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.212724    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.312312    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.313353    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.313404    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.313415    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.313444    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.321023    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.331003 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.321043    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-160.ec2.internal\": node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.334324 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.334305    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.369055 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.369001    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 11:33:48.369055 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.369047    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 11:33:48.369150 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.369068    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 11:33:48.369150 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.369109    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 11:33:48.371068 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.371054    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 11:33:48.435366 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.435316    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.469712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.469686    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"]
Sep 19 11:33:48.469808 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.469784    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.470853 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.470836    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.470950 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.470865    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.470950 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.470875    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.473300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.473289    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.473413 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.473399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.473457 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.473428    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.474056 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.474034    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.474056 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.474060    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.474190 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.474064    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.474190 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.474084    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.474190 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.474093    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.474190 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.474070    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.476273 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.476258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.476323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.476281    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 11:33:48.478490 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.478475    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 11:33:48.478589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.478503    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 11:33:48.478589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.478517    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeHasSufficientPID"
Sep 19 11:33:48.502418 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.502399    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-160.ec2.internal\" not found" node="ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.506728 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.506711    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-160.ec2.internal\" not found" node="ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.535506 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.535486    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.567536 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.567513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.567536 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.567537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.567677 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.567556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7b7a7384449df783f830280a3100b44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-160.ec2.internal\" (UID: \"c7b7a7384449df783f830280a3100b44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.636101 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.636040    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.668496 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.668473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.668582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.668506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.668582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.668523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7b7a7384449df783f830280a3100b44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-160.ec2.internal\" (UID: \"c7b7a7384449df783f830280a3100b44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.668582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.668558    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.668582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.668570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/732aa783476ab15c97c9ae702301de31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal\" (UID: \"732aa783476ab15c97c9ae702301de31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.668718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.668607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7b7a7384449df783f830280a3100b44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-160.ec2.internal\" (UID: \"c7b7a7384449df783f830280a3100b44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.736660 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.736620    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.806162 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.806140    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.809739 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:48.809718    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:48.836903 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.836876    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:48.937473 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:48.937392    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:50.205852 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.205821    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-160.ec2.internal\" not found"
Sep 19 11:33:50.274850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.274829    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 11:33:50.277519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.277503    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 11:33:50.277640 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.277624    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 11:33:50.277689 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.277657    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 11:33:50.287553 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.287533    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 11:33:50.310543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.310525    2582 apiserver.go:52] "Watching apiserver"
Sep 19 11:33:50.319891 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.319870    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 11:33:50.320216 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.320195    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9j4hc","kube-system/konnectivity-agent-xncc9","openshift-cluster-node-tuning-operator/tuned-szghn","openshift-ovn-kubernetes/ovnkube-node-mp6vf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr","openshift-dns/node-resolver-gf2qm","openshift-image-registry/node-ca-bf9j6","openshift-multus/multus-additional-cni-plugins-z5rpm","openshift-multus/multus-q6c4x","openshift-multus/network-metrics-daemon-sxqbh","openshift-network-diagnostics/network-check-target-s2q9f","openshift-network-operator/iptables-alerter-xzkpp"]
Sep 19 11:33:50.322679 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.322664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.322758 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.322740    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:33:50.324722 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.324706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.326727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.326709    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.326833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.326814    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zxfrx\""
Sep 19 11:33:50.327072 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.327050    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 11:33:50.327231 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.327219    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 11:33:50.329625 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.329607    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.329712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.329650    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hnchx\""
Sep 19 11:33:50.329712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.329704    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.330300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.330283    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.332307 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332290    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 11:33:50.332441 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.332659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332578    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:50.332790 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332769    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 11:33:50.332790 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332783    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 11:33:50.332906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332848    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.332906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332886    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 11:33:50.332988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332905    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.333020 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.332996    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 11:33:50.333167 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.333154    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dw6nj\""
Sep 19 11:33:50.334615 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.334600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.334926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.334895    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 11:33:50.334983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.334900    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.334983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.334941    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.335155 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.335143    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5zwv7\""
Sep 19 11:33:50.336742 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.336725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.336824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.336751    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pb4jp\""
Sep 19 11:33:50.336824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.336753    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.336824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.336765    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.338303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338266    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 11:28:49 +0000 UTC" deadline="2028-03-23 02:12:28.073466438 +0000 UTC"
Sep 19 11:33:50.338352 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338302    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13214h38m37.735166538s"
Sep 19 11:33:50.338352 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-sys-fs\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.338352 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcnj\" (UniqueName: \"kubernetes.io/projected/c028369b-4df8-4d9a-b039-cb5bc414bb0c-kube-api-access-2lcnj\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.338462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-systemd\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.338462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fd294aa-feef-4364-9715-5127ec92db9f-dbus\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.338462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-modprobe-d\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.338462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-etc-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.338622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-ovn\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.338622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-log-socket\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.338622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-cni-netd\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.338622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.338622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-var-lib-kubelet\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.338796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-ovnkube-script-lib\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.338796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-device-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.338796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.338796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/794c3f80-270d-4390-95ac-064346466631-hosts-file\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.338796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6dd\" (UniqueName: \"kubernetes.io/projected/794c3f80-270d-4390-95ac-064346466631-kube-api-access-lh6dd\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.338796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-kubelet\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjxw\" (UniqueName: \"kubernetes.io/projected/d72f4017-3619-4395-a288-ff999b2e35ea-kube-api-access-gwjxw\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7bcvk\""
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-run-netns\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338889    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-node-log\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-ovnkube-config\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338988    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.338989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-registration-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/794c3f80-270d-4390-95ac-064346466631-tmp-dir\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mp4\" (UniqueName: \"kubernetes.io/projected/44d3d61a-05d6-44a7-ad53-1c5040a43976-kube-api-access-r8mp4\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339098    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-systemd\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysconfig\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-run\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-sys\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-host\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysctl-d\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-systemd-units\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-env-overrides\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-socket-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fd294aa-feef-4364-9715-5127ec92db9f-kubelet-config\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3-agent-certs\") pod \"konnectivity-agent-xncc9\" (UID: \"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3\") " pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3-konnectivity-ca\") pod \"konnectivity-agent-xncc9\" (UID: \"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3\") " pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysctl-conf\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-lib-modules\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.339596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-slash\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-var-lib-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-cni-bin\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-kubernetes\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339672    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-tuned\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44d3d61a-05d6-44a7-ad53-1c5040a43976-tmp\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.340141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.339762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72f4017-3619-4395-a288-ff999b2e35ea-ovn-node-metrics-cert\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.341295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vs4j\""
Sep 19 11:33:50.341352 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.341524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341505    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 11:33:50.341598 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341530    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 11:33:50.341643 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341598    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.341643 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.341804 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.341785    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 11:33:50.343346 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.343328    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 11:33:50.343482 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.343468    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"
Sep 19 11:33:50.343537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.343503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4pmfh\""
Sep 19 11:33:50.343850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.343834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:50.344039 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.343924    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 11:33:50.344119 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.344011    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:33:50.345267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.345251    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 11:33:50.346181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.346166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:50.346253 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.346230    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:33:50.348541 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.348524    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal"]
Sep 19 11:33:50.348603 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.348594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.350674 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.350658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-69z9h\""
Sep 19 11:33:50.350762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.350659    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 11:33:50.350877 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.350863    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 11:33:50.350877 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.350872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 11:33:50.351027 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.351010    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal"]
Sep 19 11:33:50.351084 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.351069    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 11:33:50.366712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.366668    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4lz72"
Sep 19 11:33:50.374178 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.374161    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4lz72"
Sep 19 11:33:50.434302 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.434278    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 11:33:50.440390 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-lib-modules\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-slash\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-var-lib-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72f4017-3619-4395-a288-ff999b2e35ea-ovn-node-metrics-cert\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-sys-fs\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6dd\" (UniqueName: \"kubernetes.io/projected/794c3f80-270d-4390-95ac-064346466631-kube-api-access-lh6dd\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-slash\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-system-cni-dir\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-var-lib-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-kubernetes\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-sys-fs\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcnj\" (UniqueName: \"kubernetes.io/projected/c028369b-4df8-4d9a-b039-cb5bc414bb0c-kube-api-access-2lcnj\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-cni-binary-copy\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcphb\" (UniqueName: \"kubernetes.io/projected/68052912-83f1-4d8b-9184-c69b674f30db-kube-api-access-bcphb\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-lib-modules\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-socket-dir-parent\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-kubernetes\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-k8s-cni-cncf-io\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-multus-certs\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-systemd\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fd294aa-feef-4364-9715-5127ec92db9f-dbus\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-log-socket\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-systemd\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-cni-netd\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-cni-netd\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8sx\" (UniqueName: \"kubernetes.io/projected/98b60b02-8436-4c3e-a488-96c4b0b17583-kube-api-access-sl8sx\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.440897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-log-socket\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fd294aa-feef-4364-9715-5127ec92db9f-dbus\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-cni-multus\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-device-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-cni-bin\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-device-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgdpq\" (UniqueName: \"kubernetes.io/projected/cef2049a-63f1-487f-a977-953185811d43-kube-api-access-fgdpq\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.440976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-kubelet\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.440995    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441032    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-kubelet\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjxw\" (UniqueName: \"kubernetes.io/projected/d72f4017-3619-4395-a288-ff999b2e35ea-kube-api-access-gwjxw\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.441116    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:33:50.941092406 +0000 UTC m=+1.958129112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-netns\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-run-netns\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.441622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441189    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-node-log\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-node-log\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441250    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-run-netns\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-registration-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/794c3f80-270d-4390-95ac-064346466631-tmp-dir\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-hostroot\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mp4\" (UniqueName: \"kubernetes.io/projected/44d3d61a-05d6-44a7-ad53-1c5040a43976-kube-api-access-r8mp4\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-registration-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysctl-d\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-systemd-units\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-env-overrides\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-systemd-units\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-cni-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a9fe75-6411-43f2-a606-13056a0368c8-cni-binary-copy\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.442464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-conf-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441575    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysctl-d\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cef2049a-63f1-487f-a977-953185811d43-iptables-alerter-script\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/794c3f80-270d-4390-95ac-064346466631-tmp-dir\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fd294aa-feef-4364-9715-5127ec92db9f-kubelet-config\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3-agent-certs\") pod \"konnectivity-agent-xncc9\" (UID: \"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3\") " pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3-konnectivity-ca\") pod \"konnectivity-agent-xncc9\" (UID: \"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3\") " pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-cni-bin\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fd294aa-feef-4364-9715-5127ec92db9f-kubelet-config\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/794c3f80-270d-4390-95ac-064346466631-hosts-file\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/794c3f80-270d-4390-95ac-064346466631-hosts-file\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-cni-bin\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-etc-kubernetes\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59fdt\" (UniqueName: \"kubernetes.io/projected/e237339b-bb08-479d-8ff0-dc341da0a6b0-kube-api-access-59fdt\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-tuned\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44d3d61a-05d6-44a7-ad53-1c5040a43976-tmp\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-cnibin\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.441998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-modprobe-d\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-etc-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-env-overrides\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-ovn\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98b60b02-8436-4c3e-a488-96c4b0b17583-host\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442152    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442207    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3-konnectivity-ca\") pod \"konnectivity-agent-xncc9\" (UID: \"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3\") " pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cef2049a-63f1-487f-a977-953185811d43-host-slash\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-etc-openvswitch\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-modprobe-d\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-var-lib-kubelet\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-ovn\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-ovnkube-script-lib\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-var-lib-kubelet\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.443856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zb4b\" (UniqueName: \"kubernetes.io/projected/85a9fe75-6411-43f2-a606-13056a0368c8-kube-api-access-6zb4b\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-cnibin\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442627    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85a9fe75-6411-43f2-a606-13056a0368c8-multus-daemon-config\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-ovnkube-config\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-ovnkube-script-lib\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-system-cni-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442824    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-kubelet\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-systemd\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysconfig\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.442948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-run-systemd\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysconfig\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-run\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-sys\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-run\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-host\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98b60b02-8436-4c3e-a488-96c4b0b17583-serviceca\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-socket-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-sys\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-host\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72f4017-3619-4395-a288-ff999b2e35ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysctl-conf\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443250    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c028369b-4df8-4d9a-b039-cb5bc414bb0c-socket-dir\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d72f4017-3619-4395-a288-ff999b2e35ea-ovnkube-config\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.443395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-sysctl-conf\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.444607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44d3d61a-05d6-44a7-ad53-1c5040a43976-etc-tuned\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.444855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.444811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d72f4017-3619-4395-a288-ff999b2e35ea-ovn-node-metrics-cert\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.445285 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.444903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3-agent-certs\") pod \"konnectivity-agent-xncc9\" (UID: \"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3\") " pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.445285 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.445060    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44d3d61a-05d6-44a7-ad53-1c5040a43976-tmp\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.451008 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.450988    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcnj\" (UniqueName: \"kubernetes.io/projected/c028369b-4df8-4d9a-b039-cb5bc414bb0c-kube-api-access-2lcnj\") pod \"aws-ebs-csi-driver-node-v6ggr\" (UID: \"c028369b-4df8-4d9a-b039-cb5bc414bb0c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.451111 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.451011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mp4\" (UniqueName: \"kubernetes.io/projected/44d3d61a-05d6-44a7-ad53-1c5040a43976-kube-api-access-r8mp4\") pod \"tuned-szghn\" (UID: \"44d3d61a-05d6-44a7-ad53-1c5040a43976\") " pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.451111 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.451094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjxw\" (UniqueName: \"kubernetes.io/projected/d72f4017-3619-4395-a288-ff999b2e35ea-kube-api-access-gwjxw\") pod \"ovnkube-node-mp6vf\" (UID: \"d72f4017-3619-4395-a288-ff999b2e35ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.451334 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.451318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6dd\" (UniqueName: \"kubernetes.io/projected/794c3f80-270d-4390-95ac-064346466631-kube-api-access-lh6dd\") pod \"node-resolver-gf2qm\" (UID: \"794c3f80-270d-4390-95ac-064346466631\") " pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.518565 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.518534    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 11:33:50.543778 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-cni-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.543778 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a9fe75-6411-43f2-a606-13056a0368c8-cni-binary-copy\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-conf-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cef2049a-63f1-487f-a977-953185811d43-iptables-alerter-script\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-etc-kubernetes\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59fdt\" (UniqueName: \"kubernetes.io/projected/e237339b-bb08-479d-8ff0-dc341da0a6b0-kube-api-access-59fdt\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-cni-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-conf-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-cnibin\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-cnibin\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.543979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98b60b02-8436-4c3e-a488-96c4b0b17583-host\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cef2049a-63f1-487f-a977-953185811d43-host-slash\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98b60b02-8436-4c3e-a488-96c4b0b17583-host\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.543940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-etc-kubernetes\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zb4b\" (UniqueName: \"kubernetes.io/projected/85a9fe75-6411-43f2-a606-13056a0368c8-kube-api-access-6zb4b\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cef2049a-63f1-487f-a977-953185811d43-host-slash\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.544339 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.544104    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.544352    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:33:51.044331917 +0000 UTC m=+2.061368619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-cnibin\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cef2049a-63f1-487f-a977-953185811d43-iptables-alerter-script\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a9fe75-6411-43f2-a606-13056a0368c8-cni-binary-copy\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85a9fe75-6411-43f2-a606-13056a0368c8-multus-daemon-config\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-cnibin\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-system-cni-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-kubelet\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98b60b02-8436-4c3e-a488-96c4b0b17583-serviceca\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-system-cni-dir\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-kubelet\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.544727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-system-cni-dir\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-cni-binary-copy\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcphb\" (UniqueName: \"kubernetes.io/projected/68052912-83f1-4d8b-9184-c69b674f30db-kube-api-access-bcphb\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68052912-83f1-4d8b-9184-c69b674f30db-system-cni-dir\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-socket-dir-parent\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-k8s-cni-cncf-io\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-multus-certs\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8sx\" (UniqueName: \"kubernetes.io/projected/98b60b02-8436-4c3e-a488-96c4b0b17583-kube-api-access-sl8sx\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-multus-socket-dir-parent\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-cni-multus\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85a9fe75-6411-43f2-a606-13056a0368c8-multus-daemon-config\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-cni-multus\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-cni-bin\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgdpq\" (UniqueName: \"kubernetes.io/projected/cef2049a-63f1-487f-a977-953185811d43-kube-api-access-fgdpq\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-multus-certs\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.544985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-netns\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-var-lib-cni-bin\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-hostroot\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545041    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98b60b02-8436-4c3e-a488-96c4b0b17583-serviceca\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-hostroot\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-k8s-cni-cncf-io\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a9fe75-6411-43f2-a606-13056a0368c8-host-run-netns\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.545954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.545321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68052912-83f1-4d8b-9184-c69b674f30db-cni-binary-copy\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.550445 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.550429    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:33:50.550445 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.550448    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:33:50.550563 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.550457    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:50.550563 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.550498    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:33:51.05048515 +0000 UTC m=+2.067521839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:50.553064 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.553036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zb4b\" (UniqueName: \"kubernetes.io/projected/85a9fe75-6411-43f2-a606-13056a0368c8-kube-api-access-6zb4b\") pod \"multus-q6c4x\" (UID: \"85a9fe75-6411-43f2-a606-13056a0368c8\") " pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.553064 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.553059    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59fdt\" (UniqueName: \"kubernetes.io/projected/e237339b-bb08-479d-8ff0-dc341da0a6b0-kube-api-access-59fdt\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:50.553354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.553336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcphb\" (UniqueName: \"kubernetes.io/projected/68052912-83f1-4d8b-9184-c69b674f30db-kube-api-access-bcphb\") pod \"multus-additional-cni-plugins-z5rpm\" (UID: \"68052912-83f1-4d8b-9184-c69b674f30db\") " pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.553755 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.553739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8sx\" (UniqueName: \"kubernetes.io/projected/98b60b02-8436-4c3e-a488-96c4b0b17583-kube-api-access-sl8sx\") pod \"node-ca-bf9j6\" (UID: \"98b60b02-8436-4c3e-a488-96c4b0b17583\") " pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.554090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.554076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgdpq\" (UniqueName: \"kubernetes.io/projected/cef2049a-63f1-487f-a977-953185811d43-kube-api-access-fgdpq\") pod \"iptables-alerter-xzkpp\" (UID: \"cef2049a-63f1-487f-a977-953185811d43\") " pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.609281 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.609246    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b7a7384449df783f830280a3100b44.slice/crio-b91cfb8295c4dda185c38e68e157df38634407e0fadc03af1e09792e00f7b4c9 WatchSource:0}: Error finding container b91cfb8295c4dda185c38e68e157df38634407e0fadc03af1e09792e00f7b4c9: Status 404 returned error can't find the container with id b91cfb8295c4dda185c38e68e157df38634407e0fadc03af1e09792e00f7b4c9
Sep 19 11:33:50.609716 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.609693    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732aa783476ab15c97c9ae702301de31.slice/crio-ff5cacd3c458c3689365dd317263786b430afa4cd4c048fc03da3830de0a25d7 WatchSource:0}: Error finding container ff5cacd3c458c3689365dd317263786b430afa4cd4c048fc03da3830de0a25d7: Status 404 returned error can't find the container with id ff5cacd3c458c3689365dd317263786b430afa4cd4c048fc03da3830de0a25d7
Sep 19 11:33:50.614686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.614670    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:33:50.649266 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.649247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:33:50.658406 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.658381    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab69a4a_d1e7_4bbd_9916_3ad4351aa6a3.slice/crio-3c90b2fcb8fbab81427ef7eaf36a0a6c53eeca6bb431e0e62b3618e2323ce2b9 WatchSource:0}: Error finding container 3c90b2fcb8fbab81427ef7eaf36a0a6c53eeca6bb431e0e62b3618e2323ce2b9: Status 404 returned error can't find the container with id 3c90b2fcb8fbab81427ef7eaf36a0a6c53eeca6bb431e0e62b3618e2323ce2b9
Sep 19 11:33:50.668136 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.668118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szghn"
Sep 19 11:33:50.676585 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.676380    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d3d61a_05d6_44a7_ad53_1c5040a43976.slice/crio-d785123c8a818f390dba0edccba8b00a81e38c8bf201f25d69a152d0abe6c5ee WatchSource:0}: Error finding container d785123c8a818f390dba0edccba8b00a81e38c8bf201f25d69a152d0abe6c5ee: Status 404 returned error can't find the container with id d785123c8a818f390dba0edccba8b00a81e38c8bf201f25d69a152d0abe6c5ee
Sep 19 11:33:50.684208 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.684191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:33:50.691823 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.691807    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72f4017_3619_4395_a288_ff999b2e35ea.slice/crio-2683db6265071377ee2f43f0d128ed6655425ece2417f541a05a9086456424e2 WatchSource:0}: Error finding container 2683db6265071377ee2f43f0d128ed6655425ece2417f541a05a9086456424e2: Status 404 returned error can't find the container with id 2683db6265071377ee2f43f0d128ed6655425ece2417f541a05a9086456424e2
Sep 19 11:33:50.706592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.706576    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr"
Sep 19 11:33:50.714237 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.714216    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc028369b_4df8_4d9a_b039_cb5bc414bb0c.slice/crio-2cb624981ee6ed7b79a43bde6cfd7855347fc39c55bd206280d1c103730a8ab5 WatchSource:0}: Error finding container 2cb624981ee6ed7b79a43bde6cfd7855347fc39c55bd206280d1c103730a8ab5: Status 404 returned error can't find the container with id 2cb624981ee6ed7b79a43bde6cfd7855347fc39c55bd206280d1c103730a8ab5
Sep 19 11:33:50.714830 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.714808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gf2qm"
Sep 19 11:33:50.723118 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.723095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794c3f80_270d_4390_95ac_064346466631.slice/crio-c1c674f9ac020547b0ef82ab32c0be55bda1ef774eccfbddeca942ebc7b19f1e WatchSource:0}: Error finding container c1c674f9ac020547b0ef82ab32c0be55bda1ef774eccfbddeca942ebc7b19f1e: Status 404 returned error can't find the container with id c1c674f9ac020547b0ef82ab32c0be55bda1ef774eccfbddeca942ebc7b19f1e
Sep 19 11:33:50.732660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.732645    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bf9j6"
Sep 19 11:33:50.739669 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.739651    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b60b02_8436_4c3e_a488_96c4b0b17583.slice/crio-42d63384a8661dce5531bebb022d07d42b5b3e5010dce9b78e4fa872c0b423a3 WatchSource:0}: Error finding container 42d63384a8661dce5531bebb022d07d42b5b3e5010dce9b78e4fa872c0b423a3: Status 404 returned error can't find the container with id 42d63384a8661dce5531bebb022d07d42b5b3e5010dce9b78e4fa872c0b423a3
Sep 19 11:33:50.760819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.760794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z5rpm"
Sep 19 11:33:50.767860 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.767844    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68052912_83f1_4d8b_9184_c69b674f30db.slice/crio-1501dcb911a13b745d45c2d9748c971807da2efc9bcdcc70e424d5e231843f6f WatchSource:0}: Error finding container 1501dcb911a13b745d45c2d9748c971807da2efc9bcdcc70e424d5e231843f6f: Status 404 returned error can't find the container with id 1501dcb911a13b745d45c2d9748c971807da2efc9bcdcc70e424d5e231843f6f
Sep 19 11:33:50.771956 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.771934    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q6c4x"
Sep 19 11:33:50.778673 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.778656    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzkpp"
Sep 19 11:33:50.779854 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.779836    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a9fe75_6411_43f2_a606_13056a0368c8.slice/crio-512d08b776fa4bd49f44897cfc368b5e005939f012c6e8fb191ca9f5e7c5fb38 WatchSource:0}: Error finding container 512d08b776fa4bd49f44897cfc368b5e005939f012c6e8fb191ca9f5e7c5fb38: Status 404 returned error can't find the container with id 512d08b776fa4bd49f44897cfc368b5e005939f012c6e8fb191ca9f5e7c5fb38
Sep 19 11:33:50.788212 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:33:50.788193    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef2049a_63f1_487f_a977_953185811d43.slice/crio-fcb7d4020bfed8f22e4dba7047fbde0ec5dd33366cbf946341347f224e234fb6 WatchSource:0}: Error finding container fcb7d4020bfed8f22e4dba7047fbde0ec5dd33366cbf946341347f224e234fb6: Status 404 returned error can't find the container with id fcb7d4020bfed8f22e4dba7047fbde0ec5dd33366cbf946341347f224e234fb6
Sep 19 11:33:50.789796 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.789775    2582 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-xzkpp_openshift-network-operator(cef2049a-63f1-487f-a977-953185811d43): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 19 11:33:50.789870 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.789806    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-xzkpp" podUID="cef2049a-63f1-487f-a977-953185811d43"
Sep 19 11:33:50.947763 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:50.947692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:50.947927 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.947797    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:50.947927 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:50.947856    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:33:51.947843555 +0000 UTC m=+2.964880244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:51.048456 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.048424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:51.048602 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.048563    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:51.048641 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.048619    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:33:52.048603367 +0000 UTC m=+3.065640079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:51.149625 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.149592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:51.149842 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.149752    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:33:51.149842 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.149773    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:33:51.149842 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.149784    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:51.149842 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.149840    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:33:52.149822536 +0000 UTC m=+3.166859249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:51.161971 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.161932    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 11:33:51.376850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.376728    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 11:28:50 +0000 UTC" deadline="2028-04-30 18:45:07.478384103 +0000 UTC"
Sep 19 11:33:51.376850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.376757    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14143h11m16.101630509s"
Sep 19 11:33:51.538235 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.538204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:51.538404 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.538331    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:33:51.538480 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.538419    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:51.538531 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.538504    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:33:51.574304 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.574246    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzkpp" event={"ID":"cef2049a-63f1-487f-a977-953185811d43","Type":"ContainerStarted","Data":"fcb7d4020bfed8f22e4dba7047fbde0ec5dd33366cbf946341347f224e234fb6"}
Sep 19 11:33:51.578930 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.578890    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-xzkpp" podUID="cef2049a-63f1-487f-a977-953185811d43"
Sep 19 11:33:51.595954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.595890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerStarted","Data":"1501dcb911a13b745d45c2d9748c971807da2efc9bcdcc70e424d5e231843f6f"}
Sep 19 11:33:51.615984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.615954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"2683db6265071377ee2f43f0d128ed6655425ece2417f541a05a9086456424e2"}
Sep 19 11:33:51.648880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.648789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xncc9" event={"ID":"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3","Type":"ContainerStarted","Data":"3c90b2fcb8fbab81427ef7eaf36a0a6c53eeca6bb431e0e62b3618e2323ce2b9"}
Sep 19 11:33:51.662858 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.662824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q6c4x" event={"ID":"85a9fe75-6411-43f2-a606-13056a0368c8","Type":"ContainerStarted","Data":"512d08b776fa4bd49f44897cfc368b5e005939f012c6e8fb191ca9f5e7c5fb38"}
Sep 19 11:33:51.676360 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.676332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bf9j6" event={"ID":"98b60b02-8436-4c3e-a488-96c4b0b17583","Type":"ContainerStarted","Data":"42d63384a8661dce5531bebb022d07d42b5b3e5010dce9b78e4fa872c0b423a3"}
Sep 19 11:33:51.685987 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.685959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gf2qm" event={"ID":"794c3f80-270d-4390-95ac-064346466631","Type":"ContainerStarted","Data":"c1c674f9ac020547b0ef82ab32c0be55bda1ef774eccfbddeca942ebc7b19f1e"}
Sep 19 11:33:51.706074 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.706047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr" event={"ID":"c028369b-4df8-4d9a-b039-cb5bc414bb0c","Type":"ContainerStarted","Data":"2cb624981ee6ed7b79a43bde6cfd7855347fc39c55bd206280d1c103730a8ab5"}
Sep 19 11:33:51.716291 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.716227    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szghn" event={"ID":"44d3d61a-05d6-44a7-ad53-1c5040a43976","Type":"ContainerStarted","Data":"d785123c8a818f390dba0edccba8b00a81e38c8bf201f25d69a152d0abe6c5ee"}
Sep 19 11:33:51.719325 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.719278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" event={"ID":"732aa783476ab15c97c9ae702301de31","Type":"ContainerStarted","Data":"ff5cacd3c458c3689365dd317263786b430afa4cd4c048fc03da3830de0a25d7"}
Sep 19 11:33:51.733629 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.733599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal" event={"ID":"c7b7a7384449df783f830280a3100b44","Type":"ContainerStarted","Data":"b91cfb8295c4dda185c38e68e157df38634407e0fadc03af1e09792e00f7b4c9"}
Sep 19 11:33:51.956722 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:51.956636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:51.956887 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.956815    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:51.956887 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:51.956876    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:33:53.956858942 +0000 UTC m=+4.973895646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:52.058340 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:52.058277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:52.058516 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.058412    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:52.058601 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.058531    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:33:54.058481581 +0000 UTC m=+5.075518286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:52.159071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:52.158975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:52.159254 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.159163    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:33:52.159254 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.159189    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:33:52.159254 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.159203    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:52.159414 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.159261    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:33:54.159242846 +0000 UTC m=+5.176279554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:52.377784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:52.377667    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 11:28:50 +0000 UTC" deadline="2028-06-28 05:09:14.873345402 +0000 UTC"
Sep 19 11:33:52.377784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:52.377730    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15545h35m22.495619945s"
Sep 19 11:33:52.537660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:52.537626    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:52.537850 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:52.537757    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:33:52.838577 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:52.838502    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 11:33:53.537964 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:53.537932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:53.538445 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:53.538067    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:33:53.538445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:53.538434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:53.538571 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:53.538507    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:33:53.974000 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:53.973894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:53.974171 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:53.974024    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:53.974171 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:53.974092    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:33:57.974073039 +0000 UTC m=+8.991109735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:54.075301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:54.075255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:54.075637 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.075616    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:54.075745 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.075681    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:33:58.075662738 +0000 UTC m=+9.092699450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:54.175973 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:54.175926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:54.176141 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.176087    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:33:54.176141 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.176108    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:33:54.176141 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.176121    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:54.176300 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.176178    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:33:58.176159978 +0000 UTC m=+9.193196673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:54.538304 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:54.538263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:54.538740 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:54.538402    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:33:55.537804 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:55.537770    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:55.537991 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:55.537942    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:33:55.538396 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:55.538366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:55.538790 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:55.538481    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:33:56.537910 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:56.537871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:56.538112 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:56.538035    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:33:57.537587 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:57.537553    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:57.538042 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:57.537705    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:33:57.538135 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:57.538110    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:57.538298 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:57.538248    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:33:58.008085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:58.008044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:58.008361 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.008197    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:58.008361 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.008267    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:34:06.008245332 +0000 UTC m=+17.025282035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:33:58.109462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:58.109435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:58.109577 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.109566    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:58.109645 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.109635    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:06.109615995 +0000 UTC m=+17.126652690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:33:58.210309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:58.209784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:58.210309 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.209998    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:33:58.210309 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.210024    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:33:58.210309 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.210038    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:58.210309 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.210118    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:34:06.210098269 +0000 UTC m=+17.227134978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:33:58.538022 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:58.537498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:33:58.538022 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:58.537632    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:33:59.539118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:59.538558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:33:59.539118 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:59.538672    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:33:59.539118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:33:59.539098    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:33:59.539758 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:33:59.539201    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:00.537452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:00.537415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:00.537642 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:00.537534    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:01.537699 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:01.537668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:01.538276 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:01.537802    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:01.538276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:01.537860    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:01.538276 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:01.537979    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:02.537765 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:02.537730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:02.538172 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:02.537858    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:03.537853 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:03.537818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:03.538332 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:03.537866    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:03.538332 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:03.537988    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:03.538332 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:03.538128    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:04.538126 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:04.538095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:04.538480 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:04.538218    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:05.537833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:05.537752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:05.537833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:05.537754    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:05.538103 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:05.538072    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:05.538200 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:05.538178    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:06.069496 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:06.069461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:06.069671 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.069593    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:34:06.069671 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.069667    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:34:22.069650261 +0000 UTC m=+33.086686950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:34:06.170071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:06.170035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:06.170265 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.170187    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:34:06.170265 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.170251    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:22.170235609 +0000 UTC m=+33.187272321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:34:06.270763 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:06.270731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:06.270952 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.270899    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:34:06.270952 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.270931    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:34:06.270952 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.270944    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:34:06.271091 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.270996    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:34:22.270980888 +0000 UTC m=+33.288017591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:34:06.538158 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:06.538130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:06.538337 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:06.538243    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:07.537767 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:07.537729    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:07.537985 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:07.537780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:07.537985 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:07.537877    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:07.538120 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:07.538017    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:08.537697 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:08.537667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:08.538129 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:08.537789    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:09.538576 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.538379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:09.538576 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:09.538497    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:09.539222 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.538897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:09.539222 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:09.539007    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:09.777058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.777024    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal" event={"ID":"c7b7a7384449df783f830280a3100b44","Type":"ContainerStarted","Data":"dbfea9445b517849efc82becd98ba526cfab3e99d605a26f44f4db29502031af"}
Sep 19 11:34:09.779543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.779517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q6c4x" event={"ID":"85a9fe75-6411-43f2-a606-13056a0368c8","Type":"ContainerStarted","Data":"ce75a8b785275c52940ed884880969db1e56f7728493e8e69774b1782938312b"}
Sep 19 11:34:09.782590 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.782564    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szghn" event={"ID":"44d3d61a-05d6-44a7-ad53-1c5040a43976","Type":"ContainerStarted","Data":"d5ae18b6016ac1418f98cf05d5b945dfea802a66b2921745fbf23647215735b9"}
Sep 19 11:34:09.791439 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.791385    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-160.ec2.internal" podStartSLOduration=19.791364285 podStartE2EDuration="19.791364285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:09.789843233 +0000 UTC m=+20.806879945" watchObservedRunningTime="2026-09-19 11:34:09.791364285 +0000 UTC m=+20.808400997"
Sep 19 11:34:09.821436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.821383    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-szghn" podStartSLOduration=2.163070207 podStartE2EDuration="20.821367158s" totalImagesPullingTime="18.658296951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:09.805493487 +0000 UTC m=+20.822530213" watchObservedRunningTime="2026-09-19 11:34:09.821367158 +0000 UTC m=+20.838403910"
Sep 19 11:34:09.822736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:09.822685    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q6c4x" podStartSLOduration=2.232975082 podStartE2EDuration="20.822669913s" totalImagesPullingTime="18.589694831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:09.821220867 +0000 UTC m=+20.838257591" watchObservedRunningTime="2026-09-19 11:34:09.822669913 +0000 UTC m=+20.839706624"
Sep 19 11:34:10.538446 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.538222    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:10.538596 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:10.538479    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:10.786525 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.786491    2582 generic.go:356] "Generic (PLEG): container finished" podID="732aa783476ab15c97c9ae702301de31" containerID="6adafe84aacb5f399fdb7a0bd102e81b5b1b2681f3ea3a770dc128e3cbc423be" exitCode=0
Sep 19 11:34:10.786700 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.786584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" event={"ID":"732aa783476ab15c97c9ae702301de31","Type":"ContainerDied","Data":"6adafe84aacb5f399fdb7a0bd102e81b5b1b2681f3ea3a770dc128e3cbc423be"}
Sep 19 11:34:10.788439 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.788407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzkpp" event={"ID":"cef2049a-63f1-487f-a977-953185811d43","Type":"ContainerStarted","Data":"b63dc798ce92fea3264bfe9c08e374b12088de908c4e437cf3b7c2a801af28d1"}
Sep 19 11:34:10.790323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.790257    2582 generic.go:356] "Generic (PLEG): container finished" podID="68052912-83f1-4d8b-9184-c69b674f30db" containerID="936673f6e45629a82cd8d0c84927fff98f15cd1a28263c4d7640e218edcf082f" exitCode=0
Sep 19 11:34:10.790435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.790323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerDied","Data":"936673f6e45629a82cd8d0c84927fff98f15cd1a28263c4d7640e218edcf082f"}
Sep 19 11:34:10.794143 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.794120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"c460be67de17e9783784062abce7f0889ec3d34d6441b1a8fe8a4375cc54b188"}
Sep 19 11:34:10.794231 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.794191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"4b4a92f77873c290432c6b7a13c30f5830318d94d6606e253ea6bf7282fa3476"}
Sep 19 11:34:10.794286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.794234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"5cc22f988cb12472de0c5ee1de03357c161587b177172dbf052a41910301e410"}
Sep 19 11:34:10.794286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.794280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"cddb432364718c688c55bf7db0715a11d6fee5d7d2fbd0256223a798cfa3c89d"}
Sep 19 11:34:10.794371 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.794322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"731c3945cbcf3edd8004d069ab048b9849d692a404ffc85d3d7ca296a73dd528"}
Sep 19 11:34:10.794420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.794374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"a5a2561b9ca1f942bf6aa28b924160d571986ef18092fa1da58a64073198c6fd"}
Sep 19 11:34:10.795777 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.795755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xncc9" event={"ID":"3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3","Type":"ContainerStarted","Data":"367c4ecbdfce9bc80bc430a0d2abdb7cf8fba7a7d68d23484c710acaef982491"}
Sep 19 11:34:10.797512 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.797491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bf9j6" event={"ID":"98b60b02-8436-4c3e-a488-96c4b0b17583","Type":"ContainerStarted","Data":"9a2863ffd219a37920d62c6e3ac882aa9c17e7a37f22be4015b59523bde2a80e"}
Sep 19 11:34:10.799062 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.799040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gf2qm" event={"ID":"794c3f80-270d-4390-95ac-064346466631","Type":"ContainerStarted","Data":"c4b21e04e135eddb2d181a82cc8539e12547fb0a89ab14955c9e8025d4d6370a"}
Sep 19 11:34:10.800763 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.800740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr" event={"ID":"c028369b-4df8-4d9a-b039-cb5bc414bb0c","Type":"ContainerStarted","Data":"6b86e29a00971a1819767f6472bc32ae3cc85daff711bfc3b1aa2aaed5e1641e"}
Sep 19 11:34:10.813851 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.813806    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gf2qm" podStartSLOduration=3.205330909 podStartE2EDuration="21.81379384s" totalImagesPullingTime="18.608462931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:10.813346975 +0000 UTC m=+21.830383687" watchObservedRunningTime="2026-09-19 11:34:10.81379384 +0000 UTC m=+21.830830551"
Sep 19 11:34:10.848100 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.848049    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xncc9" podStartSLOduration=3.200107133 podStartE2EDuration="21.848032316s" totalImagesPullingTime="18.647925183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:10.847670441 +0000 UTC m=+21.864707151" watchObservedRunningTime="2026-09-19 11:34:10.848032316 +0000 UTC m=+21.865069029"
Sep 19 11:34:10.862800 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:10.862765    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bf9j6" podStartSLOduration=3.318081276 podStartE2EDuration="21.862753214s" totalImagesPullingTime="18.544671938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:10.862577291 +0000 UTC m=+21.879614002" watchObservedRunningTime="2026-09-19 11:34:10.862753214 +0000 UTC m=+21.879789922"
Sep 19 11:34:11.182617 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.182447    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 11:34:11.394674 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.394497    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T11:34:11.182613218Z","UUID":"e717e56c-0968-4b89-bd23-1923050d8bf6","Handler":null,"Name":"","Endpoint":""}
Sep 19 11:34:11.396002 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.395984    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 11:34:11.396117 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.396013    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 11:34:11.540830 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.540799    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:11.541380 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:11.540909    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:11.541380 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.541017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:11.541380 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:11.541127    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:11.805769 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.805725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr" event={"ID":"c028369b-4df8-4d9a-b039-cb5bc414bb0c","Type":"ContainerStarted","Data":"6029f025a5a85089da6d7a32d4b1a748ae0ef2a6e2f5a599c282343a43f26a38"}
Sep 19 11:34:11.808009 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.807979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" event={"ID":"732aa783476ab15c97c9ae702301de31","Type":"ContainerStarted","Data":"306770bf6df23e5efbe5e95718431d23d3558af56d153297374ca060c5244da4"}
Sep 19 11:34:11.823512 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.823467    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzkpp" podStartSLOduration=22.823454157 podStartE2EDuration="22.823454157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-19 11:34:10.875887392 +0000 UTC m=+21.892924099" watchObservedRunningTime="2026-09-19 11:34:11.823454157 +0000 UTC m=+22.840490868"
Sep 19 11:34:11.823841 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:11.823812    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-160.ec2.internal" podStartSLOduration=21.823803988999998 podStartE2EDuration="21.823803989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:11.823093866 +0000 UTC m=+22.840130582" watchObservedRunningTime="2026-09-19 11:34:11.823803989 +0000 UTC m=+22.840840700"
Sep 19 11:34:12.538094 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:12.538069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:12.538240 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:12.538194    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:12.812565 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:12.812533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr" event={"ID":"c028369b-4df8-4d9a-b039-cb5bc414bb0c","Type":"ContainerStarted","Data":"02a83762e07f2b38f28a9e7973a97f0cd6c009071d85168d8f70212527b2b6ff"}
Sep 19 11:34:12.816623 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:12.816593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"c2817d9cc4353f2fe40df63f215ff94aa211b447e5dc00d49dfa362036b737ce"}
Sep 19 11:34:12.831223 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:12.831185    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6ggr" podStartSLOduration=3.140727862 podStartE2EDuration="23.831170678s" totalImagesPullingTime="20.690442816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:12.829986992 +0000 UTC m=+23.847023704" watchObservedRunningTime="2026-09-19 11:34:12.831170678 +0000 UTC m=+23.848207386"
Sep 19 11:34:13.038358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:13.038328    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:34:13.039054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:13.039034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:34:13.537877 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:13.537843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:13.538168 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:13.538008    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:13.538168 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:13.538062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:13.538168 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:13.538161    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:13.819334 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:13.819243    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:34:13.819735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:13.819673    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xncc9"
Sep 19 11:34:14.537317 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:14.537289    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:14.537513 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:14.537412    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:15.538363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.538114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:15.538848 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.538153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:15.538848 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:15.538489    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:15.538848 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:15.538596    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:15.824789 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.824711    2582 generic.go:356] "Generic (PLEG): container finished" podID="68052912-83f1-4d8b-9184-c69b674f30db" containerID="85f4e18d9b7902578cc7854a7e03c3aa2acece32802a0f48af190c5f827ea0e5" exitCode=0
Sep 19 11:34:15.824789 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.824769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerDied","Data":"85f4e18d9b7902578cc7854a7e03c3aa2acece32802a0f48af190c5f827ea0e5"}
Sep 19 11:34:15.828852 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.828826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" event={"ID":"d72f4017-3619-4395-a288-ff999b2e35ea","Type":"ContainerStarted","Data":"7fbc062e0a48e76f45c312f25afef34ed3e00828a4bf062dedac1fc2e765ea2c"}
Sep 19 11:34:15.829150 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.829129    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:34:15.829235 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.829194    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:34:15.844023 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.844006    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:34:15.867518 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:15.866162    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf" podStartSLOduration=7.821475487 podStartE2EDuration="26.866142863s" totalImagesPullingTime="19.044667376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:15.864300706 +0000 UTC m=+26.881337417" watchObservedRunningTime="2026-09-19 11:34:15.866142863 +0000 UTC m=+26.883179576"
Sep 19 11:34:16.538581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.538240    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:16.538581 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:16.538361    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:16.833539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.833454    2582 generic.go:356] "Generic (PLEG): container finished" podID="68052912-83f1-4d8b-9184-c69b674f30db" containerID="61d6a7a76fe4ed5edbcdfbd53f202f66ac97250f0051e9e57a215d7e41baf42b" exitCode=0
Sep 19 11:34:16.833675 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.833532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerDied","Data":"61d6a7a76fe4ed5edbcdfbd53f202f66ac97250f0051e9e57a215d7e41baf42b"}
Sep 19 11:34:16.833975 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.833947    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:34:16.849646 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.849621    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:34:16.880315 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.880291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9j4hc"]
Sep 19 11:34:16.880428 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.880382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:16.880506 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:16.880485    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:16.883172 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.883149    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s2q9f"]
Sep 19 11:34:16.883296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.883245    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:16.883375 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:16.883338    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:16.883693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.883668    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sxqbh"]
Sep 19 11:34:16.883781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:16.883759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:16.883855 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:16.883840    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:17.838309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:17.838105    2582 generic.go:356] "Generic (PLEG): container finished" podID="68052912-83f1-4d8b-9184-c69b674f30db" containerID="c74061905c1dbb49bf7fec6d420060dc3e1531e55c77291b996c348243c52406" exitCode=0
Sep 19 11:34:17.838808 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:17.838183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerDied","Data":"c74061905c1dbb49bf7fec6d420060dc3e1531e55c77291b996c348243c52406"}
Sep 19 11:34:18.537784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:18.537756    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:18.537990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:18.537843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:18.537990 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:18.537849    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:18.537990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:18.537867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:18.537990 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:18.537969    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:18.538127 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:18.538044    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:20.537641 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:20.537608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:20.538110 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:20.537722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9j4hc" podUID="3fd294aa-feef-4364-9715-5127ec92db9f"
Sep 19 11:34:20.538110 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:20.537747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:20.538110 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:20.537756    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:20.538110 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:20.537962    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2q9f" podUID="b4d242b4-6d60-4081-a0ef-8f10e78e5d1e"
Sep 19 11:34:20.538110 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:20.537994    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxqbh" podUID="e237339b-bb08-479d-8ff0-dc341da0a6b0"
Sep 19 11:34:22.092805 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.092763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:22.093421 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.092948    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 11:34:22.093421 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.093022    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret podName:3fd294aa-feef-4364-9715-5127ec92db9f nodeName:}" failed. No retries permitted until 2026-09-19 11:34:54.093003251 +0000 UTC m=+65.110039963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret") pod "global-pull-secret-syncer-9j4hc" (UID: "3fd294aa-feef-4364-9715-5127ec92db9f") : object "kube-system"/"original-pull-secret" not registered
Sep 19 11:34:22.194026 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.193993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:22.194172 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.194135    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:34:22.194237 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.194195    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs podName:e237339b-bb08-479d-8ff0-dc341da0a6b0 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:54.194180899 +0000 UTC m=+65.211217588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs") pod "network-metrics-daemon-sxqbh" (UID: "e237339b-bb08-479d-8ff0-dc341da0a6b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 11:34:22.247953 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.247910    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-160.ec2.internal" event="NodeReady"
Sep 19 11:34:22.248117 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.248087    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 11:34:22.282805 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.282762    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85868d5fb5-rpg6t"]
Sep 19 11:34:22.294882 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.294840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:22.295034 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.295016    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 11:34:22.295085 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.295043    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 11:34:22.295085 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.295056    2582 projected.go:196] Error preparing data for projected volume kube-api-access-j56z8 for pod openshift-network-diagnostics/network-check-target-s2q9f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:34:22.295146 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.295121    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8 podName:b4d242b4-6d60-4081-a0ef-8f10e78e5d1e nodeName:}" failed. No retries permitted until 2026-09-19 11:34:54.295104613 +0000 UTC m=+65.312141317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j56z8" (UniqueName: "kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8") pod "network-check-target-s2q9f" (UID: "b4d242b4-6d60-4081-a0ef-8f10e78e5d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 11:34:22.322288 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.322262    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cvrq2"]
Sep 19 11:34:22.322550 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.322527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.325368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.325332    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sbk8r\""
Sep 19 11:34:22.326339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.325619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 11:34:22.326339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.325633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 11:34:22.326339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.325812    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 11:34:22.331574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.331552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 11:34:22.333377 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.333359    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cm742"]
Sep 19 11:34:22.333497 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.333471    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.335606 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.335572    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mvj2p\""
Sep 19 11:34:22.335961 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.335904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 11:34:22.336067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.335972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 11:34:22.353523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.353464    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85868d5fb5-rpg6t"]
Sep 19 11:34:22.353523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.353492    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvrq2"]
Sep 19 11:34:22.353523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.353510    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cm742"]
Sep 19 11:34:22.353721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.353563    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.355926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.355896    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 11:34:22.356071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.356048    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 11:34:22.356172 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.356085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 11:34:22.356245 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.356226    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t9jnr\""
Sep 19 11:34:22.395193 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-trusted-ca\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/497114e5-49e3-4ccd-ab2a-0473fd9424eb-ca-trust-extracted\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-installation-pull-secrets\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395449 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-bound-sa-token\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395449 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-certificates\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395449 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtnj4\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-kube-api-access-vtnj4\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.395549 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.395448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-image-registry-private-configuration\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.496705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.496855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/497114e5-49e3-4ccd-ab2a-0473fd9424eb-ca-trust-extracted\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.496855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-installation-pull-secrets\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.496855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-bound-sa-token\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.496855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b431d345-caad-4147-9cba-91d0759b5330-cert\") pod \"ingress-canary-cm742\" (UID: \"b431d345-caad-4147-9cba-91d0759b5330\") " pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.496855 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.496829    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 11:34:22.496855 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.496846    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85868d5fb5-rpg6t: secret "image-registry-tls" not found
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-certificates\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.496901    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls podName:497114e5-49e3-4ccd-ab2a-0473fd9424eb nodeName:}" failed. No retries permitted until 2026-09-19 11:34:22.996883499 +0000 UTC m=+34.013920204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls") pod "image-registry-85868d5fb5-rpg6t" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb") : secret "image-registry-tls" not found
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496951    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c14c5be0-3da7-460b-903c-5e5ce5583e72-config-volume\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.496975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtnj4\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-kube-api-access-vtnj4\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-image-registry-private-configuration\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.497187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c14c5be0-3da7-460b-903c-5e5ce5583e72-tmp-dir\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.497580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/497114e5-49e3-4ccd-ab2a-0473fd9424eb-ca-trust-extracted\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.497580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4z28\" (UniqueName: \"kubernetes.io/projected/c14c5be0-3da7-460b-903c-5e5ce5583e72-kube-api-access-g4z28\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.497580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd7l7\" (UniqueName: \"kubernetes.io/projected/b431d345-caad-4147-9cba-91d0759b5330-kube-api-access-dd7l7\") pod \"ingress-canary-cm742\" (UID: \"b431d345-caad-4147-9cba-91d0759b5330\") " pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.497580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-trusted-ca\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.497580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.497553    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-certificates\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.498769 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.498724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-trusted-ca\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.501487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.501467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-image-registry-private-configuration\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.501592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.501499    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-installation-pull-secrets\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.505079 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.505059    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-bound-sa-token\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.505664 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.505642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtnj4\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-kube-api-access-vtnj4\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:22.537608 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.537580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:22.537608 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.537599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:22.537760 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.537580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:22.540161 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.540138    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 11:34:22.540269 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.540195    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 11:34:22.540631 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.540610    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhwvf\""
Sep 19 11:34:22.541286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.540788    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 11:34:22.541286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.541079    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 11:34:22.541286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.541089    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6c6f7\""
Sep 19 11:34:22.598455 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c14c5be0-3da7-460b-903c-5e5ce5583e72-tmp-dir\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.598555 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4z28\" (UniqueName: \"kubernetes.io/projected/c14c5be0-3da7-460b-903c-5e5ce5583e72-kube-api-access-g4z28\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.598555 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd7l7\" (UniqueName: \"kubernetes.io/projected/b431d345-caad-4147-9cba-91d0759b5330-kube-api-access-dd7l7\") pod \"ingress-canary-cm742\" (UID: \"b431d345-caad-4147-9cba-91d0759b5330\") " pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.598672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b431d345-caad-4147-9cba-91d0759b5330-cert\") pod \"ingress-canary-cm742\" (UID: \"b431d345-caad-4147-9cba-91d0759b5330\") " pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.598672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c14c5be0-3da7-460b-903c-5e5ce5583e72-config-volume\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.598672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.598823 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.598730    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 11:34:22.598823 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:22.598789    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls podName:c14c5be0-3da7-460b-903c-5e5ce5583e72 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:23.098772041 +0000 UTC m=+34.115808743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls") pod "dns-default-cvrq2" (UID: "c14c5be0-3da7-460b-903c-5e5ce5583e72") : secret "dns-default-metrics-tls" not found
Sep 19 11:34:22.598823 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.598783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c14c5be0-3da7-460b-903c-5e5ce5583e72-tmp-dir\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.599341 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.599307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c14c5be0-3da7-460b-903c-5e5ce5583e72-config-volume\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.601378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.601358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b431d345-caad-4147-9cba-91d0759b5330-cert\") pod \"ingress-canary-cm742\" (UID: \"b431d345-caad-4147-9cba-91d0759b5330\") " pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.606838 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.606786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd7l7\" (UniqueName: \"kubernetes.io/projected/b431d345-caad-4147-9cba-91d0759b5330-kube-api-access-dd7l7\") pod \"ingress-canary-cm742\" (UID: \"b431d345-caad-4147-9cba-91d0759b5330\") " pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:22.607101 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.607068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4z28\" (UniqueName: \"kubernetes.io/projected/c14c5be0-3da7-460b-903c-5e5ce5583e72-kube-api-access-g4z28\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:22.663795 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:22.663768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cm742"
Sep 19 11:34:23.002128 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:23.001945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:23.002263 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:23.002103    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 11:34:23.002263 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:23.002198    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85868d5fb5-rpg6t: secret "image-registry-tls" not found
Sep 19 11:34:23.002263 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:23.002254    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls podName:497114e5-49e3-4ccd-ab2a-0473fd9424eb nodeName:}" failed. No retries permitted until 2026-09-19 11:34:24.002236712 +0000 UTC m=+35.019273400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls") pod "image-registry-85868d5fb5-rpg6t" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb") : secret "image-registry-tls" not found
Sep 19 11:34:23.079116 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:23.079085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cm742"]
Sep 19 11:34:23.082460 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:23.082415    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb431d345_caad_4147_9cba_91d0759b5330.slice/crio-2d7c1dcced79c7d75ad438739b1bb0ad56c0fe889f3e01f83fa029597f2e3b67 WatchSource:0}: Error finding container 2d7c1dcced79c7d75ad438739b1bb0ad56c0fe889f3e01f83fa029597f2e3b67: Status 404 returned error can't find the container with id 2d7c1dcced79c7d75ad438739b1bb0ad56c0fe889f3e01f83fa029597f2e3b67
Sep 19 11:34:23.102518 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:23.102500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:23.102810 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:23.102620    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 11:34:23.102810 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:23.102661    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls podName:c14c5be0-3da7-460b-903c-5e5ce5583e72 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:24.102648807 +0000 UTC m=+35.119685495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls") pod "dns-default-cvrq2" (UID: "c14c5be0-3da7-460b-903c-5e5ce5583e72") : secret "dns-default-metrics-tls" not found
Sep 19 11:34:23.855929 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:23.855874    2582 generic.go:356] "Generic (PLEG): container finished" podID="68052912-83f1-4d8b-9184-c69b674f30db" containerID="864b0e5ea127fff951f23d84ba109ee82d66cceac157e89c5db2163031a0a5b3" exitCode=0
Sep 19 11:34:23.856104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:23.855956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerDied","Data":"864b0e5ea127fff951f23d84ba109ee82d66cceac157e89c5db2163031a0a5b3"}
Sep 19 11:34:23.857788 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:23.857745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cm742" event={"ID":"b431d345-caad-4147-9cba-91d0759b5330","Type":"ContainerStarted","Data":"2d7c1dcced79c7d75ad438739b1bb0ad56c0fe889f3e01f83fa029597f2e3b67"}
Sep 19 11:34:24.010249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:24.009990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:24.010249 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:24.010165    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 11:34:24.010249 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:24.010180    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85868d5fb5-rpg6t: secret "image-registry-tls" not found
Sep 19 11:34:24.010249 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:24.010229    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls podName:497114e5-49e3-4ccd-ab2a-0473fd9424eb nodeName:}" failed. No retries permitted until 2026-09-19 11:34:26.010210684 +0000 UTC m=+37.027247379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls") pod "image-registry-85868d5fb5-rpg6t" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb") : secret "image-registry-tls" not found
Sep 19 11:34:24.110864 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:24.110786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:24.111457 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:24.110936    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 11:34:24.111457 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:24.111010    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls podName:c14c5be0-3da7-460b-903c-5e5ce5583e72 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:26.110990533 +0000 UTC m=+37.128027223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls") pod "dns-default-cvrq2" (UID: "c14c5be0-3da7-460b-903c-5e5ce5583e72") : secret "dns-default-metrics-tls" not found
Sep 19 11:34:24.863560 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:24.863523    2582 generic.go:356] "Generic (PLEG): container finished" podID="68052912-83f1-4d8b-9184-c69b674f30db" containerID="73e632731bcbe04e18c583a0f0a138aaa1f5efb05f47fa990c48508483e9d741" exitCode=0
Sep 19 11:34:24.863728 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:24.863595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerDied","Data":"73e632731bcbe04e18c583a0f0a138aaa1f5efb05f47fa990c48508483e9d741"}
Sep 19 11:34:25.869407 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:25.869335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" event={"ID":"68052912-83f1-4d8b-9184-c69b674f30db","Type":"ContainerStarted","Data":"e7e9e5a9305caf2b61aefca897be14c5e20d6c56cc43e4bd97394e520a728ec3"}
Sep 19 11:34:25.873508 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:25.873480    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cm742" event={"ID":"b431d345-caad-4147-9cba-91d0759b5330","Type":"ContainerStarted","Data":"fc5848b55a1c24160241d5f5e51be9d94c487b4481d95e3305df7b618b297ad4"}
Sep 19 11:34:25.888812 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:25.888764    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z5rpm" podStartSLOduration=7.511886 podStartE2EDuration="36.888751096s" totalImagesPullingTime="29.376865096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:25.887720113 +0000 UTC m=+36.904756824" watchObservedRunningTime="2026-09-19 11:34:25.888751096 +0000 UTC m=+36.905787806"
Sep 19 11:34:25.903855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:25.903814    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cm742" podStartSLOduration=1.380554521 podStartE2EDuration="3.903800758s" totalImagesPullingTime="2.523246237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:25.903732784 +0000 UTC m=+36.920769497" watchObservedRunningTime="2026-09-19 11:34:25.903800758 +0000 UTC m=+36.920837466"
Sep 19 11:34:26.026580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:26.026545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:26.026736 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:26.026693    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 11:34:26.026736 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:26.026713    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85868d5fb5-rpg6t: secret "image-registry-tls" not found
Sep 19 11:34:26.026947 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:26.026764    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls podName:497114e5-49e3-4ccd-ab2a-0473fd9424eb nodeName:}" failed. No retries permitted until 2026-09-19 11:34:30.026750843 +0000 UTC m=+41.043787565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls") pod "image-registry-85868d5fb5-rpg6t" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb") : secret "image-registry-tls" not found
Sep 19 11:34:26.127556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:26.127489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:26.127691 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:26.127584    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 11:34:26.127691 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:26.127630    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls podName:c14c5be0-3da7-460b-903c-5e5ce5583e72 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:30.127617652 +0000 UTC m=+41.144654341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls") pod "dns-default-cvrq2" (UID: "c14c5be0-3da7-460b-903c-5e5ce5583e72") : secret "dns-default-metrics-tls" not found
Sep 19 11:34:30.056443 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:30.056193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:30.056832 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:30.056345    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 11:34:30.056832 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:30.056483    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85868d5fb5-rpg6t: secret "image-registry-tls" not found
Sep 19 11:34:30.056832 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:30.056546    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls podName:497114e5-49e3-4ccd-ab2a-0473fd9424eb nodeName:}" failed. No retries permitted until 2026-09-19 11:34:38.056532075 +0000 UTC m=+49.073568777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls") pod "image-registry-85868d5fb5-rpg6t" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb") : secret "image-registry-tls" not found
Sep 19 11:34:30.157714 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:30.157682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:30.157868 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:30.157840    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 11:34:30.158128 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:30.158114    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls podName:c14c5be0-3da7-460b-903c-5e5ce5583e72 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:38.158097971 +0000 UTC m=+49.175134661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls") pod "dns-default-cvrq2" (UID: "c14c5be0-3da7-460b-903c-5e5ce5583e72") : secret "dns-default-metrics-tls" not found
Sep 19 11:34:32.477569 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.477537    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5l6vd"]
Sep 19 11:34:32.507727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.507703    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5l6vd"]
Sep 19 11:34:32.507854 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.507819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.510433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.510407    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g979l\""
Sep 19 11:34:32.510433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.510431    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 11:34:32.510627 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.510458    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 11:34:32.510627 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.510414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 11:34:32.510627 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.510535    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 11:34:32.674714 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.674688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.674714 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.674717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkmdp\" (UniqueName: \"kubernetes.io/projected/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-api-access-zkmdp\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.674905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.674758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c9b8058-f4d5-428b-a07a-1562a8048dfd-crio-socket\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.674905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.674854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.674905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.674891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9b8058-f4d5-428b-a07a-1562a8048dfd-data-volume\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.746388 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.746358    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"]
Sep 19 11:34:32.759237 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.759206    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"]
Sep 19 11:34:32.759345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.759329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"
Sep 19 11:34:32.761715 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.761695    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 19 11:34:32.762043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.762026    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-77r88\""
Sep 19 11:34:32.762139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.762060    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 19 11:34:32.775968 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.775946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.776070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.775976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkmdp\" (UniqueName: \"kubernetes.io/projected/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-api-access-zkmdp\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.776070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.776027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c9b8058-f4d5-428b-a07a-1562a8048dfd-crio-socket\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.776175 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.776070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.776175 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:32.776098    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:32.776175 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:32.776148    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:33.276134746 +0000 UTC m=+44.293171438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:32.776175 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:32.776167    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 11:34:32.776382 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.776099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9b8058-f4d5-428b-a07a-1562a8048dfd-data-volume\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.776382 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:32.776227    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:33.276215043 +0000 UTC m=+44.293251732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : configmap "kube-rbac-proxy" not found
Sep 19 11:34:32.776382 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.776262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c9b8058-f4d5-428b-a07a-1562a8048dfd-crio-socket\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.776496 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.776479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c9b8058-f4d5-428b-a07a-1562a8048dfd-data-volume\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.787145 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.787125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkmdp\" (UniqueName: \"kubernetes.io/projected/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-api-access-zkmdp\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:32.877501 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.877476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g92c\" (UniqueName: \"kubernetes.io/projected/6f9d35d4-19ef-4077-8848-3e0e09bb1527-kube-api-access-7g92c\") pod \"migrator-76794cbd6c-sm7g2\" (UID: \"6f9d35d4-19ef-4077-8848-3e0e09bb1527\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"
Sep 19 11:34:32.978405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.978375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g92c\" (UniqueName: \"kubernetes.io/projected/6f9d35d4-19ef-4077-8848-3e0e09bb1527-kube-api-access-7g92c\") pod \"migrator-76794cbd6c-sm7g2\" (UID: \"6f9d35d4-19ef-4077-8848-3e0e09bb1527\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"
Sep 19 11:34:32.985869 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:32.985850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g92c\" (UniqueName: \"kubernetes.io/projected/6f9d35d4-19ef-4077-8848-3e0e09bb1527-kube-api-access-7g92c\") pod \"migrator-76794cbd6c-sm7g2\" (UID: \"6f9d35d4-19ef-4077-8848-3e0e09bb1527\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"
Sep 19 11:34:33.070998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:33.070939    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"
Sep 19 11:34:33.281509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:33.281477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:33.281680 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:33.281549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:33.281680 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:33.281627    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:33.281749 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:33.281698    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:34.281683718 +0000 UTC m=+45.298720407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:33.281749 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:33.281631    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 11:34:33.281822 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:33.281759    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:34.281748535 +0000 UTC m=+45.298785223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : configmap "kube-rbac-proxy" not found
Sep 19 11:34:33.360325 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:33.360265    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2"]
Sep 19 11:34:33.363478 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:33.363452    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9d35d4_19ef_4077_8848_3e0e09bb1527.slice/crio-e30eb87d70cedee9d60410e379b7dc55ac1a2a16fea8cb3d1d270c2555f6932c WatchSource:0}: Error finding container e30eb87d70cedee9d60410e379b7dc55ac1a2a16fea8cb3d1d270c2555f6932c: Status 404 returned error can't find the container with id e30eb87d70cedee9d60410e379b7dc55ac1a2a16fea8cb3d1d270c2555f6932c
Sep 19 11:34:33.891240 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:33.891205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2" event={"ID":"6f9d35d4-19ef-4077-8848-3e0e09bb1527","Type":"ContainerStarted","Data":"e30eb87d70cedee9d60410e379b7dc55ac1a2a16fea8cb3d1d270c2555f6932c"}
Sep 19 11:34:34.044614 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.044589    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gf2qm_794c3f80-270d-4390-95ac-064346466631/dns-node-resolver/0.log"
Sep 19 11:34:34.243260 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.243231    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bhbj7"]
Sep 19 11:34:34.264694 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.264664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bhbj7"]
Sep 19 11:34:34.264888 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.264784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.267290 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.267263    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 19 11:34:34.268504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.268276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zmrxp\""
Sep 19 11:34:34.268504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.268320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 19 11:34:34.268504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.268363    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 19 11:34:34.268504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.268364    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 19 11:34:34.288433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.288414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:34.288524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.288467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:34.288571 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:34.288531    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 11:34:34.288571 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:34.288549    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:34.288649 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:34.288586    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:36.288572713 +0000 UTC m=+47.305609401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : configmap "kube-rbac-proxy" not found
Sep 19 11:34:34.288649 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:34.288601    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:36.288594617 +0000 UTC m=+47.305631306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:34.389356 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.389331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/204f842b-5e04-43ec-8580-a5b32c0e0f70-signing-key\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.389508 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.389370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qd5l\" (UniqueName: \"kubernetes.io/projected/204f842b-5e04-43ec-8580-a5b32c0e0f70-kube-api-access-9qd5l\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.389508 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.389388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/204f842b-5e04-43ec-8580-a5b32c0e0f70-signing-cabundle\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.490554 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.490521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/204f842b-5e04-43ec-8580-a5b32c0e0f70-signing-key\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.490695 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.490564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qd5l\" (UniqueName: \"kubernetes.io/projected/204f842b-5e04-43ec-8580-a5b32c0e0f70-kube-api-access-9qd5l\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.490695 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.490591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/204f842b-5e04-43ec-8580-a5b32c0e0f70-signing-cabundle\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.491367 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.491348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/204f842b-5e04-43ec-8580-a5b32c0e0f70-signing-cabundle\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.492820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.492802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/204f842b-5e04-43ec-8580-a5b32c0e0f70-signing-key\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.498699 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.498645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qd5l\" (UniqueName: \"kubernetes.io/projected/204f842b-5e04-43ec-8580-a5b32c0e0f70-kube-api-access-9qd5l\") pod \"service-ca-55f6fc7b86-bhbj7\" (UID: \"204f842b-5e04-43ec-8580-a5b32c0e0f70\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:34.576194 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:34.576158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7"
Sep 19 11:34:35.000483 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.000449    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bhbj7"]
Sep 19 11:34:35.044416 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.044370    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bf9j6_98b60b02-8436-4c3e-a488-96c4b0b17583/node-ca/0.log"
Sep 19 11:34:35.067318 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:35.067294    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f842b_5e04_43ec_8580_a5b32c0e0f70.slice/crio-29c96d4791baf77dfc103d880f7ed6092f05b92abc6b32aa5ad26170c2b2ae78 WatchSource:0}: Error finding container 29c96d4791baf77dfc103d880f7ed6092f05b92abc6b32aa5ad26170c2b2ae78: Status 404 returned error can't find the container with id 29c96d4791baf77dfc103d880f7ed6092f05b92abc6b32aa5ad26170c2b2ae78
Sep 19 11:34:35.644487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.644400    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm742_b431d345-caad-4147-9cba-91d0759b5330/serve-healthcheck-canary/0.log"
Sep 19 11:34:35.898801 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.898719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2" event={"ID":"6f9d35d4-19ef-4077-8848-3e0e09bb1527","Type":"ContainerStarted","Data":"3f1eec7dc778ffa2c77b4e8979656539a3de0364ebef3e4e51871220c8ba9ee1"}
Sep 19 11:34:35.898801 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.898791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2" event={"ID":"6f9d35d4-19ef-4077-8848-3e0e09bb1527","Type":"ContainerStarted","Data":"441ea7d5e52c43a6d1997346b905d17b0df8de9838d1ac365d9586c3af9b207d"}
Sep 19 11:34:35.900078 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.900048    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7" event={"ID":"204f842b-5e04-43ec-8580-a5b32c0e0f70","Type":"ContainerStarted","Data":"29c96d4791baf77dfc103d880f7ed6092f05b92abc6b32aa5ad26170c2b2ae78"}
Sep 19 11:34:35.916030 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:35.915977    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-sm7g2" podStartSLOduration=2.187407574 podStartE2EDuration="3.915959785s" totalImagesPullingTime="1.728552211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:35.913806153 +0000 UTC m=+46.930842866" watchObservedRunningTime="2026-09-19 11:34:35.915959785 +0000 UTC m=+46.932996497"
Sep 19 11:34:36.303908 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:36.303874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:36.304349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:36.304004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:36.304349 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:36.304030    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:36.304349 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:36.304091    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 11:34:36.304349 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:36.304115    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:40.304095938 +0000 UTC m=+51.321132640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:36.304349 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:36.304169    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:40.304149908 +0000 UTC m=+51.321186604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : configmap "kube-rbac-proxy" not found
Sep 19 11:34:37.906604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:37.906561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7" event={"ID":"204f842b-5e04-43ec-8580-a5b32c0e0f70","Type":"ContainerStarted","Data":"393abeb9a44ffea4795ffc08196428a013a7cadd793d54c4fad5a7ee33c61112"}
Sep 19 11:34:37.926047 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:37.926003    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-bhbj7" podStartSLOduration=1.702094869 podStartE2EDuration="3.925988126s" totalImagesPullingTime="2.223893257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:37.924511854 +0000 UTC m=+48.941548566" watchObservedRunningTime="2026-09-19 11:34:37.925988126 +0000 UTC m=+48.943024836"
Sep 19 11:34:38.119524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:38.119486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") pod \"image-registry-85868d5fb5-rpg6t\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") " pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:38.119683 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:38.119630    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 11:34:38.119683 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:38.119650    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85868d5fb5-rpg6t: secret "image-registry-tls" not found
Sep 19 11:34:38.119790 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:38.119702    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls podName:497114e5-49e3-4ccd-ab2a-0473fd9424eb nodeName:}" failed. No retries permitted until 2026-09-19 11:34:54.119688652 +0000 UTC m=+65.136725362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls") pod "image-registry-85868d5fb5-rpg6t" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb") : secret "image-registry-tls" not found
Sep 19 11:34:38.220102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:38.220032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:38.220237 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:38.220178    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 11:34:38.220274 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:38.220237    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls podName:c14c5be0-3da7-460b-903c-5e5ce5583e72 nodeName:}" failed. No retries permitted until 2026-09-19 11:34:54.220219982 +0000 UTC m=+65.237256670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls") pod "dns-default-cvrq2" (UID: "c14c5be0-3da7-460b-903c-5e5ce5583e72") : secret "dns-default-metrics-tls" not found
Sep 19 11:34:40.335630 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:40.335594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:40.336090 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:40.335699    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 11:34:40.336090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:40.335708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:40.336090 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:40.335754    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:48.335739147 +0000 UTC m=+59.352775836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : configmap "kube-rbac-proxy" not found
Sep 19 11:34:40.336090 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:40.335834    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:40.336090 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:40.335888    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:34:48.335873993 +0000 UTC m=+59.352910685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:48.394103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:48.394068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:48.394614 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:48.394162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:48.394614 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:48.394248    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:48.394614 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:48.394318    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls podName:3c9b8058-f4d5-428b-a07a-1562a8048dfd nodeName:}" failed. No retries permitted until 2026-09-19 11:35:04.394300085 +0000 UTC m=+75.411336791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l6vd" (UID: "3c9b8058-f4d5-428b-a07a-1562a8048dfd") : secret "insights-runtime-extractor-tls" not found
Sep 19 11:34:48.394793 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:48.394775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c9b8058-f4d5-428b-a07a-1562a8048dfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:34:48.850944 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:48.850902    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp6vf"
Sep 19 11:34:52.151974 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.151937    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85868d5fb5-rpg6t"]
Sep 19 11:34:52.152380 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:34:52.152161    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t" podUID="497114e5-49e3-4ccd-ab2a-0473fd9424eb"
Sep 19 11:34:52.195396 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.195367    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d9b799f7d-54l8q"]
Sep 19 11:34:52.198093 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.198076    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.213572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.213550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d9b799f7d-54l8q"]
Sep 19 11:34:52.223723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a6fcf53-6194-419b-80ab-79322650d3df-image-registry-private-configuration\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.223819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a6fcf53-6194-419b-80ab-79322650d3df-ca-trust-extracted\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.223819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a6fcf53-6194-419b-80ab-79322650d3df-registry-certificates\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.223819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223796    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-bound-sa-token\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.223959 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-registry-tls\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.223959 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a6fcf53-6194-419b-80ab-79322650d3df-trusted-ca\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.224035 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.223967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a6fcf53-6194-419b-80ab-79322650d3df-installation-pull-secrets\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.224079 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.224035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fwgl\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-kube-api-access-8fwgl\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a6fcf53-6194-419b-80ab-79322650d3df-trusted-ca\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a6fcf53-6194-419b-80ab-79322650d3df-installation-pull-secrets\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325284 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fwgl\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-kube-api-access-8fwgl\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325284 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a6fcf53-6194-419b-80ab-79322650d3df-image-registry-private-configuration\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a6fcf53-6194-419b-80ab-79322650d3df-ca-trust-extracted\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a6fcf53-6194-419b-80ab-79322650d3df-registry-certificates\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-bound-sa-token\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-registry-tls\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.325718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.325683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a6fcf53-6194-419b-80ab-79322650d3df-ca-trust-extracted\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.326171 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.326143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a6fcf53-6194-419b-80ab-79322650d3df-registry-certificates\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.326257 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.326204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a6fcf53-6194-419b-80ab-79322650d3df-trusted-ca\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.327588 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.327560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a6fcf53-6194-419b-80ab-79322650d3df-image-registry-private-configuration\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.327734 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.327718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-registry-tls\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.327795 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.327734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a6fcf53-6194-419b-80ab-79322650d3df-installation-pull-secrets\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.332551 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.332528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fwgl\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-kube-api-access-8fwgl\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.333415 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.333395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a6fcf53-6194-419b-80ab-79322650d3df-bound-sa-token\") pod \"image-registry-6d9b799f7d-54l8q\" (UID: \"2a6fcf53-6194-419b-80ab-79322650d3df\") " pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.509178 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.509151    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sbk8r\""
Sep 19 11:34:52.517208 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.517189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.785842 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.785772    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d9b799f7d-54l8q"]
Sep 19 11:34:52.788351 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:52.788319    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6fcf53_6194_419b_80ab_79322650d3df.slice/crio-3987b5b71205a557c1b5455a428460a10cb7ab2a6e459b9ab4b1014b23304ca7 WatchSource:0}: Error finding container 3987b5b71205a557c1b5455a428460a10cb7ab2a6e459b9ab4b1014b23304ca7: Status 404 returned error can't find the container with id 3987b5b71205a557c1b5455a428460a10cb7ab2a6e459b9ab4b1014b23304ca7
Sep 19 11:34:52.945141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.945111    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:52.945141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.945129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q" event={"ID":"2a6fcf53-6194-419b-80ab-79322650d3df","Type":"ContainerStarted","Data":"f22653d7b0469496aa3a1f3564bd14df5e700cca31550b33f278a4cbd21eeaa8"}
Sep 19 11:34:52.945345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.945200    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q" event={"ID":"2a6fcf53-6194-419b-80ab-79322650d3df","Type":"ContainerStarted","Data":"3987b5b71205a557c1b5455a428460a10cb7ab2a6e459b9ab4b1014b23304ca7"}
Sep 19 11:34:52.945345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.945220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:34:52.950358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.950336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:52.982006 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:52.981959    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q" podStartSLOduration=0.981943961 podStartE2EDuration="981.943961ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:34:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:52.980705597 +0000 UTC m=+63.997742309" watchObservedRunningTime="2026-09-19 11:34:52.981943961 +0000 UTC m=+63.998980672"
Sep 19 11:34:53.032612 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-bound-sa-token\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.032773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032627    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-trusted-ca\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.032773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-installation-pull-secrets\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.032773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032706    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/497114e5-49e3-4ccd-ab2a-0473fd9424eb-ca-trust-extracted\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.032773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032747    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtnj4\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-kube-api-access-vtnj4\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.032998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-certificates\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.032998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-image-registry-private-configuration\") pod \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\" (UID: \"497114e5-49e3-4ccd-ab2a-0473fd9424eb\") "
Sep 19 11:34:53.033096 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.032980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/497114e5-49e3-4ccd-ab2a-0473fd9424eb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:34:53.033505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.033161    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:34:53.033505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.033194    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/497114e5-49e3-4ccd-ab2a-0473fd9424eb-ca-trust-extracted\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.034046 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.034019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:34:53.035403 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.035373    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:34:53.035403 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.035386    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-kube-api-access-vtnj4" (OuterVolumeSpecName: "kube-api-access-vtnj4") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "kube-api-access-vtnj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:34:53.035569 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.035514    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:34:53.035628 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.035579    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "497114e5-49e3-4ccd-ab2a-0473fd9424eb" (UID: "497114e5-49e3-4ccd-ab2a-0473fd9424eb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:34:53.133779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.133690    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-installation-pull-secrets\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.133779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.133738    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtnj4\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-kube-api-access-vtnj4\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.133779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.133750    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-certificates\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.133779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.133759    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/497114e5-49e3-4ccd-ab2a-0473fd9424eb-image-registry-private-configuration\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.133779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.133768    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-bound-sa-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.133779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.133777    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/497114e5-49e3-4ccd-ab2a-0473fd9424eb-trusted-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:53.655860 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.655828    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-l6c6n"]
Sep 19 11:34:53.697968 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.697886    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-l6c6n"]
Sep 19 11:34:53.698088 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.698009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:34:53.700561 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.700536    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 11:34:53.700738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.700720    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dgtd5\""
Sep 19 11:34:53.700738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.700733    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 11:34:53.739393 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.739364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4fr\" (UniqueName: \"kubernetes.io/projected/70d7bb7e-0291-4006-9dde-65deaef5fb18-kube-api-access-vs4fr\") pod \"downloads-6594f4c75-l6c6n\" (UID: \"70d7bb7e-0291-4006-9dde-65deaef5fb18\") " pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:34:53.840515 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.840484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4fr\" (UniqueName: \"kubernetes.io/projected/70d7bb7e-0291-4006-9dde-65deaef5fb18-kube-api-access-vs4fr\") pod \"downloads-6594f4c75-l6c6n\" (UID: \"70d7bb7e-0291-4006-9dde-65deaef5fb18\") " pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:34:53.848723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.848685    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4fr\" (UniqueName: \"kubernetes.io/projected/70d7bb7e-0291-4006-9dde-65deaef5fb18-kube-api-access-vs4fr\") pod \"downloads-6594f4c75-l6c6n\" (UID: \"70d7bb7e-0291-4006-9dde-65deaef5fb18\") " pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:34:53.947607 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.947579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85868d5fb5-rpg6t"
Sep 19 11:34:53.975694 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.975622    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85868d5fb5-rpg6t"]
Sep 19 11:34:53.982668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:53.982645    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85868d5fb5-rpg6t"]
Sep 19 11:34:54.006928 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.006893    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:34:54.043201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.043178    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/497114e5-49e3-4ccd-ab2a-0473fd9424eb-registry-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:34:54.143657 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.143624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:54.146314 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.146295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 11:34:54.156354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.156326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fd294aa-feef-4364-9715-5127ec92db9f-original-pull-secret\") pod \"global-pull-secret-syncer-9j4hc\" (UID: \"3fd294aa-feef-4364-9715-5127ec92db9f\") " pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:54.244741 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.244707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:54.244863 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.244750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:54.247035 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.247008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c14c5be0-3da7-460b-903c-5e5ce5583e72-metrics-tls\") pod \"dns-default-cvrq2\" (UID: \"c14c5be0-3da7-460b-903c-5e5ce5583e72\") " pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:54.247657 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.247641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 11:34:54.257276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.257258    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e237339b-bb08-479d-8ff0-dc341da0a6b0-metrics-certs\") pod \"network-metrics-daemon-sxqbh\" (UID: \"e237339b-bb08-479d-8ff0-dc341da0a6b0\") " pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:54.290589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.290556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-l6c6n"]
Sep 19 11:34:54.293040 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:54.293022    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d7bb7e_0291_4006_9dde_65deaef5fb18.slice/crio-e86bc05ba6bdb73648f82afe9f9d2271cdeba3b40f34dd8a2d88d8207a4f9566 WatchSource:0}: Error finding container e86bc05ba6bdb73648f82afe9f9d2271cdeba3b40f34dd8a2d88d8207a4f9566: Status 404 returned error can't find the container with id e86bc05ba6bdb73648f82afe9f9d2271cdeba3b40f34dd8a2d88d8207a4f9566
Sep 19 11:34:54.345925 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.345877    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:54.348379 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.348359    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 11:34:54.357375 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.357352    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9j4hc"
Sep 19 11:34:54.358603 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.358587    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 11:34:54.364510 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.364495    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6c6f7\""
Sep 19 11:34:54.369461 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.369444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j56z8\" (UniqueName: \"kubernetes.io/projected/b4d242b4-6d60-4081-a0ef-8f10e78e5d1e-kube-api-access-j56z8\") pod \"network-check-target-s2q9f\" (UID: \"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e\") " pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:54.373220 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.373202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxqbh"
Sep 19 11:34:54.446436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.446411    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mvj2p\""
Sep 19 11:34:54.454520 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.454438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:54.652865 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.652837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhwvf\""
Sep 19 11:34:54.654496 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.654463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9j4hc"]
Sep 19 11:34:54.658339 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:54.658318    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd294aa_feef_4364_9715_5127ec92db9f.slice/crio-d3bedaf7d407979b722e8a7642ad99788bc7a1b169845c030c1357ea2cf7e181 WatchSource:0}: Error finding container d3bedaf7d407979b722e8a7642ad99788bc7a1b169845c030c1357ea2cf7e181: Status 404 returned error can't find the container with id d3bedaf7d407979b722e8a7642ad99788bc7a1b169845c030c1357ea2cf7e181
Sep 19 11:34:54.660299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.660283    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:34:54.680672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.680650    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sxqbh"]
Sep 19 11:34:54.683087 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:54.683065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode237339b_bb08_479d_8ff0_dc341da0a6b0.slice/crio-79b204da7f0decc6dd2d5e526900e0c530e781f20a72adad3cfd44d6668d51f0 WatchSource:0}: Error finding container 79b204da7f0decc6dd2d5e526900e0c530e781f20a72adad3cfd44d6668d51f0: Status 404 returned error can't find the container with id 79b204da7f0decc6dd2d5e526900e0c530e781f20a72adad3cfd44d6668d51f0
Sep 19 11:34:54.742883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.742626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvrq2"]
Sep 19 11:34:54.744718 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:54.744690    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14c5be0_3da7_460b_903c_5e5ce5583e72.slice/crio-50aac25f947bd71c14fb6007ac14311303be7be6865de32e1ac165e08d212d66 WatchSource:0}: Error finding container 50aac25f947bd71c14fb6007ac14311303be7be6865de32e1ac165e08d212d66: Status 404 returned error can't find the container with id 50aac25f947bd71c14fb6007ac14311303be7be6865de32e1ac165e08d212d66
Sep 19 11:34:54.952423 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.952339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-l6c6n" event={"ID":"70d7bb7e-0291-4006-9dde-65deaef5fb18","Type":"ContainerStarted","Data":"e86bc05ba6bdb73648f82afe9f9d2271cdeba3b40f34dd8a2d88d8207a4f9566"}
Sep 19 11:34:54.953837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.953793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sxqbh" event={"ID":"e237339b-bb08-479d-8ff0-dc341da0a6b0","Type":"ContainerStarted","Data":"79b204da7f0decc6dd2d5e526900e0c530e781f20a72adad3cfd44d6668d51f0"}
Sep 19 11:34:54.955865 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.955789    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s2q9f"]
Sep 19 11:34:54.956343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.956316    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9j4hc" event={"ID":"3fd294aa-feef-4364-9715-5127ec92db9f","Type":"ContainerStarted","Data":"d3bedaf7d407979b722e8a7642ad99788bc7a1b169845c030c1357ea2cf7e181"}
Sep 19 11:34:54.957656 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:54.957620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvrq2" event={"ID":"c14c5be0-3da7-460b-903c-5e5ce5583e72","Type":"ContainerStarted","Data":"50aac25f947bd71c14fb6007ac14311303be7be6865de32e1ac165e08d212d66"}
Sep 19 11:34:54.958895 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:34:54.958868    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d242b4_6d60_4081_a0ef_8f10e78e5d1e.slice/crio-eb4a0745450f0860a0f78353527894036084e876d0f03158f550f6adcafe52b5 WatchSource:0}: Error finding container eb4a0745450f0860a0f78353527894036084e876d0f03158f550f6adcafe52b5: Status 404 returned error can't find the container with id eb4a0745450f0860a0f78353527894036084e876d0f03158f550f6adcafe52b5
Sep 19 11:34:55.544604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:55.544385    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497114e5-49e3-4ccd-ab2a-0473fd9424eb" path="/var/lib/kubelet/pods/497114e5-49e3-4ccd-ab2a-0473fd9424eb/volumes"
Sep 19 11:34:55.964142 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:55.964060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s2q9f" event={"ID":"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e","Type":"ContainerStarted","Data":"eb4a0745450f0860a0f78353527894036084e876d0f03158f550f6adcafe52b5"}
Sep 19 11:34:56.973420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:56.973382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sxqbh" event={"ID":"e237339b-bb08-479d-8ff0-dc341da0a6b0","Type":"ContainerStarted","Data":"87541ef44688d6f4131e26c8cbd48633c684c02506b5b0e2660c54ea19eadc16"}
Sep 19 11:34:57.982036 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:57.981952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sxqbh" event={"ID":"e237339b-bb08-479d-8ff0-dc341da0a6b0","Type":"ContainerStarted","Data":"8ec14fedfc110b9a050a940f0db1ede8cefc1bdf62010d44a173cd9ed4f2f679"}
Sep 19 11:34:57.984937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:57.984880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvrq2" event={"ID":"c14c5be0-3da7-460b-903c-5e5ce5583e72","Type":"ContainerStarted","Data":"a6d445021167bacbf14f72d2203e73754fc4830c7ead29b57978a97f4e7bc141"}
Sep 19 11:34:57.985074 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:57.985055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvrq2" event={"ID":"c14c5be0-3da7-460b-903c-5e5ce5583e72","Type":"ContainerStarted","Data":"ce86aded4cfee90f9a3521af3e9776e9fb67fe5925f25bf2ff8a05f2d256bc8c"}
Sep 19 11:34:57.985172 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:57.985148    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:34:58.002289 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:58.002238    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sxqbh" podStartSLOduration=67.343103246 podStartE2EDuration="1m9.002219544s" totalImagesPullingTime="1.659116298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:57.996741141 +0000 UTC m=+69.013777851" watchObservedRunningTime="2026-09-19 11:34:58.002219544 +0000 UTC m=+69.019256258"
Sep 19 11:34:58.015251 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:34:58.015187    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cvrq2" podStartSLOduration=33.586687296 podStartE2EDuration="36.015169408s" totalImagesPullingTime="2.428482112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:34:58.014232308 +0000 UTC m=+69.031269020" watchObservedRunningTime="2026-09-19 11:34:58.015169408 +0000 UTC m=+69.032206121"
Sep 19 11:35:01.000006 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:00.999970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9j4hc" event={"ID":"3fd294aa-feef-4364-9715-5127ec92db9f","Type":"ContainerStarted","Data":"2cb0ced19f8facd8536e3a8920ef3e51f57c5f0123ed78891b5908b36f093c45"}
Sep 19 11:35:01.001794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:01.001757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s2q9f" event={"ID":"b4d242b4-6d60-4081-a0ef-8f10e78e5d1e","Type":"ContainerStarted","Data":"a8bd7799c24389f8bcb7fe864552d5bbeeecffc6c0e16c37fd7382cd8ce12fb9"}
Sep 19 11:35:01.001908 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:01.001885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:35:01.014814 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:01.014763    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9j4hc" podStartSLOduration=66.084512161 podStartE2EDuration="1m12.014743632s" totalImagesPullingTime="5.930231471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:01.013789749 +0000 UTC m=+72.030826461" watchObservedRunningTime="2026-09-19 11:35:01.014743632 +0000 UTC m=+72.031780344"
Sep 19 11:35:01.032003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:01.031951    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s2q9f" podStartSLOduration=66.408759924 podStartE2EDuration="1m12.031933584s" totalImagesPullingTime="5.62317366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:01.030994708 +0000 UTC m=+72.048031422" watchObservedRunningTime="2026-09-19 11:35:01.031933584 +0000 UTC m=+72.048970329"
Sep 19 11:35:04.424161 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:04.424116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:35:04.426809 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:04.426782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c9b8058-f4d5-428b-a07a-1562a8048dfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l6vd\" (UID: \"3c9b8058-f4d5-428b-a07a-1562a8048dfd\") " pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:35:04.619181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:04.619148    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g979l\""
Sep 19 11:35:04.627395 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:04.627369    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5l6vd"
Sep 19 11:35:07.992701 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:07.992663    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cvrq2"
Sep 19 11:35:11.575611 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:11.575527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5l6vd"]
Sep 19 11:35:11.578592 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:35:11.578558    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9b8058_f4d5_428b_a07a_1562a8048dfd.slice/crio-9cea1197b76f1c9eb63d554f02cdeab59e1eaea48ae2e6976066fa995fa9f346 WatchSource:0}: Error finding container 9cea1197b76f1c9eb63d554f02cdeab59e1eaea48ae2e6976066fa995fa9f346: Status 404 returned error can't find the container with id 9cea1197b76f1c9eb63d554f02cdeab59e1eaea48ae2e6976066fa995fa9f346
Sep 19 11:35:12.045144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:12.044840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l6vd" event={"ID":"3c9b8058-f4d5-428b-a07a-1562a8048dfd","Type":"ContainerStarted","Data":"9a9d6d3ddb68f77e5dba7a568e2b11a97415ec440ce30909f58d2f0c5d3cc6f2"}
Sep 19 11:35:12.045144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:12.044943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l6vd" event={"ID":"3c9b8058-f4d5-428b-a07a-1562a8048dfd","Type":"ContainerStarted","Data":"9cea1197b76f1c9eb63d554f02cdeab59e1eaea48ae2e6976066fa995fa9f346"}
Sep 19 11:35:12.047707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:12.047675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-l6c6n" event={"ID":"70d7bb7e-0291-4006-9dde-65deaef5fb18","Type":"ContainerStarted","Data":"bed89477eba1ad31d85fbd7af5cfd7f837919390c262ad04f4e03ce91cf9af5c"}
Sep 19 11:35:12.048258 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:12.048233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:35:12.059945 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:12.059906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-l6c6n"
Sep 19 11:35:12.068135 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:12.068086    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-l6c6n" podStartSLOduration=1.969893618 podStartE2EDuration="19.068064388s" totalImagesPullingTime="17.09817077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:12.06581552 +0000 UTC m=+83.082852230" watchObservedRunningTime="2026-09-19 11:35:12.068064388 +0000 UTC m=+83.085101098"
Sep 19 11:35:13.055055 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:13.055014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l6vd" event={"ID":"3c9b8058-f4d5-428b-a07a-1562a8048dfd","Type":"ContainerStarted","Data":"8889ceb69cabda6ed8b6ecf254cacf9d2269d8cb89c45b6f18b391769e908783"}
Sep 19 11:35:13.952890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:13.952858    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d9b799f7d-54l8q"
Sep 19 11:35:15.065762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:15.065726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l6vd" event={"ID":"3c9b8058-f4d5-428b-a07a-1562a8048dfd","Type":"ContainerStarted","Data":"7f639b82f3ac7a8d9ade03f6c103974ed21a417610a35e6a185d67404a177c6d"}
Sep 19 11:35:15.083410 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:15.083363    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5l6vd" podStartSLOduration=40.513563535 podStartE2EDuration="43.083347019s" totalImagesPullingTime="2.569783484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 11:34:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:15.083028929 +0000 UTC m=+86.100065641" watchObservedRunningTime="2026-09-19 11:35:15.083347019 +0000 UTC m=+86.100383730"
Sep 19 11:35:29.291439 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.291408    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cvsl8"]
Sep 19 11:35:29.318545 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.318520    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.321128 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.321105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5clwj\""
Sep 19 11:35:29.321405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.321384    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 11:35:29.321470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.321418    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 11:35:29.322505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.322473    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 11:35:29.322623 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.322488    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 11:35:29.322623 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.322606    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 11:35:29.322773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.322757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 11:35:29.411189 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-wtmp\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-accelerators-collector-config\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-sys\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-metrics-client-ca\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-tls\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-textfile\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vn7t\" (UniqueName: \"kubernetes.io/projected/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-kube-api-access-2vn7t\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.411572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.411523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-root\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.512790 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-sys\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.512978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-metrics-client-ca\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.512978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-tls\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.512978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-sys\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.512978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-textfile\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.512978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vn7t\" (UniqueName: \"kubernetes.io/projected/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-kube-api-access-2vn7t\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.512995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-root\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-wtmp\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513309 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:35:29.513033    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 19 11:35:29.513309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-accelerators-collector-config\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513309 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:35:29.513106    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-tls podName:c3a8e519-a4f9-4cc6-bd7f-61c600f8be53 nodeName:}" failed. No retries permitted until 2026-09-19 11:35:30.013085056 +0000 UTC m=+101.030121772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-tls") pod "node-exporter-cvsl8" (UID: "c3a8e519-a4f9-4cc6-bd7f-61c600f8be53") : secret "node-exporter-tls" not found
Sep 19 11:35:29.513658 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-root\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513658 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-wtmp\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513759 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-metrics-client-ca\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.513759 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.513745    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-textfile\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.514291 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.514266    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-accelerators-collector-config\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.516098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.516049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:29.523461 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:29.523438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vn7t\" (UniqueName: \"kubernetes.io/projected/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-kube-api-access-2vn7t\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:30.016889 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:30.016857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-tls\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:30.019242 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:30.019217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3a8e519-a4f9-4cc6-bd7f-61c600f8be53-node-exporter-tls\") pod \"node-exporter-cvsl8\" (UID: \"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53\") " pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:30.228133 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:30.228101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cvsl8"
Sep 19 11:35:30.268475 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:35:30.268414    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a8e519_a4f9_4cc6_bd7f_61c600f8be53.slice/crio-62bc24ae0a446635ef14730950553269a990894b1b73a585527419524b05d688 WatchSource:0}: Error finding container 62bc24ae0a446635ef14730950553269a990894b1b73a585527419524b05d688: Status 404 returned error can't find the container with id 62bc24ae0a446635ef14730950553269a990894b1b73a585527419524b05d688
Sep 19 11:35:31.120594 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:31.120556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvsl8" event={"ID":"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53","Type":"ContainerStarted","Data":"62bc24ae0a446635ef14730950553269a990894b1b73a585527419524b05d688"}
Sep 19 11:35:32.008366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:32.008342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s2q9f"
Sep 19 11:35:32.124876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:32.124844    2582 generic.go:356] "Generic (PLEG): container finished" podID="c3a8e519-a4f9-4cc6-bd7f-61c600f8be53" containerID="93c2db03c54ffc9f74bd8d4368cc105cdf7bfda7ac17c3956cde6454b1e15783" exitCode=0
Sep 19 11:35:32.125264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:32.124887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvsl8" event={"ID":"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53","Type":"ContainerDied","Data":"93c2db03c54ffc9f74bd8d4368cc105cdf7bfda7ac17c3956cde6454b1e15783"}
Sep 19 11:35:33.131179 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:33.131147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvsl8" event={"ID":"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53","Type":"ContainerStarted","Data":"97d925e6c02306a95b62bc9b16fd67b49ece3f4aa346b9b459be820019ae7982"}
Sep 19 11:35:33.131654 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:33.131195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvsl8" event={"ID":"c3a8e519-a4f9-4cc6-bd7f-61c600f8be53","Type":"ContainerStarted","Data":"00959200a32d7f4ef39ae388e7487f7b959d94812607f7f549b73bdfea1dff5a"}
Sep 19 11:35:33.152493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:33.152439    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cvsl8" podStartSLOduration=2.706438363 podStartE2EDuration="4.152423119s" totalImagesPullingTime="1.36843656s" totalInitContainerRuntime="77.548196ms" isStatefulPod=true podCreationTimestamp="2026-09-19 11:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:33.147909989 +0000 UTC m=+104.164946701" watchObservedRunningTime="2026-09-19 11:35:33.152423119 +0000 UTC m=+104.169459829"
Sep 19 11:35:34.066873 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.066837    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"]
Sep 19 11:35:34.092238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.092203    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f88c8459-nph4f"]
Sep 19 11:35:34.092427 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.092385    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.094828 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.094801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 19 11:35:34.095091 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.095074    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ccrgb\""
Sep 19 11:35:34.108197 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.108177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"]
Sep 19 11:35:34.108298 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.108208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f88c8459-nph4f"]
Sep 19 11:35:34.108298 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.108280    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.110683 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.110660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 11:35:34.110792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.110694    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 11:35:34.110792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.110730    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 11:35:34.110997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.110982    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-26r9q\""
Sep 19 11:35:34.110997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.110985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 11:35:34.111233 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.111218    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 11:35:34.115886 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.115869    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 11:35:34.249110 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwpwk\" (UniqueName: \"kubernetes.io/projected/e81463f6-cfc7-4a8b-ac19-da3840fe3353-kube-api-access-hwpwk\") pod \"monitoring-plugin-5984459ff8-2j9v2\" (UID: \"e81463f6-cfc7-4a8b-ac19-da3840fe3353\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.249110 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-service-ca\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e81463f6-cfc7-4a8b-ac19-da3840fe3353-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-2j9v2\" (UID: \"e81463f6-cfc7-4a8b-ac19-da3840fe3353\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-trusted-ca-bundle\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-serving-cert\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-oauth-serving-cert\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-oauth-config\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5blz\" (UniqueName: \"kubernetes.io/projected/e1800f23-ca47-4828-9408-0adbf51b2273-kube-api-access-x5blz\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.249616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.249514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-console-config\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350245 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-console-config\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350245 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwpwk\" (UniqueName: \"kubernetes.io/projected/e81463f6-cfc7-4a8b-ac19-da3840fe3353-kube-api-access-hwpwk\") pod \"monitoring-plugin-5984459ff8-2j9v2\" (UID: \"e81463f6-cfc7-4a8b-ac19-da3840fe3353\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.350245 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-service-ca\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350459 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e81463f6-cfc7-4a8b-ac19-da3840fe3353-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-2j9v2\" (UID: \"e81463f6-cfc7-4a8b-ac19-da3840fe3353\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.350459 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-trusted-ca-bundle\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350459 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-serving-cert\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350459 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-oauth-serving-cert\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350459 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-oauth-config\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.350459 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.350413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5blz\" (UniqueName: \"kubernetes.io/projected/e1800f23-ca47-4828-9408-0adbf51b2273-kube-api-access-x5blz\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.351179 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.351154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-service-ca\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.351305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.351155    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-console-config\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.351365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.351329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-oauth-serving-cert\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.351426 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.351403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-trusted-ca-bundle\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.352948 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.352908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-serving-cert\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.353040 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.353014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-oauth-config\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.353077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.353060    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e81463f6-cfc7-4a8b-ac19-da3840fe3353-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-2j9v2\" (UID: \"e81463f6-cfc7-4a8b-ac19-da3840fe3353\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.358045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.358019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5blz\" (UniqueName: \"kubernetes.io/projected/e1800f23-ca47-4828-9408-0adbf51b2273-kube-api-access-x5blz\") pod \"console-8f88c8459-nph4f\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") " pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.358338 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.358319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwpwk\" (UniqueName: \"kubernetes.io/projected/e81463f6-cfc7-4a8b-ac19-da3840fe3353-kube-api-access-hwpwk\") pod \"monitoring-plugin-5984459ff8-2j9v2\" (UID: \"e81463f6-cfc7-4a8b-ac19-da3840fe3353\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.402760 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.402736    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:34.417925 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.417901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:34.705377 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.705291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"]
Sep 19 11:35:34.707750 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:35:34.707721    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81463f6_cfc7_4a8b_ac19_da3840fe3353.slice/crio-6e8877358a2d1436b351a5cfeca429c108ae58b88eb14d166fd57d80bd90f88e WatchSource:0}: Error finding container 6e8877358a2d1436b351a5cfeca429c108ae58b88eb14d166fd57d80bd90f88e: Status 404 returned error can't find the container with id 6e8877358a2d1436b351a5cfeca429c108ae58b88eb14d166fd57d80bd90f88e
Sep 19 11:35:34.732222 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:34.732203    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f88c8459-nph4f"]
Sep 19 11:35:34.734875 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:35:34.734848    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1800f23_ca47_4828_9408_0adbf51b2273.slice/crio-79f45fc6a7de30df067e623128fa0786b6052b1feace690333a2b09df867d57b WatchSource:0}: Error finding container 79f45fc6a7de30df067e623128fa0786b6052b1feace690333a2b09df867d57b: Status 404 returned error can't find the container with id 79f45fc6a7de30df067e623128fa0786b6052b1feace690333a2b09df867d57b
Sep 19 11:35:35.138327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.138296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f88c8459-nph4f" event={"ID":"e1800f23-ca47-4828-9408-0adbf51b2273","Type":"ContainerStarted","Data":"79f45fc6a7de30df067e623128fa0786b6052b1feace690333a2b09df867d57b"}
Sep 19 11:35:35.139415 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.139392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2" event={"ID":"e81463f6-cfc7-4a8b-ac19-da3840fe3353","Type":"ContainerStarted","Data":"6e8877358a2d1436b351a5cfeca429c108ae58b88eb14d166fd57d80bd90f88e"}
Sep 19 11:35:35.489964 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.488117    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:35:35.492384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.491237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.496349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.496215    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 11:35:35.499670 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.499268    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9359dm3p2ll30\""
Sep 19 11:35:35.499670 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.499493    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 11:35:35.499850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.499696    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q8rcj\""
Sep 19 11:35:35.500348 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.500032    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 11:35:35.500348 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.500293    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 11:35:35.500726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.500478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 11:35:35.500726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.500662    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 11:35:35.501037 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.500828    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 11:35:35.501093 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.501042    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 11:35:35.501683 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.501236    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 11:35:35.501683 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.501305    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 11:35:35.501683 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.501410    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 11:35:35.504843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.504626    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 11:35:35.505823 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.505802    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 11:35:35.506130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.506109    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 11:35:35.526494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.526472    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 11:35:35.557186 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.557162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.662926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-config\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.663827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.663827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.663827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjpr\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-kube-api-access-wjjpr\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.663827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.662675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjpr\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-kube-api-access-wjjpr\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.763875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.763995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.764321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.764232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.765544 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.765515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.766605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.766277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.766605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.766571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.766751 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.766616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.766819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.766795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.768466 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.768440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.768954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.768909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.770415 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.770393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-config\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.770504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.770442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.770718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.770690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.770931 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.770888    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.771060 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.771040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.771140 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.771116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.771203 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.771175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.773003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.772957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.773687 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.773620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-config\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.777937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.777626    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjpr\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-kube-api-access-wjjpr\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.781120 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.781093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.781525 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.781503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.781610 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.781527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.782703 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.782678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.783984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.783943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:35.805994 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:35.805970    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:35:36.115795 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:36.115765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:35:36.371300 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:35:36.371225    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e039c34_2db3_478c_b593_79f201cb3ae1.slice/crio-612a4c1a15a8a7b4f2defe59aedfb90b51f8be703691e4a463a631a39df8a886 WatchSource:0}: Error finding container 612a4c1a15a8a7b4f2defe59aedfb90b51f8be703691e4a463a631a39df8a886: Status 404 returned error can't find the container with id 612a4c1a15a8a7b4f2defe59aedfb90b51f8be703691e4a463a631a39df8a886
Sep 19 11:35:37.149056 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:37.149022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"612a4c1a15a8a7b4f2defe59aedfb90b51f8be703691e4a463a631a39df8a886"}
Sep 19 11:35:39.190628 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:39.190595    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f88c8459-nph4f"]
Sep 19 11:35:40.162776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:40.162742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2" event={"ID":"e81463f6-cfc7-4a8b-ac19-da3840fe3353","Type":"ContainerStarted","Data":"34f9d2793e3debda2bc71788c5deb01cc10a9a47237e28fead0445ec9afaa406"}
Sep 19 11:35:40.162964 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:40.162936    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:40.167961 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:40.167942    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2"
Sep 19 11:35:40.176842 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:40.176802    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-2j9v2" podStartSLOduration=1.327408943 podStartE2EDuration="6.176789315s" totalImagesPullingTime="4.849380372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:40.17652849 +0000 UTC m=+111.193565202" watchObservedRunningTime="2026-09-19 11:35:40.176789315 +0000 UTC m=+111.193826030"
Sep 19 11:35:41.167631 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:41.167600    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce" exitCode=0
Sep 19 11:35:41.168044 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:41.167683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"}
Sep 19 11:35:41.169365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:41.169334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f88c8459-nph4f" event={"ID":"e1800f23-ca47-4828-9408-0adbf51b2273","Type":"ContainerStarted","Data":"25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0"}
Sep 19 11:35:41.208576 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:41.208532    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f88c8459-nph4f" podStartSLOduration=1.678608213 podStartE2EDuration="7.208519021s" totalImagesPullingTime="5.529910808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:41.207509221 +0000 UTC m=+112.224545929" watchObservedRunningTime="2026-09-19 11:35:41.208519021 +0000 UTC m=+112.225555731"
Sep 19 11:35:44.418711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:44.418678    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:35:45.185910 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:45.185880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"}
Sep 19 11:35:45.186111 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:45.185962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"}
Sep 19 11:35:48.201582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:48.201545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"}
Sep 19 11:35:48.201969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:48.201640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"}
Sep 19 11:35:48.201969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:48.201678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"}
Sep 19 11:35:48.201969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:48.201701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerStarted","Data":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"}
Sep 19 11:35:48.229327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:48.229264    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.303232034 podStartE2EDuration="13.22922378s" totalImagesPullingTime="9.90634298s" totalInitContainerRuntime="19.648766ms" isStatefulPod=false podCreationTimestamp="2026-09-19 11:35:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:35:48.228260394 +0000 UTC m=+119.245297105" watchObservedRunningTime="2026-09-19 11:35:48.22922378 +0000 UTC m=+119.246260493"
Sep 19 11:35:48.592516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:48.592483    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm742_b431d345-caad-4147-9cba-91d0759b5330/serve-healthcheck-canary/0.log"
Sep 19 11:35:50.806258 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:35:50.806223    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:06.188247 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:06.188190    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8f88c8459-nph4f" podUID="e1800f23-ca47-4828-9408-0adbf51b2273" containerName="console" containerID="cri-o://25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0" gracePeriod=15
Sep 19 11:36:06.919065 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:06.919041    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:36:07.043623 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043578    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-service-ca\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.043623 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043630    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-oauth-serving-cert\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.043867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-serving-cert\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.043867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043688    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-oauth-config\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.043867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043734    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-trusted-ca-bundle\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.043867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043759    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-console-config\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.043867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.043798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5blz\" (UniqueName: \"kubernetes.io/projected/e1800f23-ca47-4828-9408-0adbf51b2273-kube-api-access-x5blz\") pod \"e1800f23-ca47-4828-9408-0adbf51b2273\" (UID: \"e1800f23-ca47-4828-9408-0adbf51b2273\") "
Sep 19 11:36:07.044199 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.044160    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:07.046009 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.045966    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:07.046143 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.046113    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:07.046207 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.046120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-console-config" (OuterVolumeSpecName: "console-config") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:07.046264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.046240    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1800f23-ca47-4828-9408-0adbf51b2273-kube-api-access-x5blz" (OuterVolumeSpecName: "kube-api-access-x5blz") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "kube-api-access-x5blz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:36:07.046300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.046263    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:07.046300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.046280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1800f23-ca47-4828-9408-0adbf51b2273" (UID: "e1800f23-ca47-4828-9408-0adbf51b2273"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144795    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5blz\" (UniqueName: \"kubernetes.io/projected/e1800f23-ca47-4828-9408-0adbf51b2273-kube-api-access-x5blz\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144829    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144840    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-oauth-serving-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144849    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-serving-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144858    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1800f23-ca47-4828-9408-0adbf51b2273-console-oauth-config\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144867    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-trusted-ca-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.144880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.144876    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1800f23-ca47-4828-9408-0adbf51b2273-console-config\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:07.273662 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.273631    2582 generic.go:356] "Generic (PLEG): container finished" podID="e1800f23-ca47-4828-9408-0adbf51b2273" containerID="25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0" exitCode=0
Sep 19 11:36:07.274090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.273678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f88c8459-nph4f" event={"ID":"e1800f23-ca47-4828-9408-0adbf51b2273","Type":"ContainerDied","Data":"25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0"}
Sep 19 11:36:07.274090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.273686    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f88c8459-nph4f"
Sep 19 11:36:07.274090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.273737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f88c8459-nph4f" event={"ID":"e1800f23-ca47-4828-9408-0adbf51b2273","Type":"ContainerDied","Data":"79f45fc6a7de30df067e623128fa0786b6052b1feace690333a2b09df867d57b"}
Sep 19 11:36:07.274090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.273757    2582 scope.go:117] "RemoveContainer" containerID="25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0"
Sep 19 11:36:07.282258 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.282240    2582 scope.go:117] "RemoveContainer" containerID="25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0"
Sep 19 11:36:07.282593 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:07.282567    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0\": container with ID starting with 25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0 not found: ID does not exist" containerID="25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0"
Sep 19 11:36:07.282680 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.282599    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0"} err="failed to get container status \"25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0\": rpc error: code = NotFound desc = could not find container \"25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0\": container with ID starting with 25359b38f9af64c2c240f5691e809943d8c539ddcd031f61a9db7b6855871cb0 not found: ID does not exist"
Sep 19 11:36:07.294982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.294956    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f88c8459-nph4f"]
Sep 19 11:36:07.298538 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.298520    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f88c8459-nph4f"]
Sep 19 11:36:07.542277 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:07.542245    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1800f23-ca47-4828-9408-0adbf51b2273" path="/var/lib/kubelet/pods/e1800f23-ca47-4828-9408-0adbf51b2273/volumes"
Sep 19 11:36:35.807180 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:35.807141    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:35.825958 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:35.825928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:36.393405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:36.393366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:53.787635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.787594    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:36:53.788164 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.787996    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="prometheus" containerID="cri-o://3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6" gracePeriod=600
Sep 19 11:36:53.788164 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.788025    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78" gracePeriod=600
Sep 19 11:36:53.788164 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.788051    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="config-reloader" containerID="cri-o://88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a" gracePeriod=600
Sep 19 11:36:53.788164 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.788102    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-web" containerID="cri-o://41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763" gracePeriod=600
Sep 19 11:36:53.788164 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.788004    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy" containerID="cri-o://ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e" gracePeriod=600
Sep 19 11:36:53.788394 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:53.788050    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="thanos-sidecar" containerID="cri-o://4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a" gracePeriod=600
Sep 19 11:36:54.021563 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.021536    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.101122 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-metrics-client-ca\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101122 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101122 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101108    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-kube-rbac-proxy\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101122 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjjpr\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-kube-api-access-wjjpr\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101142    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-web-config\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101162    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-kubelet-serving-ca-bundle\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101179    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-serving-certs-ca-bundle\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101200    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-config\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101220    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-metrics-client-certs\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-2\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101261    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-0\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-tls\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101324    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-tls-assets\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-thanos-prometheus-http-client-file\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101358    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-1\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101377    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-config-out\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.101422 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101400    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.102113 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-trusted-ca-bundle\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.102113 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.102113 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.101823    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.103174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.102769    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.103174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.102872    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.103556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103532    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-db\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.103650 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103582    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-grpc-tls\") pod \"0e039c34-2db3-478c-b593-79f201cb3ae1\" (UID: \"0e039c34-2db3-478c-b593-79f201cb3ae1\") "
Sep 19 11:36:54.103868 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103841    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.103868 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103847    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.104023 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103876    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-metrics-client-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.104023 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103892    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.104023 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.103907    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.104537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.104508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.104837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.104810    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.104940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.104890    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-kube-api-access-wjjpr" (OuterVolumeSpecName: "kube-api-access-wjjpr") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "kube-api-access-wjjpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:36:54.105092 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.104974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.105178 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.105148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:36:54.106234 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.106204    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:36:54.106324 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.106257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.106514 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.106477    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:36:54.106855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.106825    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.106960 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.106835    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.107130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.107111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-config" (OuterVolumeSpecName: "config") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.107194 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.107170    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.107696 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.107680    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-config-out" (OuterVolumeSpecName: "config-out") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:36:54.108256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.108235    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.115015 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.114993    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-web-config" (OuterVolumeSpecName: "web-config") pod "0e039c34-2db3-478c-b593-79f201cb3ae1" (UID: "0e039c34-2db3-478c-b593-79f201cb3ae1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:36:54.204503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204451    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-db\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204497    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-grpc-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204511    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204525    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-kube-rbac-proxy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204537    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjjpr\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-kube-api-access-wjjpr\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204548    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-web-config\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204559    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-config\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204569    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-metrics-client-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204580    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204592    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204604    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204614    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e039c34-2db3-478c-b593-79f201cb3ae1-tls-assets\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204626    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204637    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e039c34-2db3-478c-b593-79f201cb3ae1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204651    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e039c34-2db3-478c-b593-79f201cb3ae1-config-out\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.204753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.204664    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e039c34-2db3-478c-b593-79f201cb3ae1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444721    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78" exitCode=0
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444746    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e" exitCode=0
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444752    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763" exitCode=0
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444758    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a" exitCode=0
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444763    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a" exitCode=0
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444769    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6" exitCode=0
Sep 19 11:36:54.444811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"}
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444864    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"}
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444933    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"}
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.444972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"}
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.445010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"}
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.445050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"}
Sep 19 11:36:54.445249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.445089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e039c34-2db3-478c-b593-79f201cb3ae1","Type":"ContainerDied","Data":"612a4c1a15a8a7b4f2defe59aedfb90b51f8be703691e4a463a631a39df8a886"}
Sep 19 11:36:54.457007 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.456989    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.463624 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.463610    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.470311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.470291    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.470659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.470642    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:36:54.475109 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.475087    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:36:54.477484 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.477465    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.483551 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.483532    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.490152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.490135    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.496191 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.496175    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.496452 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.496434    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.496517 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.496464    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"} err="failed to get container status \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist"
Sep 19 11:36:54.496517 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.496489    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.496726 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.496709    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.496764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.496731    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"} err="failed to get container status \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist"
Sep 19 11:36:54.496764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.496745    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.497002 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.496983    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.497125 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.497009    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"} err="failed to get container status \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist"
Sep 19 11:36:54.497125 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.497029    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.497423 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.497390    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.497503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.497421    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"} err="failed to get container status \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist"
Sep 19 11:36:54.497503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.497441    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.497696 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.497680    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.497753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.497702    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"} err="failed to get container status \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist"
Sep 19 11:36:54.497753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.497720    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.498226 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.498020    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.498226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498050    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"} err="failed to get container status \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist"
Sep 19 11:36:54.498226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498071    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.498425 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:36:54.498395    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.498513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498427    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"} err="failed to get container status \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist"
Sep 19 11:36:54.498513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498442    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.498715 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498696    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"} err="failed to get container status \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist"
Sep 19 11:36:54.498781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498717    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.498781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498761    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:36:54.499014 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.498995    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"} err="failed to get container status \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist"
Sep 19 11:36:54.499091 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499016    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.499136 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499110    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-web"
Sep 19 11:36:54.499136 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499125    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-web"
Sep 19 11:36:54.499136 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499132    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499138    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499146    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-thanos"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499152    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-thanos"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499159    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1800f23-ca47-4828-9408-0adbf51b2273" containerName="console"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499163    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1800f23-ca47-4828-9408-0adbf51b2273" containerName="console"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499169    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="init-config-reloader"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499174    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="init-config-reloader"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499183    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="prometheus"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499188    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="prometheus"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499198    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="config-reloader"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499203    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="config-reloader"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499209    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="thanos-sidecar"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499213    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="thanos-sidecar"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499253    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="prometheus"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499261    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="thanos-sidecar"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499255    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"} err="failed to get container status \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist"
Sep 19 11:36:54.499279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499278    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499267    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-web"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499341    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy-thanos"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499355    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="config-reloader"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499366    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1800f23-ca47-4828-9408-0adbf51b2273" containerName="console"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499374    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" containerName="kube-rbac-proxy"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499508    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"} err="failed to get container status \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499523    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499728    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"} err="failed to get container status \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499743    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499975    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"} err="failed to get container status \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist"
Sep 19 11:36:54.500082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.499993    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.500597 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500206    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"} err="failed to get container status \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist"
Sep 19 11:36:54.500597 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500221    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.500597 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500415    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"} err="failed to get container status \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist"
Sep 19 11:36:54.500597 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500430    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.500796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500617    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"} err="failed to get container status \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist"
Sep 19 11:36:54.500796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500629    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.500870 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500811    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"} err="failed to get container status \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist"
Sep 19 11:36:54.500870 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.500824    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.501059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501043    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"} err="failed to get container status \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist"
Sep 19 11:36:54.501096 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501059    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.501236 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501220    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"} err="failed to get container status \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist"
Sep 19 11:36:54.501270 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501237    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.501433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501419    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"} err="failed to get container status \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist"
Sep 19 11:36:54.501472 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501435    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.501626 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501610    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"} err="failed to get container status \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist"
Sep 19 11:36:54.501663 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501626    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.501819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501800    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"} err="failed to get container status \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist"
Sep 19 11:36:54.501819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.501817    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.502052 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502034    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"} err="failed to get container status \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist"
Sep 19 11:36:54.502052 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502051    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.502299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502278    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"} err="failed to get container status \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist"
Sep 19 11:36:54.502299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502298    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.502505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502489    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"} err="failed to get container status \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist"
Sep 19 11:36:54.502505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502504    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.502718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502701    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"} err="failed to get container status \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist"
Sep 19 11:36:54.502768 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502718    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.502983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502956    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"} err="failed to get container status \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist"
Sep 19 11:36:54.503035 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.502985    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.503256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503238    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"} err="failed to get container status \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist"
Sep 19 11:36:54.503298 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503258    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.503509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503489    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"} err="failed to get container status \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist"
Sep 19 11:36:54.503509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503508    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.503738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503721    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"} err="failed to get container status \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist"
Sep 19 11:36:54.503738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503738    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.503980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503962    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"} err="failed to get container status \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist"
Sep 19 11:36:54.503980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.503980    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.504259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504239    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"} err="failed to get container status \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist"
Sep 19 11:36:54.504348 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504260    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.504553 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504526    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"} err="failed to get container status \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist"
Sep 19 11:36:54.504629 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504554    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.504842 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.504842 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504829    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"} err="failed to get container status \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist"
Sep 19 11:36:54.504992 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.504849    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.505155 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.505131    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"} err="failed to get container status \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist"
Sep 19 11:36:54.505221 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.505158    2582 scope.go:117] "RemoveContainer" containerID="9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"
Sep 19 11:36:54.505529 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.505485    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78"} err="failed to get container status \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": rpc error: code = NotFound desc = could not find container \"9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78\": container with ID starting with 9b6c0ae1ebf111e83e10142d7dfa987a05e560acaeab81c7b523087a2e8dbe78 not found: ID does not exist"
Sep 19 11:36:54.505529 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.505516    2582 scope.go:117] "RemoveContainer" containerID="ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"
Sep 19 11:36:54.505812 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.505793    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e"} err="failed to get container status \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": rpc error: code = NotFound desc = could not find container \"ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e\": container with ID starting with ff5f39643f5b00f07a684f7fbf23d69ddb035a974221a6ba6ffb768afb8f9c0e not found: ID does not exist"
Sep 19 11:36:54.505869 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.505812    2582 scope.go:117] "RemoveContainer" containerID="41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"
Sep 19 11:36:54.506089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506070    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763"} err="failed to get container status \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": rpc error: code = NotFound desc = could not find container \"41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763\": container with ID starting with 41f44fb1da10b84487c872d7f9fec111fe57045c4faa36dfa9b714e4e0d8a763 not found: ID does not exist"
Sep 19 11:36:54.506174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506090    2582 scope.go:117] "RemoveContainer" containerID="4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"
Sep 19 11:36:54.506372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506347    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a"} err="failed to get container status \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": rpc error: code = NotFound desc = could not find container \"4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a\": container with ID starting with 4e4d72bb2865dc37e8dc66d3838abfdd9e06b75a663293ac3ee98404d4e9dc1a not found: ID does not exist"
Sep 19 11:36:54.506372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506371    2582 scope.go:117] "RemoveContainer" containerID="88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"
Sep 19 11:36:54.506647 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506628    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a"} err="failed to get container status \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": rpc error: code = NotFound desc = could not find container \"88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a\": container with ID starting with 88d7c2392133cd4bf6f689e23d2320f28ebb6914c6e2fc2ba01738511ec8d53a not found: ID does not exist"
Sep 19 11:36:54.506717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506648    2582 scope.go:117] "RemoveContainer" containerID="3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"
Sep 19 11:36:54.506909 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506886    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6"} err="failed to get container status \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": rpc error: code = NotFound desc = could not find container \"3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6\": container with ID starting with 3b65c29e286bed004a04735518a1df05f72747584065a2301eb116f3e2eb83c6 not found: ID does not exist"
Sep 19 11:36:54.506984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.506932    2582 scope.go:117] "RemoveContainer" containerID="33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"
Sep 19 11:36:54.507116 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507103    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 11:36:54.507171 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507136    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 11:36:54.507306 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507280    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 11:36:54.507386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q8rcj\""
Sep 19 11:36:54.507386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507315    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce"} err="failed to get container status \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": rpc error: code = NotFound desc = could not find container \"33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce\": container with ID starting with 33d6ed2221cac8543d5fd8cb7f35e2a92983ab81ba021c174fdf2eae31e149ce not found: ID does not exist"
Sep 19 11:36:54.507493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 11:36:54.507902 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9359dm3p2ll30\""
Sep 19 11:36:54.507993 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.507891    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 11:36:54.508046 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.508007    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 11:36:54.508173 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.508148    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 11:36:54.508273 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.508256    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 11:36:54.508418 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.508404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 11:36:54.508789 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.508755    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 11:36:54.509328 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.509306    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 11:36:54.509400 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.509357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 11:36:54.509400 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.509391    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 11:36:54.511506 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.511465    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 11:36:54.513402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.513384    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 11:36:54.518665 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.518646    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:36:54.607574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-web-config\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90e50c8-4307-486d-a2c8-335f2306c45b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607818 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607818 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607887 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.607887 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.607962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-config\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90e50c8-4307-486d-a2c8-335f2306c45b-config-out\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608333 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjsqc\" (UniqueName: \"kubernetes.io/projected/e90e50c8-4307-486d-a2c8-335f2306c45b-kube-api-access-tjsqc\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.608333 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.608251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-web-config\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90e50c8-4307-486d-a2c8-335f2306c45b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-config\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90e50c8-4307-486d-a2c8-335f2306c45b-config-out\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjsqc\" (UniqueName: \"kubernetes.io/projected/e90e50c8-4307-486d-a2c8-335f2306c45b-kube-api-access-tjsqc\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.709983 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.709864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.710264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.710009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.710372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.710344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.711354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.710373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.711354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.710943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.711354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.711031    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.711354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.711082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.712253 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.712228    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.712411 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.712231    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e90e50c8-4307-486d-a2c8-335f2306c45b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.712649 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.712602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-web-config\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.713597 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.713571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714133 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-config\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714217 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714217 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714159    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714331 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e90e50c8-4307-486d-a2c8-335f2306c45b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714569 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.714886 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.714866    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e90e50c8-4307-486d-a2c8-335f2306c45b-config-out\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.715267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.715251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.715638 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.715621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90e50c8-4307-486d-a2c8-335f2306c45b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.718737 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.718721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjsqc\" (UniqueName: \"kubernetes.io/projected/e90e50c8-4307-486d-a2c8-335f2306c45b-kube-api-access-tjsqc\") pod \"prometheus-k8s-0\" (UID: \"e90e50c8-4307-486d-a2c8-335f2306c45b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:54.814738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:54.814714    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:36:55.090889 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:55.090848    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 11:36:55.093682 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:36:55.093656    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90e50c8_4307_486d_a2c8_335f2306c45b.slice/crio-2a4d77fd23afd6c4c9abe5da00019282e9c02b622650e179e2d61897b3306997 WatchSource:0}: Error finding container 2a4d77fd23afd6c4c9abe5da00019282e9c02b622650e179e2d61897b3306997: Status 404 returned error can't find the container with id 2a4d77fd23afd6c4c9abe5da00019282e9c02b622650e179e2d61897b3306997
Sep 19 11:36:55.450742 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:55.450652    2582 generic.go:356] "Generic (PLEG): container finished" podID="e90e50c8-4307-486d-a2c8-335f2306c45b" containerID="d22c971b223bf7526117a5a6d145a73f989209b98c343639a2d0f0e8c0802b0d" exitCode=0
Sep 19 11:36:55.450742 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:55.450696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerDied","Data":"d22c971b223bf7526117a5a6d145a73f989209b98c343639a2d0f0e8c0802b0d"}
Sep 19 11:36:55.450940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:55.450762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"2a4d77fd23afd6c4c9abe5da00019282e9c02b622650e179e2d61897b3306997"}
Sep 19 11:36:55.544146 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:55.544109    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e039c34-2db3-478c-b593-79f201cb3ae1" path="/var/lib/kubelet/pods/0e039c34-2db3-478c-b593-79f201cb3ae1/volumes"
Sep 19 11:36:56.457701 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.457665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"f00cdae387668cae6c0b208eb73c026dd301c8c463485a6dbf22f8c251be2831"}
Sep 19 11:36:56.458073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.457731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"4a1e343e4e24fbff85985d902d2d60115d5e023656255347c2c2522adaee3f44"}
Sep 19 11:36:56.458073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.457763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"192a01a586f715fa1c31e2da3c73741ec517663adbca89f67a1dfe7700c852ad"}
Sep 19 11:36:56.458073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.457797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"f915ab9e7847e93596a3509911bcfa0fb96e84993b60ba44fefbcccd7f312a18"}
Sep 19 11:36:56.458073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.457828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"1d0b5525ce52504314a7dd2094bb7add968d768b5f93ae8203350bd20943dd44"}
Sep 19 11:36:56.458073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.457886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e90e50c8-4307-486d-a2c8-335f2306c45b","Type":"ContainerStarted","Data":"7d6c16d7e37435d702bc6a4900e22f0969352a6c95e6badaf62b90decc03d606"}
Sep 19 11:36:56.485292 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:56.485032    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.465706462 podStartE2EDuration="2.485001993s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.295531ms" isStatefulPod=false podCreationTimestamp="2026-09-19 11:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:36:56.483485338 +0000 UTC m=+187.500522075" watchObservedRunningTime="2026-09-19 11:36:56.485001993 +0000 UTC m=+187.502038706"
Sep 19 11:36:59.814804 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:36:59.814773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:37:50.993542 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:50.993502    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"]
Sep 19 11:37:50.998271 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:50.998248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.000421 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.000380    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f9x6f\""
Sep 19 11:37:51.000629 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.000613    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 11:37:51.001359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.001339    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 11:37:51.003460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.003440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"]
Sep 19 11:37:51.118447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.118421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.118579 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.118465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.118579 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.118501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbt7z\" (UniqueName: \"kubernetes.io/projected/6efc025c-a585-4c91-a67d-afbc212bca7e-kube-api-access-hbt7z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.219793 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.219762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbt7z\" (UniqueName: \"kubernetes.io/projected/6efc025c-a585-4c91-a67d-afbc212bca7e-kube-api-access-hbt7z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.219954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.219800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.219954 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.219934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.220134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.220119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.220225 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.220209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.227129 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.227107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbt7z\" (UniqueName: \"kubernetes.io/projected/6efc025c-a585-4c91-a67d-afbc212bca7e-kube-api-access-hbt7z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.308762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.308714    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:37:51.576192 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.576171    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"]
Sep 19 11:37:51.578020 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:37:51.577987    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efc025c_a585_4c91_a67d_afbc212bca7e.slice/crio-592912a981f9262672ee31bb8e87c697aaaa160281b82f5687bd4d61575cc691 WatchSource:0}: Error finding container 592912a981f9262672ee31bb8e87c697aaaa160281b82f5687bd4d61575cc691: Status 404 returned error can't find the container with id 592912a981f9262672ee31bb8e87c697aaaa160281b82f5687bd4d61575cc691
Sep 19 11:37:51.649693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:51.649662    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng" event={"ID":"6efc025c-a585-4c91-a67d-afbc212bca7e","Type":"ContainerStarted","Data":"592912a981f9262672ee31bb8e87c697aaaa160281b82f5687bd4d61575cc691"}
Sep 19 11:37:53.866173 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.866137    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"]
Sep 19 11:37:53.869949 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.869925    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.872480 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.872454    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 11:37:53.872784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.872624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 11:37:53.872784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.872670    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 11:37:53.872784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.872696    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6mzxt\""
Sep 19 11:37:53.882072 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.882051    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"]
Sep 19 11:37:53.928540 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.928512    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"]
Sep 19 11:37:53.932555 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.932434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:53.935359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.935337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-l2rzk\""
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98f45e35-42ae-4235-b45d-bba2360e9411-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m65vd\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-kube-api-access-m65vd\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98f45e35-42ae-4235-b45d-bba2360e9411-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.943720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.943568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:53.946970 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:53.946884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"]
Sep 19 11:37:54.044417 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.044592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.044592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.044592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98f45e35-42ae-4235-b45d-bba2360e9411-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.044757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m65vd\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-kube-api-access-m65vd\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.044757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9940cc-a722-4314-8e75-51e02ac4ab93-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.044757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-kube-api-access-qf8ds\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.044757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.044757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045038 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.045038 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045038 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98f45e35-42ae-4235-b45d-bba2360e9411-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045038 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-data\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045038 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.044870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.045286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-certs\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045406    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-credential-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98f45e35-42ae-4235-b45d-bba2360e9411-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.045786 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.045654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.046215 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.046026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-socket\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.047995 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.047951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-envoy\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.048516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.048496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98f45e35-42ae-4235-b45d-bba2360e9411-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.053378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.053349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-istio-token\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.053727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.053702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m65vd\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-kube-api-access-m65vd\") pod \"maas-default-gateway-openshift-default-6fdcb54cb8-ls84r\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.093370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.093339    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"]
Sep 19 11:37:54.098238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.098215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.108321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.108293    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"]
Sep 19 11:37:54.146644 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.146644 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.146875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.146875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a847a4ee-b18e-4756-a13f-68a562d26842-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.146875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.146875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.146875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.146875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a847a4ee-b18e-4756-a13f-68a562d26842-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.146984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a847a4ee-b18e-4756-a13f-68a562d26842-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97tr\" (UniqueName: \"kubernetes.io/projected/a847a4ee-b18e-4756-a13f-68a562d26842-kube-api-access-x97tr\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147100    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.147605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9940cc-a722-4314-8e75-51e02ac4ab93-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.147862 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.147635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-kube-api-access-qf8ds\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.148249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.148227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9940cc-a722-4314-8e75-51e02ac4ab93-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.150111 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.150084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.150232 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.150106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.155346 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.155306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-kube-api-access-qf8ds\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.155457 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.155420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.184214 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.184185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:37:54.248905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.248854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a847a4ee-b18e-4756-a13f-68a562d26842-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.248905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.248895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.248946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.248974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a847a4ee-b18e-4756-a13f-68a562d26842-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:37:54.249071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a847a4ee-b18e-4756-a13f-68a562d26842-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97tr\" (UniqueName: \"kubernetes.io/projected/a847a4ee-b18e-4756-a13f-68a562d26842-kube-api-access-x97tr\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249361 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249361 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.249827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.249538    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.250332 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.250165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.250332 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.250274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a847a4ee-b18e-4756-a13f-68a562d26842-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.250745 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.250704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.252789 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.252739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a847a4ee-b18e-4756-a13f-68a562d26842-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.255472 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.255427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a847a4ee-b18e-4756-a13f-68a562d26842-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.261711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.261512    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97tr\" (UniqueName: \"kubernetes.io/projected/a847a4ee-b18e-4756-a13f-68a562d26842-kube-api-access-x97tr\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.264659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.264616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a847a4ee-b18e-4756-a13f-68a562d26842-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h\" (UID: \"a847a4ee-b18e-4756-a13f-68a562d26842\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.410433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.410358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:37:54.462089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.462058    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"]
Sep 19 11:37:54.466632 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.465991    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.471673 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.471591    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"]
Sep 19 11:37:54.476397 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.476376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"]
Sep 19 11:37:54.537627 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.537601    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"]
Sep 19 11:37:54.539965 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:37:54.539938    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9940cc_a722_4314_8e75_51e02ac4ab93.slice/crio-e570bea43e14be12d68f95a355786db4276dfc4d773cb3b955e6276f0c153052 WatchSource:0}: Error finding container e570bea43e14be12d68f95a355786db4276dfc4d773cb3b955e6276f0c153052: Status 404 returned error can't find the container with id e570bea43e14be12d68f95a355786db4276dfc4d773cb3b955e6276f0c153052
Sep 19 11:37:54.552047 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552143 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552143 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552251 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552251 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stx5q\" (UniqueName: \"kubernetes.io/projected/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-kube-api-access-stx5q\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552410 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.552410 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.552371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653154 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stx5q\" (UniqueName: \"kubernetes.io/projected/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-kube-api-access-stx5q\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653595 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653595 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653595 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653595 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653819    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.653896 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.653824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.654070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.654045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.654579 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.654559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.656628 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.656605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.657402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.657382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.662940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.662840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stx5q\" (UniqueName: \"kubernetes.io/projected/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-kube-api-access-stx5q\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.663089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.662994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c535113-61e5-4185-9cbe-d9c7aaa6ccd7-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fww29\" (UID: \"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.663436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.663386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" event={"ID":"8e9940cc-a722-4314-8e75-51e02ac4ab93","Type":"ContainerStarted","Data":"e570bea43e14be12d68f95a355786db4276dfc4d773cb3b955e6276f0c153052"}
Sep 19 11:37:54.664822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.664797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" event={"ID":"98f45e35-42ae-4235-b45d-bba2360e9411","Type":"ContainerStarted","Data":"be49fc4dd29783582b6ee4529b15c152e6936528fdf41f03ca495d2389b71701"}
Sep 19 11:37:54.691762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.691741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"]
Sep 19 11:37:54.693845 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:37:54.693822    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda847a4ee_b18e_4756_a13f_68a562d26842.slice/crio-d3ca838aafd7be5bd79a7dfc3f9dc31e9c3f291f56345eb699adf55b1b6c1e5f WatchSource:0}: Error finding container d3ca838aafd7be5bd79a7dfc3f9dc31e9c3f291f56345eb699adf55b1b6c1e5f: Status 404 returned error can't find the container with id d3ca838aafd7be5bd79a7dfc3f9dc31e9c3f291f56345eb699adf55b1b6c1e5f
Sep 19 11:37:54.787430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.787385    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:37:54.815833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.815800    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:37:54.833270 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:54.833245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:37:55.419691 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.419658    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"]
Sep 19 11:37:55.425878 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.425846    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.431087 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.431059    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"]
Sep 19 11:37:55.461139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.461115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m52s\" (UniqueName: \"kubernetes.io/projected/1ed6b551-2526-4c5b-ad68-5e27605b4912-kube-api-access-2m52s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.461261 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.461221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.461312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.461271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.562596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.562554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m52s\" (UniqueName: \"kubernetes.io/projected/1ed6b551-2526-4c5b-ad68-5e27605b4912-kube-api-access-2m52s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.562781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.562638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.562781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.562689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.563129 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.563095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.563244 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.563134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.570701 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.570672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m52s\" (UniqueName: \"kubernetes.io/projected/1ed6b551-2526-4c5b-ad68-5e27605b4912-kube-api-access-2m52s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.612612 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.612583    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"]
Sep 19 11:37:55.616484 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.616463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.623905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.623882    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"]
Sep 19 11:37:55.663843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.663810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.664011 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.663864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm2zk\" (UniqueName: \"kubernetes.io/projected/e6430451-baa7-4735-934b-a136e028984e-kube-api-access-sm2zk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.664077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.664008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.670937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.670854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h" event={"ID":"a847a4ee-b18e-4756-a13f-68a562d26842","Type":"ContainerStarted","Data":"d3ca838aafd7be5bd79a7dfc3f9dc31e9c3f291f56345eb699adf55b1b6c1e5f"}
Sep 19 11:37:55.687883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.687858    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 11:37:55.711486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.711460    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"]
Sep 19 11:37:55.715515 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.715429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.724013 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.723992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"]
Sep 19 11:37:55.738058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.737949    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:37:55.765533 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.765669 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm2zk\" (UniqueName: \"kubernetes.io/projected/e6430451-baa7-4735-934b-a136e028984e-kube-api-access-sm2zk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.765818 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6svc\" (UniqueName: \"kubernetes.io/projected/3866536c-8e39-4345-aff3-bdab7ff91fd1-kube-api-access-q6svc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.765818 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.765946 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.766008 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.766659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.765990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.766659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.766532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.774181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.774156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm2zk\" (UniqueName: \"kubernetes.io/projected/e6430451-baa7-4735-934b-a136e028984e-kube-api-access-sm2zk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:55.867523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.867494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.867668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.867612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6svc\" (UniqueName: \"kubernetes.io/projected/3866536c-8e39-4345-aff3-bdab7ff91fd1-kube-api-access-q6svc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.867668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.867643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.867993 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.867948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.867993 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.867991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.876568 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.876541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6svc\" (UniqueName: \"kubernetes.io/projected/3866536c-8e39-4345-aff3-bdab7ff91fd1-kube-api-access-q6svc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:55.928409 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:55.928335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:37:56.029447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:56.029403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:37:56.944731 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:56.944697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"]
Sep 19 11:37:56.946896 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:37:56.946625    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed6b551_2526_4c5b_ad68_5e27605b4912.slice/crio-80a334bdf66eec9e3b35236022567d395f92610ce7a83b3172969ab6f30a4bbb WatchSource:0}: Error finding container 80a334bdf66eec9e3b35236022567d395f92610ce7a83b3172969ab6f30a4bbb: Status 404 returned error can't find the container with id 80a334bdf66eec9e3b35236022567d395f92610ce7a83b3172969ab6f30a4bbb
Sep 19 11:37:56.947866 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:56.947807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"]
Sep 19 11:37:56.948824 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:37:56.948795    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3866536c_8e39_4345_aff3_bdab7ff91fd1.slice/crio-ee3620cc4d03b651ddc75f267e977d5ee449fa9bb25d0718c67631da85a992e8 WatchSource:0}: Error finding container ee3620cc4d03b651ddc75f267e977d5ee449fa9bb25d0718c67631da85a992e8: Status 404 returned error can't find the container with id ee3620cc4d03b651ddc75f267e977d5ee449fa9bb25d0718c67631da85a992e8
Sep 19 11:37:56.950991 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:56.950972    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"]
Sep 19 11:37:56.955188 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:56.955159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"]
Sep 19 11:37:57.687947 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.687367    2582 generic.go:356] "Generic (PLEG): container finished" podID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerID="31e90895246e1dfc030fcdfecc10136442e40aff80337acb919c6f142b60510d" exitCode=0
Sep 19 11:37:57.687947 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.687465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng" event={"ID":"6efc025c-a585-4c91-a67d-afbc212bca7e","Type":"ContainerDied","Data":"31e90895246e1dfc030fcdfecc10136442e40aff80337acb919c6f142b60510d"}
Sep 19 11:37:57.692543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.691875    2582 generic.go:356] "Generic (PLEG): container finished" podID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerID="e78a849600616639dc93f8b681950d40c558b32c967c0b7ab8edb267a5d02870" exitCode=0
Sep 19 11:37:57.692543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.692036    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" event={"ID":"1ed6b551-2526-4c5b-ad68-5e27605b4912","Type":"ContainerDied","Data":"e78a849600616639dc93f8b681950d40c558b32c967c0b7ab8edb267a5d02870"}
Sep 19 11:37:57.692543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.692090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" event={"ID":"1ed6b551-2526-4c5b-ad68-5e27605b4912","Type":"ContainerStarted","Data":"80a334bdf66eec9e3b35236022567d395f92610ce7a83b3172969ab6f30a4bbb"}
Sep 19 11:37:57.695705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.695531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" event={"ID":"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7","Type":"ContainerStarted","Data":"2ef10a311a2fc3918a6678892ef64558f9c8d08cdd1eae8dd8fc3eb79c407ed0"}
Sep 19 11:37:57.699106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.698473    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6430451-baa7-4735-934b-a136e028984e" containerID="1c052c9786ca1f6b9386672ca6577a0cbf258b9e6df1532b024e4aa9e5cff2c8" exitCode=0
Sep 19 11:37:57.699106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.698540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq" event={"ID":"e6430451-baa7-4735-934b-a136e028984e","Type":"ContainerDied","Data":"1c052c9786ca1f6b9386672ca6577a0cbf258b9e6df1532b024e4aa9e5cff2c8"}
Sep 19 11:37:57.699106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.698572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq" event={"ID":"e6430451-baa7-4735-934b-a136e028984e","Type":"ContainerStarted","Data":"7aa6476f5ed99c5c1ac818b322b5dda00540f18f5b2ce66ea41a0fff9e4d89fe"}
Sep 19 11:37:57.701945 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.701847    2582 generic.go:356] "Generic (PLEG): container finished" podID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerID="f2cf7e4c5ab3efb522f2d1806e1622ae3d29d9cff6a69514b9c9dce6b2205895" exitCode=0
Sep 19 11:37:57.705018 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.702088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf" event={"ID":"3866536c-8e39-4345-aff3-bdab7ff91fd1","Type":"ContainerDied","Data":"f2cf7e4c5ab3efb522f2d1806e1622ae3d29d9cff6a69514b9c9dce6b2205895"}
Sep 19 11:37:57.705018 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:57.702135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf" event={"ID":"3866536c-8e39-4345-aff3-bdab7ff91fd1","Type":"ContainerStarted","Data":"ee3620cc4d03b651ddc75f267e977d5ee449fa9bb25d0718c67631da85a992e8"}
Sep 19 11:37:59.541156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.541115    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.541499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.541204    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.541499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.541244    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.549893 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.549866    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.549988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.549944    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.550028 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.549989    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.610066 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.610038    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.610174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.610067    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.610174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.610102    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.610174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.610136    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.610174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.610138    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.610383 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.610203    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:37:59.718355 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.718120    2582 generic.go:356] "Generic (PLEG): container finished" podID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerID="722775eae25f4c46685fe95c4ee104ea6fd1780d23d484f35d575ca2d3ae40de" exitCode=0
Sep 19 11:37:59.718355 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:37:59.718201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" event={"ID":"1ed6b551-2526-4c5b-ad68-5e27605b4912","Type":"ContainerDied","Data":"722775eae25f4c46685fe95c4ee104ea6fd1780d23d484f35d575ca2d3ae40de"}
Sep 19 11:38:00.726759 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.726646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" event={"ID":"8e9940cc-a722-4314-8e75-51e02ac4ab93","Type":"ContainerStarted","Data":"3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c"}
Sep 19 11:38:00.728979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.728949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" event={"ID":"98f45e35-42ae-4235-b45d-bba2360e9411","Type":"ContainerStarted","Data":"f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f"}
Sep 19 11:38:00.731061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.731025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h" event={"ID":"a847a4ee-b18e-4756-a13f-68a562d26842","Type":"ContainerStarted","Data":"ef7c0718da31bcffe8b2efed582dbbfb3f34e987eb6e817ea428c177ddd761f8"}
Sep 19 11:38:00.733492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.733469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" event={"ID":"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7","Type":"ContainerStarted","Data":"7d6388ecebedd749798e6f94f1928dec9cd40b3694f6f0ed810b62528c65d3ff"}
Sep 19 11:38:00.736126 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.736099    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6430451-baa7-4735-934b-a136e028984e" containerID="084df112adc35502c47bf018a2b0726c2fca3ffcace015ea9bff1e0cea4f90ce" exitCode=0
Sep 19 11:38:00.736244 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.736189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq" event={"ID":"e6430451-baa7-4735-934b-a136e028984e","Type":"ContainerDied","Data":"084df112adc35502c47bf018a2b0726c2fca3ffcace015ea9bff1e0cea4f90ce"}
Sep 19 11:38:00.738737 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.738712    2582 generic.go:356] "Generic (PLEG): container finished" podID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerID="d3ff2c6bf7e376bac6931f8e546428bb11da0dfe9ec1e384c760be69c64cd700" exitCode=0
Sep 19 11:38:00.738873 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.738762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf" event={"ID":"3866536c-8e39-4345-aff3-bdab7ff91fd1","Type":"ContainerDied","Data":"d3ff2c6bf7e376bac6931f8e546428bb11da0dfe9ec1e384c760be69c64cd700"}
Sep 19 11:38:00.746620 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.746574    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" podStartSLOduration=2.679386201 podStartE2EDuration="7.746557816s" totalImagesPullingTime="5.067171615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:00.745662328 +0000 UTC m=+251.762699041" watchObservedRunningTime="2026-09-19 11:38:00.746557816 +0000 UTC m=+251.763594528"
Sep 19 11:38:00.764377 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.764322    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podStartSLOduration=4.180313843 podStartE2EDuration="6.764304664s" totalImagesPullingTime="2.583990821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:00.763418031 +0000 UTC m=+251.780454754" watchObservedRunningTime="2026-09-19 11:38:00.764304664 +0000 UTC m=+251.781341375"
Sep 19 11:38:00.787855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.787822    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:38:00.794280 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.794248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:38:00.799346 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.799294    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" podStartSLOduration=2.744421893 podStartE2EDuration="7.79927344s" totalImagesPullingTime="5.054851547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:00.797403057 +0000 UTC m=+251.814439769" watchObservedRunningTime="2026-09-19 11:38:00.79927344 +0000 UTC m=+251.816310153"
Sep 19 11:38:00.820776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:00.820690    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h" podStartSLOduration=1.9069133040000001 podStartE2EDuration="6.820669661s" totalImagesPullingTime="4.913756357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:00.818613326 +0000 UTC m=+251.835650038" watchObservedRunningTime="2026-09-19 11:38:00.820669661 +0000 UTC m=+251.837706373"
Sep 19 11:38:01.185401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.185297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:38:01.187378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.187348    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Sep 19 11:38:01.187543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.187413    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Sep 19 11:38:01.250651 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.250616    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:38:01.252452 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.252420    2582 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Sep 19 11:38:01.252576 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.252476    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Sep 19 11:38:01.411551 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.411515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:38:01.417391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.417366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:38:01.748397 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.748367    2582 generic.go:356] "Generic (PLEG): container finished" podID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerID="e7bb35097195d07cf6efab255e9b88351c140e9bfb45a11bc693c0b6ca5c8670" exitCode=0
Sep 19 11:38:01.750016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.749851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng" event={"ID":"6efc025c-a585-4c91-a67d-afbc212bca7e","Type":"ContainerDied","Data":"e7bb35097195d07cf6efab255e9b88351c140e9bfb45a11bc693c0b6ca5c8670"}
Sep 19 11:38:01.750016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.749944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:38:01.750016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.749976    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:38:01.751027 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.750997    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h"
Sep 19 11:38:01.751146 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.751060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:38:01.824517 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.823675    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"]
Sep 19 11:38:01.840022 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:01.839946    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"]
Sep 19 11:38:02.184813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:02.184716    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Sep 19 11:38:02.184813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:02.184795    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Sep 19 11:38:02.250493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:02.250456    2582 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Sep 19 11:38:02.250676 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:02.250520    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Sep 19 11:38:03.185328 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:03.185294    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Sep 19 11:38:03.185778 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:03.185362    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Sep 19 11:38:03.250321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:03.249896    2582 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Sep 19 11:38:03.250321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:03.249984    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Sep 19 11:38:03.761945 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:03.761887    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy" containerID="cri-o://f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f" gracePeriod=30
Sep 19 11:38:03.762710 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:03.762568    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy" containerID="cri-o://3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c" gracePeriod=30
Sep 19 11:38:07.789414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:07.789379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" event={"ID":"1ed6b551-2526-4c5b-ad68-5e27605b4912","Type":"ContainerStarted","Data":"316986d11be3d1617c41866ab12e20eacfcf66edc20b57ad6b550c691c649e79"}
Sep 19 11:38:07.809337 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:07.809274    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" podStartSLOduration=3.021767687 podStartE2EDuration="12.809253589s" totalImagesPullingTime="9.787485902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:37:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:07.806832791 +0000 UTC m=+258.823869523" watchObservedRunningTime="2026-09-19 11:38:07.809253589 +0000 UTC m=+258.826290300"
Sep 19 11:38:08.795613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.795581    2582 generic.go:356] "Generic (PLEG): container finished" podID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerID="89e2dcfb566e627af93451c83a5664c3bc7070d175cb88b01345bb66e7b55fad" exitCode=0
Sep 19 11:38:08.795972 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.795673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng" event={"ID":"6efc025c-a585-4c91-a67d-afbc212bca7e","Type":"ContainerDied","Data":"89e2dcfb566e627af93451c83a5664c3bc7070d175cb88b01345bb66e7b55fad"}
Sep 19 11:38:08.797740 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.797718    2582 generic.go:356] "Generic (PLEG): container finished" podID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerID="316986d11be3d1617c41866ab12e20eacfcf66edc20b57ad6b550c691c649e79" exitCode=0
Sep 19 11:38:08.797833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.797811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" event={"ID":"1ed6b551-2526-4c5b-ad68-5e27605b4912","Type":"ContainerDied","Data":"316986d11be3d1617c41866ab12e20eacfcf66edc20b57ad6b550c691c649e79"}
Sep 19 11:38:08.800083 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.800062    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6430451-baa7-4735-934b-a136e028984e" containerID="5a7d9afde1034c4b7075f5d33fb42739bfe7110c1bef77ec71db4acf22dcc1a9" exitCode=0
Sep 19 11:38:08.800200 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.800116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq" event={"ID":"e6430451-baa7-4735-934b-a136e028984e","Type":"ContainerDied","Data":"5a7d9afde1034c4b7075f5d33fb42739bfe7110c1bef77ec71db4acf22dcc1a9"}
Sep 19 11:38:08.802124 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.802104    2582 generic.go:356] "Generic (PLEG): container finished" podID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerID="2fa107cd9d99ab8081b627a174365a44273e8c402a5c3249c6c7381745997388" exitCode=0
Sep 19 11:38:08.802191 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:08.802165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf" event={"ID":"3866536c-8e39-4345-aff3-bdab7ff91fd1","Type":"ContainerDied","Data":"2fa107cd9d99ab8081b627a174365a44273e8c402a5c3249c6c7381745997388"}
Sep 19 11:38:09.029137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.029116    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:38:09.031528 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.031509    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:38:09.107255 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107223    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-kube-api-access-qf8ds\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107255 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-socket\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107276    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-certs\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-certs\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107318    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-envoy\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107349    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-credential-socket\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107365    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-token\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-socket\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107425    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9940cc-a722-4314-8e75-51e02ac4ab93-istiod-ca-cert\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107452    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-data\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107476    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-envoy\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107524    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-istio-token\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107570    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98f45e35-42ae-4235-b45d-bba2360e9411-istiod-ca-cert\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107564    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107575    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107603    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-credential-socket\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107609    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-podinfo\") pod \"8e9940cc-a722-4314-8e75-51e02ac4ab93\" (UID: \"8e9940cc-a722-4314-8e75-51e02ac4ab93\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m65vd\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-kube-api-access-m65vd\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107714    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-data\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.107837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98f45e35-42ae-4235-b45d-bba2360e9411-istio-podinfo\") pod \"98f45e35-42ae-4235-b45d-bba2360e9411\" (UID: \"98f45e35-42ae-4235-b45d-bba2360e9411\") "
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-data" (OuterVolumeSpecName: "istio-data") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.107997    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108081    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e9940cc-a722-4314-8e75-51e02ac4ab93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108216    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108237    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108253    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108267    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108281    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108291    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98f45e35-42ae-4235-b45d-bba2360e9411-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:38:09.108445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108316    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.108951 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.108521    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.110176 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.110341 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110302    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-kube-api-access-qf8ds" (OuterVolumeSpecName: "kube-api-access-qf8ds") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "kube-api-access-qf8ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:09.110446 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110406    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-istio-token" (OuterVolumeSpecName: "istio-token") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:09.110446 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110416    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.110586 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110552    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:38:09.110661 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110630    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:09.110713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98f45e35-42ae-4235-b45d-bba2360e9411-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:38:09.110785 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.110764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-kube-api-access-m65vd" (OuterVolumeSpecName: "kube-api-access-m65vd") pod "98f45e35-42ae-4235-b45d-bba2360e9411" (UID: "98f45e35-42ae-4235-b45d-bba2360e9411"). InnerVolumeSpecName "kube-api-access-m65vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:09.111191 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.111173    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e9940cc-a722-4314-8e75-51e02ac4ab93" (UID: "8e9940cc-a722-4314-8e75-51e02ac4ab93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:09.209522 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209495    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209522 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209518    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9940cc-a722-4314-8e75-51e02ac4ab93-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209522 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209527    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209535    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209543    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209550    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98f45e35-42ae-4235-b45d-bba2360e9411-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209558    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209566    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9940cc-a722-4314-8e75-51e02ac4ab93-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209574    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m65vd\" (UniqueName: \"kubernetes.io/projected/98f45e35-42ae-4235-b45d-bba2360e9411-kube-api-access-m65vd\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209582    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98f45e35-42ae-4235-b45d-bba2360e9411-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209590    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/8e9940cc-a722-4314-8e75-51e02ac4ab93-kube-api-access-qf8ds\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.209707 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.209599    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98f45e35-42ae-4235-b45d-bba2360e9411-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:09.807473 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.807396    2582 generic.go:356] "Generic (PLEG): container finished" podID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerID="3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c" exitCode=0
Sep 19 11:38:09.807473 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.807447    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"
Sep 19 11:38:09.807947 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.807486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" event={"ID":"8e9940cc-a722-4314-8e75-51e02ac4ab93","Type":"ContainerDied","Data":"3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c"}
Sep 19 11:38:09.807947 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.807537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk" event={"ID":"8e9940cc-a722-4314-8e75-51e02ac4ab93","Type":"ContainerDied","Data":"e570bea43e14be12d68f95a355786db4276dfc4d773cb3b955e6276f0c153052"}
Sep 19 11:38:09.807947 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.807560    2582 scope.go:117] "RemoveContainer" containerID="3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c"
Sep 19 11:38:09.808828 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.808803    2582 generic.go:356] "Generic (PLEG): container finished" podID="98f45e35-42ae-4235-b45d-bba2360e9411" containerID="f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f" exitCode=0
Sep 19 11:38:09.808966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.808832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" event={"ID":"98f45e35-42ae-4235-b45d-bba2360e9411","Type":"ContainerDied","Data":"f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f"}
Sep 19 11:38:09.808966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.808855    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"
Sep 19 11:38:09.808966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.808882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r" event={"ID":"98f45e35-42ae-4235-b45d-bba2360e9411","Type":"ContainerDied","Data":"be49fc4dd29783582b6ee4529b15c152e6936528fdf41f03ca495d2389b71701"}
Sep 19 11:38:09.817849 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.817827    2582 scope.go:117] "RemoveContainer" containerID="3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c"
Sep 19 11:38:09.818308 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:38:09.818270    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c\": container with ID starting with 3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c not found: ID does not exist" containerID="3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c"
Sep 19 11:38:09.818417 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.818308    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c"} err="failed to get container status \"3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c\": rpc error: code = NotFound desc = could not find container \"3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c\": container with ID starting with 3ce7bd0c9dd5200db89233360dd017e1b27abd737a92bf9b7632bf83ab212a0c not found: ID does not exist"
Sep 19 11:38:09.818417 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.818331    2582 scope.go:117] "RemoveContainer" containerID="f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f"
Sep 19 11:38:09.829339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.829282    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"]
Sep 19 11:38:09.833186 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.831967    2582 scope.go:117] "RemoveContainer" containerID="f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f"
Sep 19 11:38:09.833433 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:38:09.833355    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f\": container with ID starting with f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f not found: ID does not exist" containerID="f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f"
Sep 19 11:38:09.833433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.833396    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f"} err="failed to get container status \"f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f\": rpc error: code = NotFound desc = could not find container \"f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f\": container with ID starting with f1f795afa654cc2efde650858d23927d27c888c7a9c1385d8740d5346d6a576f not found: ID does not exist"
Sep 19 11:38:09.834656 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.834629    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7dfc59559-zxkjk"]
Sep 19 11:38:09.849432 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.847958    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"]
Sep 19 11:38:09.852124 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.852091    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6fdcb54cb8-ls84r"]
Sep 19 11:38:09.961789 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:09.961754    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:38:10.022409 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.022388    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:38:10.025412 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.025391    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:38:10.028384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.028366    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:38:10.117312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-util\") pod \"e6430451-baa7-4735-934b-a136e028984e\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") "
Sep 19 11:38:10.117312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117286    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-util\") pod \"3866536c-8e39-4345-aff3-bdab7ff91fd1\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") "
Sep 19 11:38:10.117312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-util\") pod \"1ed6b551-2526-4c5b-ad68-5e27605b4912\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") "
Sep 19 11:38:10.117546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbt7z\" (UniqueName: \"kubernetes.io/projected/6efc025c-a585-4c91-a67d-afbc212bca7e-kube-api-access-hbt7z\") pod \"6efc025c-a585-4c91-a67d-afbc212bca7e\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") "
Sep 19 11:38:10.117546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117365    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-bundle\") pod \"3866536c-8e39-4345-aff3-bdab7ff91fd1\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") "
Sep 19 11:38:10.117546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117384    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m52s\" (UniqueName: \"kubernetes.io/projected/1ed6b551-2526-4c5b-ad68-5e27605b4912-kube-api-access-2m52s\") pod \"1ed6b551-2526-4c5b-ad68-5e27605b4912\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") "
Sep 19 11:38:10.117546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117511    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-bundle\") pod \"6efc025c-a585-4c91-a67d-afbc212bca7e\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") "
Sep 19 11:38:10.117736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117587    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6svc\" (UniqueName: \"kubernetes.io/projected/3866536c-8e39-4345-aff3-bdab7ff91fd1-kube-api-access-q6svc\") pod \"3866536c-8e39-4345-aff3-bdab7ff91fd1\" (UID: \"3866536c-8e39-4345-aff3-bdab7ff91fd1\") "
Sep 19 11:38:10.117736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117621    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-bundle\") pod \"e6430451-baa7-4735-934b-a136e028984e\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") "
Sep 19 11:38:10.117736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117654    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-bundle\") pod \"1ed6b551-2526-4c5b-ad68-5e27605b4912\" (UID: \"1ed6b551-2526-4c5b-ad68-5e27605b4912\") "
Sep 19 11:38:10.117736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117708    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-util\") pod \"6efc025c-a585-4c91-a67d-afbc212bca7e\" (UID: \"6efc025c-a585-4c91-a67d-afbc212bca7e\") "
Sep 19 11:38:10.117939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.117735    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm2zk\" (UniqueName: \"kubernetes.io/projected/e6430451-baa7-4735-934b-a136e028984e-kube-api-access-sm2zk\") pod \"e6430451-baa7-4735-934b-a136e028984e\" (UID: \"e6430451-baa7-4735-934b-a136e028984e\") "
Sep 19 11:38:10.118632 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.118144    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-bundle" (OuterVolumeSpecName: "bundle") pod "3866536c-8e39-4345-aff3-bdab7ff91fd1" (UID: "3866536c-8e39-4345-aff3-bdab7ff91fd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.118759 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.118702    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-bundle" (OuterVolumeSpecName: "bundle") pod "6efc025c-a585-4c91-a67d-afbc212bca7e" (UID: "6efc025c-a585-4c91-a67d-afbc212bca7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.119292 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.119265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-bundle" (OuterVolumeSpecName: "bundle") pod "e6430451-baa7-4735-934b-a136e028984e" (UID: "e6430451-baa7-4735-934b-a136e028984e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.119371 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.119316    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-bundle" (OuterVolumeSpecName: "bundle") pod "1ed6b551-2526-4c5b-ad68-5e27605b4912" (UID: "1ed6b551-2526-4c5b-ad68-5e27605b4912"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.120163 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.120116    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed6b551-2526-4c5b-ad68-5e27605b4912-kube-api-access-2m52s" (OuterVolumeSpecName: "kube-api-access-2m52s") pod "1ed6b551-2526-4c5b-ad68-5e27605b4912" (UID: "1ed6b551-2526-4c5b-ad68-5e27605b4912"). InnerVolumeSpecName "kube-api-access-2m52s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:10.120275 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.120194    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efc025c-a585-4c91-a67d-afbc212bca7e-kube-api-access-hbt7z" (OuterVolumeSpecName: "kube-api-access-hbt7z") pod "6efc025c-a585-4c91-a67d-afbc212bca7e" (UID: "6efc025c-a585-4c91-a67d-afbc212bca7e"). InnerVolumeSpecName "kube-api-access-hbt7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:10.120333 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.120277    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6430451-baa7-4735-934b-a136e028984e-kube-api-access-sm2zk" (OuterVolumeSpecName: "kube-api-access-sm2zk") pod "e6430451-baa7-4735-934b-a136e028984e" (UID: "e6430451-baa7-4735-934b-a136e028984e"). InnerVolumeSpecName "kube-api-access-sm2zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:10.121539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.121516    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3866536c-8e39-4345-aff3-bdab7ff91fd1-kube-api-access-q6svc" (OuterVolumeSpecName: "kube-api-access-q6svc") pod "3866536c-8e39-4345-aff3-bdab7ff91fd1" (UID: "3866536c-8e39-4345-aff3-bdab7ff91fd1"). InnerVolumeSpecName "kube-api-access-q6svc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:38:10.122303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.122284    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-util" (OuterVolumeSpecName: "util") pod "3866536c-8e39-4345-aff3-bdab7ff91fd1" (UID: "3866536c-8e39-4345-aff3-bdab7ff91fd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.123785 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.123764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-util" (OuterVolumeSpecName: "util") pod "6efc025c-a585-4c91-a67d-afbc212bca7e" (UID: "6efc025c-a585-4c91-a67d-afbc212bca7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.124065 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.124043    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-util" (OuterVolumeSpecName: "util") pod "e6430451-baa7-4735-934b-a136e028984e" (UID: "e6430451-baa7-4735-934b-a136e028984e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.124126 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.124106    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-util" (OuterVolumeSpecName: "util") pod "1ed6b551-2526-4c5b-ad68-5e27605b4912" (UID: "1ed6b551-2526-4c5b-ad68-5e27605b4912"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:38:10.219084 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219061    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219084 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219082    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm2zk\" (UniqueName: \"kubernetes.io/projected/e6430451-baa7-4735-934b-a136e028984e-kube-api-access-sm2zk\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219092    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219100    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219107    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-util\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219114    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbt7z\" (UniqueName: \"kubernetes.io/projected/6efc025c-a585-4c91-a67d-afbc212bca7e-kube-api-access-hbt7z\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219122    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3866536c-8e39-4345-aff3-bdab7ff91fd1-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219130    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m52s\" (UniqueName: \"kubernetes.io/projected/1ed6b551-2526-4c5b-ad68-5e27605b4912-kube-api-access-2m52s\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219138    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6efc025c-a585-4c91-a67d-afbc212bca7e-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219146    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6svc\" (UniqueName: \"kubernetes.io/projected/3866536c-8e39-4345-aff3-bdab7ff91fd1-kube-api-access-q6svc\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219153    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6430451-baa7-4735-934b-a136e028984e-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.219206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.219161    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ed6b551-2526-4c5b-ad68-5e27605b4912-bundle\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:38:10.815373 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.815332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng" event={"ID":"6efc025c-a585-4c91-a67d-afbc212bca7e","Type":"ContainerDied","Data":"592912a981f9262672ee31bb8e87c697aaaa160281b82f5687bd4d61575cc691"}
Sep 19 11:38:10.815813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.815393    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="592912a981f9262672ee31bb8e87c697aaaa160281b82f5687bd4d61575cc691"
Sep 19 11:38:10.815813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.815343    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c62ng"
Sep 19 11:38:10.817237 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.817205    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj"
Sep 19 11:38:10.817237 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.817216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s5rfj" event={"ID":"1ed6b551-2526-4c5b-ad68-5e27605b4912","Type":"ContainerDied","Data":"80a334bdf66eec9e3b35236022567d395f92610ce7a83b3172969ab6f30a4bbb"}
Sep 19 11:38:10.817417 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.817263    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80a334bdf66eec9e3b35236022567d395f92610ce7a83b3172969ab6f30a4bbb"
Sep 19 11:38:10.819171 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.819148    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq"
Sep 19 11:38:10.819295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.819152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck52jq" event={"ID":"e6430451-baa7-4735-934b-a136e028984e","Type":"ContainerDied","Data":"7aa6476f5ed99c5c1ac818b322b5dda00540f18f5b2ce66ea41a0fff9e4d89fe"}
Sep 19 11:38:10.819295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.819274    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7aa6476f5ed99c5c1ac818b322b5dda00540f18f5b2ce66ea41a0fff9e4d89fe"
Sep 19 11:38:10.821328 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.821273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf" event={"ID":"3866536c-8e39-4345-aff3-bdab7ff91fd1","Type":"ContainerDied","Data":"ee3620cc4d03b651ddc75f267e977d5ee449fa9bb25d0718c67631da85a992e8"}
Sep 19 11:38:10.821328 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.821326    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee3620cc4d03b651ddc75f267e977d5ee449fa9bb25d0718c67631da85a992e8"
Sep 19 11:38:10.821544 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:10.821292    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfdtf"
Sep 19 11:38:11.542778 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.542749    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" path="/var/lib/kubelet/pods/8e9940cc-a722-4314-8e75-51e02ac4ab93/volumes"
Sep 19 11:38:11.543193 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.543177    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" path="/var/lib/kubelet/pods/98f45e35-42ae-4235-b45d-bba2360e9411/volumes"
Sep 19 11:38:11.852500 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852429    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"]
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852695    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852706    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852714    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852719    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852728    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="pull"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852733    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="pull"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852741    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="pull"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852747    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="pull"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852755    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852760    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852768    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852773    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852781    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="pull"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852787    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="pull"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852793    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852799    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852805    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852810    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="extract"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852816    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852821    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852830    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852835    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852841    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852846    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="util"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852852    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy"
Sep 19 11:38:11.852844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852857    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852865    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="pull"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852870    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="pull"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852966    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6efc025c-a585-4c91-a67d-afbc212bca7e" containerName="extract"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852973    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3866536c-8e39-4345-aff3-bdab7ff91fd1" containerName="extract"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852981    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="98f45e35-42ae-4235-b45d-bba2360e9411" containerName="istio-proxy"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed6b551-2526-4c5b-ad68-5e27605b4912" containerName="extract"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852992    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6430451-baa7-4735-934b-a136e028984e" containerName="extract"
Sep 19 11:38:11.853562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.852996    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e9940cc-a722-4314-8e75-51e02ac4ab93" containerName="istio-proxy"
Sep 19 11:38:11.863130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.863105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:11.865770 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.865750    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 11:38:11.865937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.865791    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-cjw94\""
Sep 19 11:38:11.865937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.865868    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 19 11:38:11.865937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.865879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 19 11:38:11.866117 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.865947    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 19 11:38:11.866117 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.866067    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 11:38:11.871723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:11.871703    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"]
Sep 19 11:38:12.033177 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.033146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d883b81-dff5-4f64-a7bb-f067e268fce6-tmp\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.033343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.033197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d883b81-dff5-4f64-a7bb-f067e268fce6-manifests\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.033343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.033252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.033343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.033297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.033343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.033338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-metrics-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.033533 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.033361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lr7t\" (UniqueName: \"kubernetes.io/projected/1d883b81-dff5-4f64-a7bb-f067e268fce6-kube-api-access-6lr7t\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d883b81-dff5-4f64-a7bb-f067e268fce6-tmp\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d883b81-dff5-4f64-a7bb-f067e268fce6-manifests\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-metrics-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134418    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lr7t\" (UniqueName: \"kubernetes.io/projected/1d883b81-dff5-4f64-a7bb-f067e268fce6-kube-api-access-6lr7t\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.134777 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.134741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d883b81-dff5-4f64-a7bb-f067e268fce6-manifests\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.136694 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.136666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d883b81-dff5-4f64-a7bb-f067e268fce6-tmp\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.136803 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.136787    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.136959 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.136941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-metrics-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.137012 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.136994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d883b81-dff5-4f64-a7bb-f067e268fce6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.144551 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.144528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lr7t\" (UniqueName: \"kubernetes.io/projected/1d883b81-dff5-4f64-a7bb-f067e268fce6-kube-api-access-6lr7t\") pod \"opendatahub-operator-controller-manager-9f59f68b4-29rp5\" (UID: \"1d883b81-dff5-4f64-a7bb-f067e268fce6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.174012 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.173987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:12.466678 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.466651    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"]
Sep 19 11:38:12.468725 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:38:12.468688    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d883b81_dff5_4f64_a7bb_f067e268fce6.slice/crio-a59fa751beb30bc3630afeb6ecbf396c030ad709ecaf2a33e139a5df72a31a6f WatchSource:0}: Error finding container a59fa751beb30bc3630afeb6ecbf396c030ad709ecaf2a33e139a5df72a31a6f: Status 404 returned error can't find the container with id a59fa751beb30bc3630afeb6ecbf396c030ad709ecaf2a33e139a5df72a31a6f
Sep 19 11:38:12.837437 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:12.837401    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5" event={"ID":"1d883b81-dff5-4f64-a7bb-f067e268fce6","Type":"ContainerStarted","Data":"a59fa751beb30bc3630afeb6ecbf396c030ad709ecaf2a33e139a5df72a31a6f"}
Sep 19 11:38:15.854654 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:15.854577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5" event={"ID":"1d883b81-dff5-4f64-a7bb-f067e268fce6","Type":"ContainerStarted","Data":"6839baa50482a89c71c0dc645707d1336fca2e9390bf0fbb7c79c744cb08f2c5"}
Sep 19 11:38:16.706289 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.706250    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"]
Sep 19 11:38:16.708330 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.708312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:16.710570 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.710535    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Sep 19 11:38:16.710686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.710573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Sep 19 11:38:16.710686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.710636    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-sffjg\""
Sep 19 11:38:16.717593 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.717568    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"]
Sep 19 11:38:16.865667 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.865636    2582 generic.go:356] "Generic (PLEG): container finished" podID="1d883b81-dff5-4f64-a7bb-f067e268fce6" containerID="6839baa50482a89c71c0dc645707d1336fca2e9390bf0fbb7c79c744cb08f2c5" exitCode=0
Sep 19 11:38:16.866106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.865691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5" event={"ID":"1d883b81-dff5-4f64-a7bb-f067e268fce6","Type":"ContainerDied","Data":"6839baa50482a89c71c0dc645707d1336fca2e9390bf0fbb7c79c744cb08f2c5"}
Sep 19 11:38:16.878471 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.878446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rckqc\" (UniqueName: \"kubernetes.io/projected/f727bffb-7557-449b-add2-7e7b053a7cc0-kube-api-access-rckqc\") pod \"jobset-operator-56d489b4b8-spfwq\" (UID: \"f727bffb-7557-449b-add2-7e7b053a7cc0\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:16.878584 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.878520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f727bffb-7557-449b-add2-7e7b053a7cc0-tmp\") pod \"jobset-operator-56d489b4b8-spfwq\" (UID: \"f727bffb-7557-449b-add2-7e7b053a7cc0\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:16.979513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.979484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f727bffb-7557-449b-add2-7e7b053a7cc0-tmp\") pod \"jobset-operator-56d489b4b8-spfwq\" (UID: \"f727bffb-7557-449b-add2-7e7b053a7cc0\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:16.979698 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.979534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rckqc\" (UniqueName: \"kubernetes.io/projected/f727bffb-7557-449b-add2-7e7b053a7cc0-kube-api-access-rckqc\") pod \"jobset-operator-56d489b4b8-spfwq\" (UID: \"f727bffb-7557-449b-add2-7e7b053a7cc0\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:16.979900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.979879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f727bffb-7557-449b-add2-7e7b053a7cc0-tmp\") pod \"jobset-operator-56d489b4b8-spfwq\" (UID: \"f727bffb-7557-449b-add2-7e7b053a7cc0\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:16.988214 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:16.988184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rckqc\" (UniqueName: \"kubernetes.io/projected/f727bffb-7557-449b-add2-7e7b053a7cc0-kube-api-access-rckqc\") pod \"jobset-operator-56d489b4b8-spfwq\" (UID: \"f727bffb-7557-449b-add2-7e7b053a7cc0\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:17.030677 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:17.030647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"
Sep 19 11:38:17.326604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:17.326577    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq"]
Sep 19 11:38:17.328743 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:38:17.328710    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf727bffb_7557_449b_add2_7e7b053a7cc0.slice/crio-05a6443df48f5a249a555faba7f0f9f1574aa84da1c44f97a58c3666e725d7ee WatchSource:0}: Error finding container 05a6443df48f5a249a555faba7f0f9f1574aa84da1c44f97a58c3666e725d7ee: Status 404 returned error can't find the container with id 05a6443df48f5a249a555faba7f0f9f1574aa84da1c44f97a58c3666e725d7ee
Sep 19 11:38:17.872100 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:17.872068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5" event={"ID":"1d883b81-dff5-4f64-a7bb-f067e268fce6","Type":"ContainerStarted","Data":"04efb392ed0f492e24bc39c145f032b94b15d433872c5b82a5b1f3af95a7d952"}
Sep 19 11:38:17.872529 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:17.872168    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:17.873407 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:17.873388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq" event={"ID":"f727bffb-7557-449b-add2-7e7b053a7cc0","Type":"ContainerStarted","Data":"05a6443df48f5a249a555faba7f0f9f1574aa84da1c44f97a58c3666e725d7ee"}
Sep 19 11:38:17.891846 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:17.891800    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5" podStartSLOduration=3.130791467 podStartE2EDuration="6.891787768s" totalImagesPullingTime="3.334030741s" totalInitContainerRuntime="426.96556ms" isStatefulPod=false podCreationTimestamp="2026-09-19 11:38:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:17.890112834 +0000 UTC m=+268.907149546" watchObservedRunningTime="2026-09-19 11:38:17.891787768 +0000 UTC m=+268.908824478"
Sep 19 11:38:20.888881 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:20.888841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq" event={"ID":"f727bffb-7557-449b-add2-7e7b053a7cc0","Type":"ContainerStarted","Data":"520276b17603bd41642b7823be7cc91b9ecab9a15dbd4196ca8ded5d845be3f9"}
Sep 19 11:38:20.904843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:20.904793    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-spfwq" podStartSLOduration=2.326137364 podStartE2EDuration="4.904776181s" totalImagesPullingTime="2.578638817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:20.90324622 +0000 UTC m=+271.920282930" watchObservedRunningTime="2026-09-19 11:38:20.904776181 +0000 UTC m=+271.921812891"
Sep 19 11:38:28.881484 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:28.881452    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-9f59f68b4-29rp5"
Sep 19 11:38:37.468160 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.468120    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"]
Sep 19 11:38:37.512603 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.512569    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"]
Sep 19 11:38:37.512756 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.512686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.515578 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.515557    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 19 11:38:37.515849 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.515835    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 19 11:38:37.516324 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.516308    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8nxp4\""
Sep 19 11:38:37.553771 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.553747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca53116-0662-4b1c-8895-c580d05129b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-ktfww\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.553884 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.553775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzks9\" (UniqueName: \"kubernetes.io/projected/dca53116-0662-4b1c-8895-c580d05129b4-kube-api-access-nzks9\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-ktfww\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.654645 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.654614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca53116-0662-4b1c-8895-c580d05129b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-ktfww\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.654645 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.654647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzks9\" (UniqueName: \"kubernetes.io/projected/dca53116-0662-4b1c-8895-c580d05129b4-kube-api-access-nzks9\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-ktfww\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.655225 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.655204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca53116-0662-4b1c-8895-c580d05129b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-ktfww\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.671564 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.671542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzks9\" (UniqueName: \"kubernetes.io/projected/dca53116-0662-4b1c-8895-c580d05129b4-kube-api-access-nzks9\") pod \"kuadrant-operator-controller-manager-7cbf85f5f5-ktfww\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:37.822644 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:37.822613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:38.121665 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.121584    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"]
Sep 19 11:38:38.124989 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:38:38.124959    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca53116_0662_4b1c_8895_c580d05129b4.slice/crio-f9ec923c3853d9b1938a9ff4f0c5e82ea68658b85fd86d44ad48d2e9aab2b2cb WatchSource:0}: Error finding container f9ec923c3853d9b1938a9ff4f0c5e82ea68658b85fd86d44ad48d2e9aab2b2cb: Status 404 returned error can't find the container with id f9ec923c3853d9b1938a9ff4f0c5e82ea68658b85fd86d44ad48d2e9aab2b2cb
Sep 19 11:38:38.361935 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.361876    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"]
Sep 19 11:38:38.392535 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.392460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"]
Sep 19 11:38:38.392673 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.392549    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.395149 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.395126    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 19 11:38:38.395311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.395216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 19 11:38:38.395311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.395221    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wqfnh\""
Sep 19 11:38:38.462042 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.462013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85deca22-dc4b-471d-92c1-61750fca07ac-tls-certs\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.462184 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.462066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85deca22-dc4b-471d-92c1-61750fca07ac-tmp\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.462184 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.462154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4bns\" (UniqueName: \"kubernetes.io/projected/85deca22-dc4b-471d-92c1-61750fca07ac-kube-api-access-t4bns\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.495512 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.495483    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"]
Sep 19 11:38:38.518509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.518480    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"]
Sep 19 11:38:38.518657 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.518611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.521102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.521080    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vhncb\""
Sep 19 11:38:38.562969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.562931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563076 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.562994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4bns\" (UniqueName: \"kubernetes.io/projected/85deca22-dc4b-471d-92c1-61750fca07ac-kube-api-access-t4bns\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.563076 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563076 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a643c1-e9d2-421b-8643-4fbb929de704-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563076 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfw7\" (UniqueName: \"kubernetes.io/projected/01a643c1-e9d2-421b-8643-4fbb929de704-kube-api-access-kzfw7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85deca22-dc4b-471d-92c1-61750fca07ac-tls-certs\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a643c1-e9d2-421b-8643-4fbb929de704-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a643c1-e9d2-421b-8643-4fbb929de704-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.563259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.563254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85deca22-dc4b-471d-92c1-61750fca07ac-tmp\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.565368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.565343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85deca22-dc4b-471d-92c1-61750fca07ac-tmp\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.565693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.565675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85deca22-dc4b-471d-92c1-61750fca07ac-tls-certs\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.570630 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.570606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4bns\" (UniqueName: \"kubernetes.io/projected/85deca22-dc4b-471d-92c1-61750fca07ac-kube-api-access-t4bns\") pod \"kube-auth-proxy-864788f75f-l7bzp\" (UID: \"85deca22-dc4b-471d-92c1-61750fca07ac\") " pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.664824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.664824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a643c1-e9d2-421b-8643-4fbb929de704-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfw7\" (UniqueName: \"kubernetes.io/projected/01a643c1-e9d2-421b-8643-4fbb929de704-kube-api-access-kzfw7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a643c1-e9d2-421b-8643-4fbb929de704-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.664986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a643c1-e9d2-421b-8643-4fbb929de704-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665380 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665380 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665639 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a643c1-e9d2-421b-8643-4fbb929de704-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.665750 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.665695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.667523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.667499    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a643c1-e9d2-421b-8643-4fbb929de704-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.667946 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.667904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a643c1-e9d2-421b-8643-4fbb929de704-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.677539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.677508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a643c1-e9d2-421b-8643-4fbb929de704-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.677948 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.677895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfw7\" (UniqueName: \"kubernetes.io/projected/01a643c1-e9d2-421b-8643-4fbb929de704-kube-api-access-kzfw7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9\" (UID: \"01a643c1-e9d2-421b-8643-4fbb929de704\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.702267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.702247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"
Sep 19 11:38:38.830335 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.830301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:38.971032 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:38.970948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww" event={"ID":"dca53116-0662-4b1c-8895-c580d05129b4","Type":"ContainerStarted","Data":"f9ec923c3853d9b1938a9ff4f0c5e82ea68658b85fd86d44ad48d2e9aab2b2cb"}
Sep 19 11:38:39.006704 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.006666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-864788f75f-l7bzp"]
Sep 19 11:38:39.007263 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:38:39.007233    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85deca22_dc4b_471d_92c1_61750fca07ac.slice/crio-f5a184715c91982f9f33bfd2c49aa7768f1c63bc284969d10289b705d5b96d2a WatchSource:0}: Error finding container f5a184715c91982f9f33bfd2c49aa7768f1c63bc284969d10289b705d5b96d2a: Status 404 returned error can't find the container with id f5a184715c91982f9f33bfd2c49aa7768f1c63bc284969d10289b705d5b96d2a
Sep 19 11:38:39.135829 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.135809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"]
Sep 19 11:38:39.138518 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:38:39.138491    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a643c1_e9d2_421b_8643_4fbb929de704.slice/crio-09012e4f206ceeb34232d975abf5eecc23c8d95f510c49586759a90365c9eb57 WatchSource:0}: Error finding container 09012e4f206ceeb34232d975abf5eecc23c8d95f510c49586759a90365c9eb57: Status 404 returned error can't find the container with id 09012e4f206ceeb34232d975abf5eecc23c8d95f510c49586759a90365c9eb57
Sep 19 11:38:39.141379 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.141343    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:38:39.141494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.141418    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:38:39.141494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.141449    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:38:39.982493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.982453    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9" event={"ID":"01a643c1-e9d2-421b-8643-4fbb929de704","Type":"ContainerStarted","Data":"3d123193acb008df43a27366e6951b592824b40acf4f8bac955d618432a06599"}
Sep 19 11:38:39.982973 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.982523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9" event={"ID":"01a643c1-e9d2-421b-8643-4fbb929de704","Type":"ContainerStarted","Data":"09012e4f206ceeb34232d975abf5eecc23c8d95f510c49586759a90365c9eb57"}
Sep 19 11:38:39.984278 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:39.984247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp" event={"ID":"85deca22-dc4b-471d-92c1-61750fca07ac","Type":"ContainerStarted","Data":"f5a184715c91982f9f33bfd2c49aa7768f1c63bc284969d10289b705d5b96d2a"}
Sep 19 11:38:40.003823 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:40.003773    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9" podStartSLOduration=2.003753687 podStartE2EDuration="2.003753687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:40.002727379 +0000 UTC m=+291.019764091" watchObservedRunningTime="2026-09-19 11:38:40.003753687 +0000 UTC m=+291.020790399"
Sep 19 11:38:40.830834 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:40.830803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:40.836179 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:40.836154    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:40.990612 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:40.990577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:40.991673 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:40.991648    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9"
Sep 19 11:38:43.002702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:43.002604    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp" event={"ID":"85deca22-dc4b-471d-92c1-61750fca07ac","Type":"ContainerStarted","Data":"70a9b86a915aba1165062cad867c4e5e584d06b4eb921cf75b366e4769bd6dd5"}
Sep 19 11:38:43.004530 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:43.004495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww" event={"ID":"dca53116-0662-4b1c-8895-c580d05129b4","Type":"ContainerStarted","Data":"b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff"}
Sep 19 11:38:43.004713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:43.004697    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:43.020654 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:43.020609    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-864788f75f-l7bzp" podStartSLOduration=1.288090813 podStartE2EDuration="5.020595112s" totalImagesPullingTime="3.732504299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:43.01882521 +0000 UTC m=+294.035861920" watchObservedRunningTime="2026-09-19 11:38:43.020595112 +0000 UTC m=+294.037631823"
Sep 19 11:38:43.035236 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:43.035196    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww" podStartSLOduration=1.410717103 podStartE2EDuration="6.035182985s" totalImagesPullingTime="4.624465882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:43.034311214 +0000 UTC m=+294.051347949" watchObservedRunningTime="2026-09-19 11:38:43.035182985 +0000 UTC m=+294.052219695"
Sep 19 11:38:44.670931 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.670890    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"]
Sep 19 11:38:44.678889 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.678865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:38:44.681443 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.681421    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-48f5d\""
Sep 19 11:38:44.685798 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.685773    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"]
Sep 19 11:38:44.722220 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.722195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg25h\" (UniqueName: \"kubernetes.io/projected/b08968df-a4e6-4af3-82ba-63e3b0872f62-kube-api-access-tg25h\") pod \"authorino-operator-6c7cb5c9cb-pqfwr\" (UID: \"b08968df-a4e6-4af3-82ba-63e3b0872f62\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:38:44.823311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.823285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg25h\" (UniqueName: \"kubernetes.io/projected/b08968df-a4e6-4af3-82ba-63e3b0872f62-kube-api-access-tg25h\") pod \"authorino-operator-6c7cb5c9cb-pqfwr\" (UID: \"b08968df-a4e6-4af3-82ba-63e3b0872f62\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:38:44.831299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.831274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg25h\" (UniqueName: \"kubernetes.io/projected/b08968df-a4e6-4af3-82ba-63e3b0872f62-kube-api-access-tg25h\") pod \"authorino-operator-6c7cb5c9cb-pqfwr\" (UID: \"b08968df-a4e6-4af3-82ba-63e3b0872f62\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:38:44.992311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:44.992284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:38:45.302429 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:45.300718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"]
Sep 19 11:38:45.305085 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:38:45.305058    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08968df_a4e6_4af3_82ba_63e3b0872f62.slice/crio-1162a025eb9b9da37ed3078e430de44b2759d8bc02f783300fcdcab251e546a4 WatchSource:0}: Error finding container 1162a025eb9b9da37ed3078e430de44b2759d8bc02f783300fcdcab251e546a4: Status 404 returned error can't find the container with id 1162a025eb9b9da37ed3078e430de44b2759d8bc02f783300fcdcab251e546a4
Sep 19 11:38:46.019384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:46.019348    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr" event={"ID":"b08968df-a4e6-4af3-82ba-63e3b0872f62","Type":"ContainerStarted","Data":"1162a025eb9b9da37ed3078e430de44b2759d8bc02f783300fcdcab251e546a4"}
Sep 19 11:38:47.025162 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:47.025078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr" event={"ID":"b08968df-a4e6-4af3-82ba-63e3b0872f62","Type":"ContainerStarted","Data":"51a3c54c006e334bc44b2dd911335acd68036d65d4dfcf5f064673cb665cec25"}
Sep 19 11:38:47.025510 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:47.025180    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:38:47.046537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:47.046494    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr" podStartSLOduration=1.588269549 podStartE2EDuration="3.046481415s" totalImagesPullingTime="1.458211866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:38:47.044651884 +0000 UTC m=+298.061688598" watchObservedRunningTime="2026-09-19 11:38:47.046481415 +0000 UTC m=+298.063518127"
Sep 19 11:38:49.363561 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:49.363526    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 11:38:54.010169 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:54.010139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:38:58.032392 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:38:58.032360    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-pqfwr"
Sep 19 11:39:10.560328 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.560290    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"]
Sep 19 11:39:10.560776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.560539    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww" podUID="dca53116-0662-4b1c-8895-c580d05129b4" containerName="manager" containerID="cri-o://b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff" gracePeriod=10
Sep 19 11:39:10.804181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.804155    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:39:10.939169 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.939099    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzks9\" (UniqueName: \"kubernetes.io/projected/dca53116-0662-4b1c-8895-c580d05129b4-kube-api-access-nzks9\") pod \"dca53116-0662-4b1c-8895-c580d05129b4\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") "
Sep 19 11:39:10.939169 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.939134    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca53116-0662-4b1c-8895-c580d05129b4-extensions-socket-volume\") pod \"dca53116-0662-4b1c-8895-c580d05129b4\" (UID: \"dca53116-0662-4b1c-8895-c580d05129b4\") "
Sep 19 11:39:10.939525 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.939501    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dca53116-0662-4b1c-8895-c580d05129b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dca53116-0662-4b1c-8895-c580d05129b4" (UID: "dca53116-0662-4b1c-8895-c580d05129b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:39:10.941310 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:10.941289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca53116-0662-4b1c-8895-c580d05129b4-kube-api-access-nzks9" (OuterVolumeSpecName: "kube-api-access-nzks9") pod "dca53116-0662-4b1c-8895-c580d05129b4" (UID: "dca53116-0662-4b1c-8895-c580d05129b4"). InnerVolumeSpecName "kube-api-access-nzks9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:39:11.040250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.040222    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzks9\" (UniqueName: \"kubernetes.io/projected/dca53116-0662-4b1c-8895-c580d05129b4-kube-api-access-nzks9\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:39:11.040250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.040244    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca53116-0662-4b1c-8895-c580d05129b4-extensions-socket-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:39:11.137874 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.137841    2582 generic.go:356] "Generic (PLEG): container finished" podID="dca53116-0662-4b1c-8895-c580d05129b4" containerID="b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff" exitCode=0
Sep 19 11:39:11.138044 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.137886    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"
Sep 19 11:39:11.138044 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.138019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww" event={"ID":"dca53116-0662-4b1c-8895-c580d05129b4","Type":"ContainerDied","Data":"b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff"}
Sep 19 11:39:11.138131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.138074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww" event={"ID":"dca53116-0662-4b1c-8895-c580d05129b4","Type":"ContainerDied","Data":"f9ec923c3853d9b1938a9ff4f0c5e82ea68658b85fd86d44ad48d2e9aab2b2cb"}
Sep 19 11:39:11.138131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.138096    2582 scope.go:117] "RemoveContainer" containerID="b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff"
Sep 19 11:39:11.147187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.147170    2582 scope.go:117] "RemoveContainer" containerID="b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff"
Sep 19 11:39:11.147489 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:39:11.147468    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff\": container with ID starting with b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff not found: ID does not exist" containerID="b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff"
Sep 19 11:39:11.147528 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.147498    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff"} err="failed to get container status \"b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff\": rpc error: code = NotFound desc = could not find container \"b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff\": container with ID starting with b894eb9d0c8c63d8e7dca1613d1c58537ee1a2540fb1f178fe2ab084551396ff not found: ID does not exist"
Sep 19 11:39:11.171743 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.171716    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"]
Sep 19 11:39:11.180107 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.180081    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7cbf85f5f5-ktfww"]
Sep 19 11:39:11.543484 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:11.543445    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca53116-0662-4b1c-8895-c580d05129b4" path="/var/lib/kubelet/pods/dca53116-0662-4b1c-8895-c580d05129b4/volumes"
Sep 19 11:39:30.856409 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.856371    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:39:30.856807 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.856708    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca53116-0662-4b1c-8895-c580d05129b4" containerName="manager"
Sep 19 11:39:30.856807 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.856720    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca53116-0662-4b1c-8895-c580d05129b4" containerName="manager"
Sep 19 11:39:30.856807 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.856771    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca53116-0662-4b1c-8895-c580d05129b4" containerName="manager"
Sep 19 11:39:30.861764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.861746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:30.864404 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.864386    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qq8p4\""
Sep 19 11:39:30.864558 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.864538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 19 11:39:30.871106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.871082    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:39:30.901173 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.901147    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:39:30.905811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.905788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsw4\" (UniqueName: \"kubernetes.io/projected/9023baaf-18f7-49ac-85d3-e5be4ac26e06-kube-api-access-dcsw4\") pod \"limitador-limitador-84994f7ffc-k4jdg\" (UID: \"9023baaf-18f7-49ac-85d3-e5be4ac26e06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:30.905903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:30.905846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9023baaf-18f7-49ac-85d3-e5be4ac26e06-config-file\") pod \"limitador-limitador-84994f7ffc-k4jdg\" (UID: \"9023baaf-18f7-49ac-85d3-e5be4ac26e06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:31.006542 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.006513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsw4\" (UniqueName: \"kubernetes.io/projected/9023baaf-18f7-49ac-85d3-e5be4ac26e06-kube-api-access-dcsw4\") pod \"limitador-limitador-84994f7ffc-k4jdg\" (UID: \"9023baaf-18f7-49ac-85d3-e5be4ac26e06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:31.006713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.006565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9023baaf-18f7-49ac-85d3-e5be4ac26e06-config-file\") pod \"limitador-limitador-84994f7ffc-k4jdg\" (UID: \"9023baaf-18f7-49ac-85d3-e5be4ac26e06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:31.007175 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.007157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9023baaf-18f7-49ac-85d3-e5be4ac26e06-config-file\") pod \"limitador-limitador-84994f7ffc-k4jdg\" (UID: \"9023baaf-18f7-49ac-85d3-e5be4ac26e06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:31.022592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.022563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsw4\" (UniqueName: \"kubernetes.io/projected/9023baaf-18f7-49ac-85d3-e5be4ac26e06-kube-api-access-dcsw4\") pod \"limitador-limitador-84994f7ffc-k4jdg\" (UID: \"9023baaf-18f7-49ac-85d3-e5be4ac26e06\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:31.172462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.172386    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:31.445708 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.445677    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:39:31.447869 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:39:31.447838    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9023baaf_18f7_49ac_85d3_e5be4ac26e06.slice/crio-fe79e8d8851a8c529c49b81dc3650dcbbcb00b65a992cf8dcb4616f02ba84055 WatchSource:0}: Error finding container fe79e8d8851a8c529c49b81dc3650dcbbcb00b65a992cf8dcb4616f02ba84055: Status 404 returned error can't find the container with id fe79e8d8851a8c529c49b81dc3650dcbbcb00b65a992cf8dcb4616f02ba84055
Sep 19 11:39:31.450491 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.450472    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:39:31.532363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.532320    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-9bdss"]
Sep 19 11:39:31.538017 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.537992    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:39:31.540652 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.540627    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d599g\""
Sep 19 11:39:31.553641 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.553602    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9bdss"]
Sep 19 11:39:31.611746 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.611713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr26b\" (UniqueName: \"kubernetes.io/projected/2dd61254-e4d9-47f2-8028-99f83f1fb01b-kube-api-access-cr26b\") pod \"authorino-59c974bd48-9bdss\" (UID: \"2dd61254-e4d9-47f2-8028-99f83f1fb01b\") " pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:39:31.699324 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.699249    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7db885c774-25hvd"]
Sep 19 11:39:31.702478 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.702458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.705061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.705031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Sep 19 11:39:31.705200 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.705184    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 19 11:39:31.705310 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.705289    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 11:39:31.705372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.705342    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ctlc2\""
Sep 19 11:39:31.705497 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.705479    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 11:39:31.711269 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.711247    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-25hvd"]
Sep 19 11:39:31.712414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.712391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr26b\" (UniqueName: \"kubernetes.io/projected/2dd61254-e4d9-47f2-8028-99f83f1fb01b-kube-api-access-cr26b\") pod \"authorino-59c974bd48-9bdss\" (UID: \"2dd61254-e4d9-47f2-8028-99f83f1fb01b\") " pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:39:31.730082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.730058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr26b\" (UniqueName: \"kubernetes.io/projected/2dd61254-e4d9-47f2-8028-99f83f1fb01b-kube-api-access-cr26b\") pod \"authorino-59c974bd48-9bdss\" (UID: \"2dd61254-e4d9-47f2-8028-99f83f1fb01b\") " pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:39:31.813898 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.813869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc9fd22c-721e-438a-9fe4-a0bf23de72db-cert\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.814061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.814022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc9fd22c-721e-438a-9fe4-a0bf23de72db-metrics-certs\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.814061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.814052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vm95\" (UniqueName: \"kubernetes.io/projected/cc9fd22c-721e-438a-9fe4-a0bf23de72db-kube-api-access-7vm95\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.854667 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.854638    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:39:31.916320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.915570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc9fd22c-721e-438a-9fe4-a0bf23de72db-metrics-certs\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.916320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.915619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vm95\" (UniqueName: \"kubernetes.io/projected/cc9fd22c-721e-438a-9fe4-a0bf23de72db-kube-api-access-7vm95\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.916320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.915671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc9fd22c-721e-438a-9fe4-a0bf23de72db-cert\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.922374 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.922345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc9fd22c-721e-438a-9fe4-a0bf23de72db-cert\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.926880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.926856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc9fd22c-721e-438a-9fe4-a0bf23de72db-metrics-certs\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:31.928865 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:31.928835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vm95\" (UniqueName: \"kubernetes.io/projected/cc9fd22c-721e-438a-9fe4-a0bf23de72db-kube-api-access-7vm95\") pod \"odh-model-controller-7db885c774-25hvd\" (UID: \"cc9fd22c-721e-438a-9fe4-a0bf23de72db\") " pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:32.014630 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:32.014602    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:32.151338 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:32.151306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9bdss"]
Sep 19 11:39:32.230038 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:39:32.230002    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd61254_e4d9_47f2_8028_99f83f1fb01b.slice/crio-f425aba1af5244232a538f1fd93a386a2e2e656317d34a5295e3b2279899488f WatchSource:0}: Error finding container f425aba1af5244232a538f1fd93a386a2e2e656317d34a5295e3b2279899488f: Status 404 returned error can't find the container with id f425aba1af5244232a538f1fd93a386a2e2e656317d34a5295e3b2279899488f
Sep 19 11:39:32.245360 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:32.245331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg" event={"ID":"9023baaf-18f7-49ac-85d3-e5be4ac26e06","Type":"ContainerStarted","Data":"fe79e8d8851a8c529c49b81dc3650dcbbcb00b65a992cf8dcb4616f02ba84055"}
Sep 19 11:39:32.246486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:32.246460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9bdss" event={"ID":"2dd61254-e4d9-47f2-8028-99f83f1fb01b","Type":"ContainerStarted","Data":"f425aba1af5244232a538f1fd93a386a2e2e656317d34a5295e3b2279899488f"}
Sep 19 11:39:32.291737 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:32.291714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-25hvd"]
Sep 19 11:39:32.295811 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:39:32.295784    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9fd22c_721e_438a_9fe4_a0bf23de72db.slice/crio-19bc2df29c59e1cb098da0e644269930f410fc4ad4e045dd26f6e80a3e62a958 WatchSource:0}: Error finding container 19bc2df29c59e1cb098da0e644269930f410fc4ad4e045dd26f6e80a3e62a958: Status 404 returned error can't find the container with id 19bc2df29c59e1cb098da0e644269930f410fc4ad4e045dd26f6e80a3e62a958
Sep 19 11:39:33.255772 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:33.255731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg" event={"ID":"9023baaf-18f7-49ac-85d3-e5be4ac26e06","Type":"ContainerStarted","Data":"aa195f439d3005b6a004feae18ed372cc6fc02443d1f02fca664a5bee368f2c4"}
Sep 19 11:39:33.256238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:33.255805    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:33.257572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:33.257543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-25hvd" event={"ID":"cc9fd22c-721e-438a-9fe4-a0bf23de72db","Type":"ContainerStarted","Data":"19bc2df29c59e1cb098da0e644269930f410fc4ad4e045dd26f6e80a3e62a958"}
Sep 19 11:39:33.272989 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:33.272939    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg" podStartSLOduration=2.438194817 podStartE2EDuration="3.272886917s" totalImagesPullingTime="834.6921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:39:33.270967631 +0000 UTC m=+344.288004341" watchObservedRunningTime="2026-09-19 11:39:33.272886917 +0000 UTC m=+344.289923629"
Sep 19 11:39:36.281524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:36.281491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-25hvd" event={"ID":"cc9fd22c-721e-438a-9fe4-a0bf23de72db","Type":"ContainerStarted","Data":"94fafb316fd61e7b4a76d355ee3c6365bcba4585f86b23c4611451b95b07a69d"}
Sep 19 11:39:36.281991 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:36.281607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:39:36.283240 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:36.283216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9bdss" event={"ID":"2dd61254-e4d9-47f2-8028-99f83f1fb01b","Type":"ContainerStarted","Data":"f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd"}
Sep 19 11:39:36.300903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:36.300857    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7db885c774-25hvd" podStartSLOduration=2.343490104 podStartE2EDuration="5.300844677s" totalImagesPullingTime="2.957354573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:39:36.299730782 +0000 UTC m=+347.316767495" watchObservedRunningTime="2026-09-19 11:39:36.300844677 +0000 UTC m=+347.317881389"
Sep 19 11:39:36.313757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:36.313711    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-9bdss" podStartSLOduration=2.338021946 podStartE2EDuration="5.313695383s" totalImagesPullingTime="2.975673437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:39:36.312776002 +0000 UTC m=+347.329812714" watchObservedRunningTime="2026-09-19 11:39:36.313695383 +0000 UTC m=+347.330732098"
Sep 19 11:39:44.265159 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:44.265081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"
Sep 19 11:39:47.290181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:39:47.290147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7db885c774-25hvd"
Sep 19 11:40:02.948818 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.948786    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6df5dfb9-2hzr2"]
Sep 19 11:40:02.953134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.953114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:02.955868 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.955845    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 11:40:02.955999 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.955875    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 11:40:02.956766 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.956751    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d96l2\""
Sep 19 11:40:02.956830 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.956758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 11:40:02.962435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.962413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6df5dfb9-2hzr2"]
Sep 19 11:40:02.994165 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.994133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:02.994296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.994166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:02.994296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:02.994279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzz6d\" (UniqueName: \"kubernetes.io/projected/56688282-390b-4166-95b1-a3bf13b77c07-kube-api-access-pzz6d\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.095748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.095717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.095748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.095749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.095988 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:03.095882    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 19 11:40:03.095988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.095881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzz6d\" (UniqueName: \"kubernetes.io/projected/56688282-390b-4166-95b1-a3bf13b77c07-kube-api-access-pzz6d\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.096594 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:03.096480    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 19 11:40:03.096594 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:03.096578    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs podName:56688282-390b-4166-95b1-a3bf13b77c07 nodeName:}" failed. No retries permitted until 2026-09-19 11:40:03.59652772 +0000 UTC m=+374.613564415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs") pod "maas-controller-7c6df5dfb9-2hzr2" (UID: "56688282-390b-4166-95b1-a3bf13b77c07") : secret "maas-controller-metrics-tls" not found
Sep 19 11:40:03.096820 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:03.096635    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert podName:56688282-390b-4166-95b1-a3bf13b77c07 nodeName:}" failed. No retries permitted until 2026-09-19 11:40:03.596610371 +0000 UTC m=+374.613647062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert") pod "maas-controller-7c6df5dfb9-2hzr2" (UID: "56688282-390b-4166-95b1-a3bf13b77c07") : secret "maas-controller-webhook-cert" not found
Sep 19 11:40:03.107924 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.107879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzz6d\" (UniqueName: \"kubernetes.io/projected/56688282-390b-4166-95b1-a3bf13b77c07-kube-api-access-pzz6d\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.112977 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.112954    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-tddnf"]
Sep 19 11:40:03.115576 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.115561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.125781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.125756    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-tddnf"]
Sep 19 11:40:03.197413 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.197387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-metrics-certs\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.197561 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.197452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjf46\" (UniqueName: \"kubernetes.io/projected/51fa9b95-30a7-4bd3-9518-f7afd19c318e-kube-api-access-cjf46\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.197561 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.197489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.298726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.298694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.298866 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.298755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-metrics-certs\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.298866 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.298806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf46\" (UniqueName: \"kubernetes.io/projected/51fa9b95-30a7-4bd3-9518-f7afd19c318e-kube-api-access-cjf46\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.298866 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:03.298847    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 19 11:40:03.298996 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:03.298950    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert podName:51fa9b95-30a7-4bd3-9518-f7afd19c318e nodeName:}" failed. No retries permitted until 2026-09-19 11:40:03.798927605 +0000 UTC m=+374.815964321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert") pod "maas-controller-6b54d84f7b-tddnf" (UID: "51fa9b95-30a7-4bd3-9518-f7afd19c318e") : secret "maas-controller-webhook-cert" not found
Sep 19 11:40:03.301303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.301283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-metrics-certs\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.305815 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.305794    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjf46\" (UniqueName: \"kubernetes.io/projected/51fa9b95-30a7-4bd3-9518-f7afd19c318e-kube-api-access-cjf46\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.601781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.601695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.601781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.601731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.604363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.604328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.604478 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.604328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs\") pod \"maas-controller-7c6df5dfb9-2hzr2\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") " pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:03.803281 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.803246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.805540 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.805522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert\") pod \"maas-controller-6b54d84f7b-tddnf\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") " pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:03.866679 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:03.866616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:04.027572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:04.027540    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:04.133307 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:04.133282    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6df5dfb9-2hzr2"]
Sep 19 11:40:04.134816 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:40:04.134788    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56688282_390b_4166_95b1_a3bf13b77c07.slice/crio-2623462d013a412ab6ecc28abf4cdb9d4addd17881ed43898db0a946f194a258 WatchSource:0}: Error finding container 2623462d013a412ab6ecc28abf4cdb9d4addd17881ed43898db0a946f194a258: Status 404 returned error can't find the container with id 2623462d013a412ab6ecc28abf4cdb9d4addd17881ed43898db0a946f194a258
Sep 19 11:40:04.292985 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:04.292960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-tddnf"]
Sep 19 11:40:04.294392 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:40:04.294366    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fa9b95_30a7_4bd3_9518_f7afd19c318e.slice/crio-dd2916ae071c51d9e23809061dc4c2d0764ad0a879fe6608c789fa6a6057565c WatchSource:0}: Error finding container dd2916ae071c51d9e23809061dc4c2d0764ad0a879fe6608c789fa6a6057565c: Status 404 returned error can't find the container with id dd2916ae071c51d9e23809061dc4c2d0764ad0a879fe6608c789fa6a6057565c
Sep 19 11:40:04.421855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:04.421769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-tddnf" event={"ID":"51fa9b95-30a7-4bd3-9518-f7afd19c318e","Type":"ContainerStarted","Data":"dd2916ae071c51d9e23809061dc4c2d0764ad0a879fe6608c789fa6a6057565c"}
Sep 19 11:40:04.423022 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:04.422996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2" event={"ID":"56688282-390b-4166-95b1-a3bf13b77c07","Type":"ContainerStarted","Data":"2623462d013a412ab6ecc28abf4cdb9d4addd17881ed43898db0a946f194a258"}
Sep 19 11:40:07.443308 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:07.443270    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2" event={"ID":"56688282-390b-4166-95b1-a3bf13b77c07","Type":"ContainerStarted","Data":"dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e"}
Sep 19 11:40:07.443736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:07.443437    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:07.445031 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:07.445007    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-tddnf" event={"ID":"51fa9b95-30a7-4bd3-9518-f7afd19c318e","Type":"ContainerStarted","Data":"ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0"}
Sep 19 11:40:07.445119 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:07.445058    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:07.463103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:07.463062    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2" podStartSLOduration=2.798797853 podStartE2EDuration="5.463048572s" totalImagesPullingTime="2.664250719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:40:07.463015565 +0000 UTC m=+378.480052277" watchObservedRunningTime="2026-09-19 11:40:07.463048572 +0000 UTC m=+378.480085283"
Sep 19 11:40:07.483616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:07.483558    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b54d84f7b-tddnf" podStartSLOduration=1.987929423 podStartE2EDuration="4.483540316s" totalImagesPullingTime="2.495610893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:40:07.483077423 +0000 UTC m=+378.500114134" watchObservedRunningTime="2026-09-19 11:40:07.483540316 +0000 UTC m=+378.500577037"
Sep 19 11:40:16.710784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.710746    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5f8f5b78-wll2k"]
Sep 19 11:40:16.714129 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.714109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.716712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.716694    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-26r9q\""
Sep 19 11:40:16.716827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.716693    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 11:40:16.717671 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.717649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 11:40:16.717793 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.717677    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 11:40:16.717793 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.717724    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 11:40:16.717993 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.717977    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 11:40:16.722015 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.721995    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 11:40:16.724253 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.724232    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5f8f5b78-wll2k"]
Sep 19 11:40:16.812890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.812862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-config\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.813043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.812902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-serving-cert\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.813043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.812952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-oauth-serving-cert\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.813043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.812970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvk2\" (UniqueName: \"kubernetes.io/projected/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-kube-api-access-wrvk2\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.813043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.812992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-oauth-config\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.813186 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.813052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-trusted-ca-bundle\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.813186 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.813083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-service-ca\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.913697 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.913663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-oauth-config\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.913867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.913717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-trusted-ca-bundle\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.913867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.913755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-service-ca\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.913867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.913782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-config\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.913937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-serving-cert\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.914009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-oauth-serving-cert\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.914042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvk2\" (UniqueName: \"kubernetes.io/projected/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-kube-api-access-wrvk2\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914602 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.914577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-service-ca\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.914628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-config\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.914707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-oauth-serving-cert\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.914839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.914742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-trusted-ca-bundle\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.916238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.916213    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-serving-cert\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.916355 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.916218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-console-oauth-config\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:16.921839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:16.921819    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvk2\" (UniqueName: \"kubernetes.io/projected/e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d-kube-api-access-wrvk2\") pod \"console-7d5f8f5b78-wll2k\" (UID: \"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d\") " pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:17.024112 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:17.024078    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:17.295270 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:17.295222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5f8f5b78-wll2k"]
Sep 19 11:40:17.297849 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:40:17.297819    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61e8ec5_b7c7_4918_bf49_e6091c7b2e0d.slice/crio-72d8d078105e3a4ced7fdf54bcfdf49aa535fc44c59d8d22a84748617f14973f WatchSource:0}: Error finding container 72d8d078105e3a4ced7fdf54bcfdf49aa535fc44c59d8d22a84748617f14973f: Status 404 returned error can't find the container with id 72d8d078105e3a4ced7fdf54bcfdf49aa535fc44c59d8d22a84748617f14973f
Sep 19 11:40:17.495439 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:17.495404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5f8f5b78-wll2k" event={"ID":"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d","Type":"ContainerStarted","Data":"60ca7b6c7a006997b1fef2a90970e5c0999c69b370af702c5c93a0619e379eb6"}
Sep 19 11:40:17.495606 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:17.495455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5f8f5b78-wll2k" event={"ID":"e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d","Type":"ContainerStarted","Data":"72d8d078105e3a4ced7fdf54bcfdf49aa535fc44c59d8d22a84748617f14973f"}
Sep 19 11:40:17.512311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:17.512264    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d5f8f5b78-wll2k" podStartSLOduration=1.512251037 podStartE2EDuration="1.512251037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:40:17.511294358 +0000 UTC m=+388.528331072" watchObservedRunningTime="2026-09-19 11:40:17.512251037 +0000 UTC m=+388.529287747"
Sep 19 11:40:18.452711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.452675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:18.453173 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.452752    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 11:40:18.517386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.517100    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6df5dfb9-2hzr2"]
Sep 19 11:40:18.522536 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.522481    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2" podUID="56688282-390b-4166-95b1-a3bf13b77c07" containerName="manager" containerID="cri-o://dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e" gracePeriod=30
Sep 19 11:40:18.758819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.758797    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:18.832606 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.832580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert\") pod \"56688282-390b-4166-95b1-a3bf13b77c07\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") "
Sep 19 11:40:18.832606 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.832610    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzz6d\" (UniqueName: \"kubernetes.io/projected/56688282-390b-4166-95b1-a3bf13b77c07-kube-api-access-pzz6d\") pod \"56688282-390b-4166-95b1-a3bf13b77c07\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") "
Sep 19 11:40:18.832834 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.832668    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs\") pod \"56688282-390b-4166-95b1-a3bf13b77c07\" (UID: \"56688282-390b-4166-95b1-a3bf13b77c07\") "
Sep 19 11:40:18.834825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.834794    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "56688282-390b-4166-95b1-a3bf13b77c07" (UID: "56688282-390b-4166-95b1-a3bf13b77c07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:40:18.834825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.834814    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56688282-390b-4166-95b1-a3bf13b77c07-kube-api-access-pzz6d" (OuterVolumeSpecName: "kube-api-access-pzz6d") pod "56688282-390b-4166-95b1-a3bf13b77c07" (UID: "56688282-390b-4166-95b1-a3bf13b77c07"). InnerVolumeSpecName "kube-api-access-pzz6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:40:18.835034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.834815    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "56688282-390b-4166-95b1-a3bf13b77c07" (UID: "56688282-390b-4166-95b1-a3bf13b77c07"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:40:18.933800 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.933772    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-webhook-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:40:18.933800 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.933798    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzz6d\" (UniqueName: \"kubernetes.io/projected/56688282-390b-4166-95b1-a3bf13b77c07-kube-api-access-pzz6d\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:40:18.934002 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:18.933807    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56688282-390b-4166-95b1-a3bf13b77c07-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:40:19.527851 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.527813    2582 generic.go:356] "Generic (PLEG): container finished" podID="56688282-390b-4166-95b1-a3bf13b77c07" containerID="dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e" exitCode=0
Sep 19 11:40:19.528286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.527860    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2"
Sep 19 11:40:19.528286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.527859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2" event={"ID":"56688282-390b-4166-95b1-a3bf13b77c07","Type":"ContainerDied","Data":"dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e"}
Sep 19 11:40:19.528286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.527939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6df5dfb9-2hzr2" event={"ID":"56688282-390b-4166-95b1-a3bf13b77c07","Type":"ContainerDied","Data":"2623462d013a412ab6ecc28abf4cdb9d4addd17881ed43898db0a946f194a258"}
Sep 19 11:40:19.528286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.527967    2582 scope.go:117] "RemoveContainer" containerID="dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e"
Sep 19 11:40:19.537103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.537086    2582 scope.go:117] "RemoveContainer" containerID="dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e"
Sep 19 11:40:19.537372 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:19.537351    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e\": container with ID starting with dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e not found: ID does not exist" containerID="dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e"
Sep 19 11:40:19.537435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.537380    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e"} err="failed to get container status \"dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e\": rpc error: code = NotFound desc = could not find container \"dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e\": container with ID starting with dc52b551f4eba8562e9f2f31ec521fc24982ec07e18d14f7d0b006cda3acd49e not found: ID does not exist"
Sep 19 11:40:19.547953 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.547909    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6df5dfb9-2hzr2"]
Sep 19 11:40:19.551749 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:19.551729    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c6df5dfb9-2hzr2"]
Sep 19 11:40:21.542775 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:21.542740    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56688282-390b-4166-95b1-a3bf13b77c07" path="/var/lib/kubelet/pods/56688282-390b-4166-95b1-a3bf13b77c07/volumes"
Sep 19 11:40:27.024305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:27.024273    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:27.024676 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:27.024324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:27.029223 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:27.029203    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:27.567519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:27.567493    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d5f8f5b78-wll2k"
Sep 19 11:40:38.848638 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:38.848599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:40:47.529482 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.529445    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fww29 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": read tcp 10.133.0.2:46708->10.133.0.22:15021: read: connection reset by peer" start-of-body=
Sep 19 11:40:47.529850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.529547    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podUID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": read tcp 10.133.0.2:46708->10.133.0.22:15021: read: connection reset by peer"
Sep 19 11:40:47.559586 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.559559    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-kwpvc"]
Sep 19 11:40:47.559910 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.559898    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56688282-390b-4166-95b1-a3bf13b77c07" containerName="manager"
Sep 19 11:40:47.559972 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.559944    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="56688282-390b-4166-95b1-a3bf13b77c07" containerName="manager"
Sep 19 11:40:47.560008 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.560002    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="56688282-390b-4166-95b1-a3bf13b77c07" containerName="manager"
Sep 19 11:40:47.562795 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.562777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:47.568383 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.568361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-kwpvc"]
Sep 19 11:40:47.662827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.662761    2582 generic.go:356] "Generic (PLEG): container finished" podID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerID="7d6388ecebedd749798e6f94f1928dec9cd40b3694f6f0ed810b62528c65d3ff" exitCode=0
Sep 19 11:40:47.662827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.662802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" event={"ID":"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7","Type":"ContainerDied","Data":"7d6388ecebedd749798e6f94f1928dec9cd40b3694f6f0ed810b62528c65d3ff"}
Sep 19 11:40:47.663208 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.663189    2582 scope.go:117] "RemoveContainer" containerID="7d6388ecebedd749798e6f94f1928dec9cd40b3694f6f0ed810b62528c65d3ff"
Sep 19 11:40:47.664316 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.664289    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:40:47.664384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.664356    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:40:47.664433 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.664387    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:40:47.688749 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.688724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnkg\" (UniqueName: \"kubernetes.io/projected/2482365b-316e-485c-a4eb-116c40154858-kube-api-access-8tnkg\") pod \"authorino-557f876f69-kwpvc\" (UID: \"2482365b-316e-485c-a4eb-116c40154858\") " pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:47.689266 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.689240    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6649958464-bn9m5"]
Sep 19 11:40:47.694183 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.694164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.696655 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.696638    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 19 11:40:47.696762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.696680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g4wpl\""
Sep 19 11:40:47.696762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.696638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 11:40:47.696884 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.696650    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 11:40:47.696884 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.696813    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 11:40:47.702401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.702209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6649958464-bn9m5"]
Sep 19 11:40:47.789708 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.789623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-maas-api-tls\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.789866 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.789773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-metrics-certs\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.789866 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.789830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksn54\" (UniqueName: \"kubernetes.io/projected/41e6c4b1-c7d3-4869-a7e5-012004cd047d-kube-api-access-ksn54\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.790027 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.789909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41e6c4b1-c7d3-4869-a7e5-012004cd047d-openshift-service-ca\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.790027 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.789990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnkg\" (UniqueName: \"kubernetes.io/projected/2482365b-316e-485c-a4eb-116c40154858-kube-api-access-8tnkg\") pod \"authorino-557f876f69-kwpvc\" (UID: \"2482365b-316e-485c-a4eb-116c40154858\") " pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:47.798265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.798222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnkg\" (UniqueName: \"kubernetes.io/projected/2482365b-316e-485c-a4eb-116c40154858-kube-api-access-8tnkg\") pod \"authorino-557f876f69-kwpvc\" (UID: \"2482365b-316e-485c-a4eb-116c40154858\") " pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:47.820876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.820821    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kwpvc"]
Sep 19 11:40:47.821134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.821117    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:47.845609 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.845579    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b696b768d-wszk9"]
Sep 19 11:40:47.850284 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.850246    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:47.853466 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.853440    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 19 11:40:47.858063 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.857975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b696b768d-wszk9"]
Sep 19 11:40:47.891574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.891261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/73076cb7-6f9a-4685-bb78-68582db6fd1e-tls-cert\") pod \"authorino-6b696b768d-wszk9\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") " pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:47.891574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.891317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksn54\" (UniqueName: \"kubernetes.io/projected/41e6c4b1-c7d3-4869-a7e5-012004cd047d-kube-api-access-ksn54\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.891574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.891388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41e6c4b1-c7d3-4869-a7e5-012004cd047d-openshift-service-ca\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.891574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.891442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-maas-api-tls\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.891574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.891488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgt82\" (UniqueName: \"kubernetes.io/projected/73076cb7-6f9a-4685-bb78-68582db6fd1e-kube-api-access-qgt82\") pod \"authorino-6b696b768d-wszk9\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") " pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:47.891574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.891554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-metrics-certs\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.894061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.892733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41e6c4b1-c7d3-4869-a7e5-012004cd047d-openshift-service-ca\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.895128 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.894807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-metrics-certs\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.896726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.896665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-maas-api-tls\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.900249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.900215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksn54\" (UniqueName: \"kubernetes.io/projected/41e6c4b1-c7d3-4869-a7e5-012004cd047d-kube-api-access-ksn54\") pod \"maas-api-6649958464-bn9m5\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") " pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:47.992491 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.992459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgt82\" (UniqueName: \"kubernetes.io/projected/73076cb7-6f9a-4685-bb78-68582db6fd1e-kube-api-access-qgt82\") pod \"authorino-6b696b768d-wszk9\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") " pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:47.992663 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.992525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/73076cb7-6f9a-4685-bb78-68582db6fd1e-tls-cert\") pod \"authorino-6b696b768d-wszk9\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") " pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:47.995138 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.995117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/73076cb7-6f9a-4685-bb78-68582db6fd1e-tls-cert\") pod \"authorino-6b696b768d-wszk9\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") " pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:47.999969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:47.999946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgt82\" (UniqueName: \"kubernetes.io/projected/73076cb7-6f9a-4685-bb78-68582db6fd1e-kube-api-access-qgt82\") pod \"authorino-6b696b768d-wszk9\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") " pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:48.019561 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.019540    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:48.102678 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.102654    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kwpvc"]
Sep 19 11:40:48.105331 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:40:48.105303    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2482365b_316e_485c_a4eb_116c40154858.slice/crio-60840e1eff14f87357441953ff0775565431f0415d552d1093d7a6d20b1b2c37 WatchSource:0}: Error finding container 60840e1eff14f87357441953ff0775565431f0415d552d1093d7a6d20b1b2c37: Status 404 returned error can't find the container with id 60840e1eff14f87357441953ff0775565431f0415d552d1093d7a6d20b1b2c37
Sep 19 11:40:48.163806 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.163768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:40:48.292939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.291676    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6649958464-bn9m5"]
Sep 19 11:40:48.300452 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:40:48.300416    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e6c4b1_c7d3_4869_a7e5_012004cd047d.slice/crio-b1efb732985758e2959daa8542e41770572c26ab72def4cff8603380c7c501fa WatchSource:0}: Error finding container b1efb732985758e2959daa8542e41770572c26ab72def4cff8603380c7c501fa: Status 404 returned error can't find the container with id b1efb732985758e2959daa8542e41770572c26ab72def4cff8603380c7c501fa
Sep 19 11:40:48.444831 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.444804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b696b768d-wszk9"]
Sep 19 11:40:48.446533 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:40:48.446495    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73076cb7_6f9a_4685_bb78_68582db6fd1e.slice/crio-455b37bb1f8ddcba5229a16b88c383f8208cace719559a4d1e834e9aeb22f780 WatchSource:0}: Error finding container 455b37bb1f8ddcba5229a16b88c383f8208cace719559a4d1e834e9aeb22f780: Status 404 returned error can't find the container with id 455b37bb1f8ddcba5229a16b88c383f8208cace719559a4d1e834e9aeb22f780
Sep 19 11:40:48.669089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.669056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b696b768d-wszk9" event={"ID":"73076cb7-6f9a-4685-bb78-68582db6fd1e","Type":"ContainerStarted","Data":"455b37bb1f8ddcba5229a16b88c383f8208cace719559a4d1e834e9aeb22f780"}
Sep 19 11:40:48.670249 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.670219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-kwpvc" event={"ID":"2482365b-316e-485c-a4eb-116c40154858","Type":"ContainerStarted","Data":"60840e1eff14f87357441953ff0775565431f0415d552d1093d7a6d20b1b2c37"}
Sep 19 11:40:48.672423 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.672388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" event={"ID":"2c535113-61e5-4185-9cbe-d9c7aaa6ccd7","Type":"ContainerStarted","Data":"f06804efaa0665c0a4dfa906d7db2ac76f741b6d0ba97c58e51ba7dc171dfbea"}
Sep 19 11:40:48.674627 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.674600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5" event={"ID":"41e6c4b1-c7d3-4869-a7e5-012004cd047d","Type":"ContainerStarted","Data":"b1efb732985758e2959daa8542e41770572c26ab72def4cff8603380c7c501fa"}
Sep 19 11:40:48.794441 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.794400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:40:48.794726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.794464    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fww29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Sep 19 11:40:48.796054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:48.794872    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podUID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Sep 19 11:40:49.702944 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:49.702836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b696b768d-wszk9" event={"ID":"73076cb7-6f9a-4685-bb78-68582db6fd1e","Type":"ContainerStarted","Data":"b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db"}
Sep 19 11:40:49.717858 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:49.717798    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b696b768d-wszk9" podStartSLOduration=2.241466312 podStartE2EDuration="2.717777522s" totalImagesPullingTime="476.31121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:40:49.71709314 +0000 UTC m=+420.734129851" watchObservedRunningTime="2026-09-19 11:40:49.717777522 +0000 UTC m=+420.734814234"
Sep 19 11:40:49.744450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:49.744411    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9bdss"]
Sep 19 11:40:49.744640 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:49.744611    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-9bdss" podUID="2dd61254-e4d9-47f2-8028-99f83f1fb01b" containerName="authorino" containerID="cri-o://f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd" gracePeriod=30
Sep 19 11:40:49.798061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:49.797019    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fww29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Sep 19 11:40:49.798061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:49.797087    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podUID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Sep 19 11:40:50.208952 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.208909    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:40:50.215130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.215103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr26b\" (UniqueName: \"kubernetes.io/projected/2dd61254-e4d9-47f2-8028-99f83f1fb01b-kube-api-access-cr26b\") pod \"2dd61254-e4d9-47f2-8028-99f83f1fb01b\" (UID: \"2dd61254-e4d9-47f2-8028-99f83f1fb01b\") "
Sep 19 11:40:50.217049 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.217017    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd61254-e4d9-47f2-8028-99f83f1fb01b-kube-api-access-cr26b" (OuterVolumeSpecName: "kube-api-access-cr26b") pod "2dd61254-e4d9-47f2-8028-99f83f1fb01b" (UID: "2dd61254-e4d9-47f2-8028-99f83f1fb01b"). InnerVolumeSpecName "kube-api-access-cr26b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:40:50.316556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.316481    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr26b\" (UniqueName: \"kubernetes.io/projected/2dd61254-e4d9-47f2-8028-99f83f1fb01b-kube-api-access-cr26b\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:40:50.710643 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.710524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5" event={"ID":"41e6c4b1-c7d3-4869-a7e5-012004cd047d","Type":"ContainerStarted","Data":"36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520"}
Sep 19 11:40:50.711115 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.710718    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:50.712000 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.711978    2582 generic.go:356] "Generic (PLEG): container finished" podID="2dd61254-e4d9-47f2-8028-99f83f1fb01b" containerID="f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd" exitCode=0
Sep 19 11:40:50.712085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.712008    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9bdss"
Sep 19 11:40:50.712085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.712022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9bdss" event={"ID":"2dd61254-e4d9-47f2-8028-99f83f1fb01b","Type":"ContainerDied","Data":"f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd"}
Sep 19 11:40:50.712085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.712067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9bdss" event={"ID":"2dd61254-e4d9-47f2-8028-99f83f1fb01b","Type":"ContainerDied","Data":"f425aba1af5244232a538f1fd93a386a2e2e656317d34a5295e3b2279899488f"}
Sep 19 11:40:50.712244 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.712090    2582 scope.go:117] "RemoveContainer" containerID="f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd"
Sep 19 11:40:50.720815 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.720787    2582 scope.go:117] "RemoveContainer" containerID="f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd"
Sep 19 11:40:50.721207 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:50.721181    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd\": container with ID starting with f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd not found: ID does not exist" containerID="f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd"
Sep 19 11:40:50.721306 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.721212    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd"} err="failed to get container status \"f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd\": rpc error: code = NotFound desc = could not find container \"f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd\": container with ID starting with f65875178578547a81d58be01ac15cf4598a767a4f05693db13a0d788c3156bd not found: ID does not exist"
Sep 19 11:40:50.728690 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.728648    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5" podStartSLOduration=1.957825809 podStartE2EDuration="3.728633287s" totalImagesPullingTime="1.770807478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:40:50.727833493 +0000 UTC m=+421.744870205" watchObservedRunningTime="2026-09-19 11:40:50.728633287 +0000 UTC m=+421.745669990"
Sep 19 11:40:50.745149 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.745127    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9bdss"]
Sep 19 11:40:50.749417 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.749394    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9bdss"]
Sep 19 11:40:50.789114 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.788636    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fww29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Sep 19 11:40:50.789114 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:50.788698    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podUID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Sep 19 11:40:51.544644 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:51.544612    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd61254-e4d9-47f2-8028-99f83f1fb01b" path="/var/lib/kubelet/pods/2dd61254-e4d9-47f2-8028-99f83f1fb01b/volumes"
Sep 19 11:40:51.787939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:51.787884    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fww29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Sep 19 11:40:51.788393 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:51.787967    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podUID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Sep 19 11:40:52.788592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:52.788546    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fww29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Sep 19 11:40:52.789102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:52.788622    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29" podUID="2c535113-61e5-4185-9cbe-d9c7aaa6ccd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Sep 19 11:40:53.791876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:53.791844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:40:53.792259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:53.792153    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:40:53.792792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:53.792776    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fww29"
Sep 19 11:40:55.744586 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:55.744547    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-kwpvc" event={"ID":"2482365b-316e-485c-a4eb-116c40154858","Type":"ContainerStarted","Data":"974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038"}
Sep 19 11:40:55.745115 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:55.744618    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-kwpvc" podUID="2482365b-316e-485c-a4eb-116c40154858" containerName="authorino" containerID="cri-o://974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038" gracePeriod=30
Sep 19 11:40:55.759272 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:55.759226    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-kwpvc" podStartSLOduration=1.942823929 podStartE2EDuration="8.759209881s" totalImagesPullingTime="6.816385952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:40:55.757804707 +0000 UTC m=+426.774841416" watchObservedRunningTime="2026-09-19 11:40:55.759209881 +0000 UTC m=+426.776246593"
Sep 19 11:40:55.998275 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:55.998210    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:56.068631 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.068592    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tnkg\" (UniqueName: \"kubernetes.io/projected/2482365b-316e-485c-a4eb-116c40154858-kube-api-access-8tnkg\") pod \"2482365b-316e-485c-a4eb-116c40154858\" (UID: \"2482365b-316e-485c-a4eb-116c40154858\") "
Sep 19 11:40:56.070692 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.070669    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2482365b-316e-485c-a4eb-116c40154858-kube-api-access-8tnkg" (OuterVolumeSpecName: "kube-api-access-8tnkg") pod "2482365b-316e-485c-a4eb-116c40154858" (UID: "2482365b-316e-485c-a4eb-116c40154858"). InnerVolumeSpecName "kube-api-access-8tnkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:40:56.170051 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.170023    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tnkg\" (UniqueName: \"kubernetes.io/projected/2482365b-316e-485c-a4eb-116c40154858-kube-api-access-8tnkg\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:40:56.723819 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.723788    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 11:40:56.758995 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.758958    2582 generic.go:356] "Generic (PLEG): container finished" podID="2482365b-316e-485c-a4eb-116c40154858" containerID="974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038" exitCode=0
Sep 19 11:40:56.759401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.759018    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kwpvc"
Sep 19 11:40:56.759401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.759043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-kwpvc" event={"ID":"2482365b-316e-485c-a4eb-116c40154858","Type":"ContainerDied","Data":"974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038"}
Sep 19 11:40:56.759401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.759091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-kwpvc" event={"ID":"2482365b-316e-485c-a4eb-116c40154858","Type":"ContainerDied","Data":"60840e1eff14f87357441953ff0775565431f0415d552d1093d7a6d20b1b2c37"}
Sep 19 11:40:56.759401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.759112    2582 scope.go:117] "RemoveContainer" containerID="974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038"
Sep 19 11:40:56.769702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.769686    2582 scope.go:117] "RemoveContainer" containerID="974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038"
Sep 19 11:40:56.770024 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:40:56.770004    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038\": container with ID starting with 974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038 not found: ID does not exist" containerID="974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038"
Sep 19 11:40:56.770103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.770035    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038"} err="failed to get container status \"974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038\": rpc error: code = NotFound desc = could not find container \"974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038\": container with ID starting with 974be06a1f3b1266c9ec76c1840e520d8ed7bc5a0e8c5b2e17651e3b82327038 not found: ID does not exist"
Sep 19 11:40:56.787175 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.787152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kwpvc"]
Sep 19 11:40:56.795239 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:56.795215    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-kwpvc"]
Sep 19 11:40:57.543998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:40:57.543965    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2482365b-316e-485c-a4eb-116c40154858" path="/var/lib/kubelet/pods/2482365b-316e-485c-a4eb-116c40154858/volumes"
Sep 19 11:41:03.643635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.643598    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"]
Sep 19 11:41:03.644132 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.644116    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd61254-e4d9-47f2-8028-99f83f1fb01b" containerName="authorino"
Sep 19 11:41:03.644201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.644136    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd61254-e4d9-47f2-8028-99f83f1fb01b" containerName="authorino"
Sep 19 11:41:03.644201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.644151    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2482365b-316e-485c-a4eb-116c40154858" containerName="authorino"
Sep 19 11:41:03.644201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.644160    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2482365b-316e-485c-a4eb-116c40154858" containerName="authorino"
Sep 19 11:41:03.644317 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.644246    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd61254-e4d9-47f2-8028-99f83f1fb01b" containerName="authorino"
Sep 19 11:41:03.644317 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.644259    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2482365b-316e-485c-a4eb-116c40154858" containerName="authorino"
Sep 19 11:41:03.649071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.649053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.651777 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.651748    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 11:41:03.652027 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.652006    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 11:41:03.652631 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.652612    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6gh2s\""
Sep 19 11:41:03.652710 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.652649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 19 11:41:03.657325 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.657304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"]
Sep 19 11:41:03.731518 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.731491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.731661 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.731526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.731661 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.731580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.731661 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.731608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.731661 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.731642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c248ef2d-da7a-4774-aa44-2a485355832b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.731797 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.731675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xghg\" (UniqueName: \"kubernetes.io/projected/c248ef2d-da7a-4774-aa44-2a485355832b-kube-api-access-8xghg\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.832620 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.832589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c248ef2d-da7a-4774-aa44-2a485355832b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.832796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.832631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xghg\" (UniqueName: \"kubernetes.io/projected/c248ef2d-da7a-4774-aa44-2a485355832b-kube-api-access-8xghg\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.832796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.832669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.832796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.832686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.832796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.832723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.832796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.832756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.833152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.833125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.833265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.833192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.833315 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.833294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.835095 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.835076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c248ef2d-da7a-4774-aa44-2a485355832b-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.835278 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.835262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c248ef2d-da7a-4774-aa44-2a485355832b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.840273 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.840252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xghg\" (UniqueName: \"kubernetes.io/projected/c248ef2d-da7a-4774-aa44-2a485355832b-kube-api-access-8xghg\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4\" (UID: \"c248ef2d-da7a-4774-aa44-2a485355832b\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:03.960781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:03.960701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:04.232614 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:04.232587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"]
Sep 19 11:41:04.234989 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:41:04.234959    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc248ef2d_da7a_4774_aa44_2a485355832b.slice/crio-de28e1ebb1bc901fc79755191cc2709de8fe5ae71a16f9becef37f6c3395e66b WatchSource:0}: Error finding container de28e1ebb1bc901fc79755191cc2709de8fe5ae71a16f9becef37f6c3395e66b: Status 404 returned error can't find the container with id de28e1ebb1bc901fc79755191cc2709de8fe5ae71a16f9becef37f6c3395e66b
Sep 19 11:41:04.341036 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:04.340997    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:41:04.802739 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:04.802696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4" event={"ID":"c248ef2d-da7a-4774-aa44-2a485355832b","Type":"ContainerStarted","Data":"de28e1ebb1bc901fc79755191cc2709de8fe5ae71a16f9becef37f6c3395e66b"}
Sep 19 11:41:05.811621 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:05.811593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4" event={"ID":"c248ef2d-da7a-4774-aa44-2a485355832b","Type":"ContainerStarted","Data":"129a53c1e5d62944a99e6cb9aa473fa63211858e1b63ecdba07e1b67b072ecb4"}
Sep 19 11:41:05.828778 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:05.828730    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4" podStartSLOduration=1.641665916 podStartE2EDuration="2.828715681s" totalImagesPullingTime="1.187049765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:41:05.826358928 +0000 UTC m=+436.843395641" watchObservedRunningTime="2026-09-19 11:41:05.828715681 +0000 UTC m=+436.845752392"
Sep 19 11:41:05.961034 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:05.961002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:13.961121 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:13.961039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:13.973105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:13.973079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:14.865603 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:14.865577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4"
Sep 19 11:41:25.239686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:25.239648    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:41:39.848108 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:39.848073    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:41:47.644114 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:47.644078    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:41:59.821694 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.821659    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"]
Sep 19 11:41:59.826486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.826461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:41:59.829017 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.828904    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 19 11:41:59.834313 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.834291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"]
Sep 19 11:41:59.931508 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.931476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:41:59.931655 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.931532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:41:59.931655 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.931602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:41:59.931655 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.931635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:41:59.931655 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.931651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3bb4da-6dde-498f-9647-c2def272b6ef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:41:59.931809 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:41:59.931672    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6ph\" (UniqueName: \"kubernetes.io/projected/9e3bb4da-6dde-498f-9647-c2def272b6ef-kube-api-access-4g6ph\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.032820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.032784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.032820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.032826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.032844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3bb4da-6dde-498f-9647-c2def272b6ef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.032865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6ph\" (UniqueName: \"kubernetes.io/projected/9e3bb4da-6dde-498f-9647-c2def272b6ef-kube-api-access-4g6ph\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.032992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.033045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033326 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.033307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033388 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.033362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.033448 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.033398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.035263 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.035243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3bb4da-6dde-498f-9647-c2def272b6ef-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.035560 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.035536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3bb4da-6dde-498f-9647-c2def272b6ef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.040631 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.040609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6ph\" (UniqueName: \"kubernetes.io/projected/9e3bb4da-6dde-498f-9647-c2def272b6ef-kube-api-access-4g6ph\") pod \"facebook-opt-125m-simulated-kserve-89945f574-6dtxd\" (UID: \"9e3bb4da-6dde-498f-9647-c2def272b6ef\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.140017 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.139947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:00.412730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:00.412700    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"]
Sep 19 11:42:00.413940 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:42:00.413892    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3bb4da_6dde_498f_9647_c2def272b6ef.slice/crio-1d997db821321b4a3956b34c76489164cb02bc458bd1be12ca8aa1b0cd218ba9 WatchSource:0}: Error finding container 1d997db821321b4a3956b34c76489164cb02bc458bd1be12ca8aa1b0cd218ba9: Status 404 returned error can't find the container with id 1d997db821321b4a3956b34c76489164cb02bc458bd1be12ca8aa1b0cd218ba9
Sep 19 11:42:01.090073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:01.090039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd" event={"ID":"9e3bb4da-6dde-498f-9647-c2def272b6ef","Type":"ContainerStarted","Data":"4e621ce2a3fda8d9ac744e8d20eb02012ccd8a34c28eef1e68d290f95b9d9418"}
Sep 19 11:42:01.090429 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:01.090101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd" event={"ID":"9e3bb4da-6dde-498f-9647-c2def272b6ef","Type":"ContainerStarted","Data":"1d997db821321b4a3956b34c76489164cb02bc458bd1be12ca8aa1b0cd218ba9"}
Sep 19 11:42:01.109149 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:01.109093    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd" podStartSLOduration=1.938496855 podStartE2EDuration="2.109078153s" totalImagesPullingTime="170.581298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:42:01.10705865 +0000 UTC m=+492.124095364" watchObservedRunningTime="2026-09-19 11:42:01.109078153 +0000 UTC m=+492.126114864"
Sep 19 11:42:01.140152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:01.140130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:02.843225 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:02.843188    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:42:10.140963 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:10.140928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:10.153608 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:10.153583    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:11.150021 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:11.149994    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-6dtxd"
Sep 19 11:42:13.039940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.039887    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"]
Sep 19 11:42:13.043852 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.043829    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.046114 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.046096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 19 11:42:13.053753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.053729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"]
Sep 19 11:42:13.147854 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.147826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.148050 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.147866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.148050 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.147987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.148050 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.148022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxcwx\" (UniqueName: \"kubernetes.io/projected/f25ac8c7-2946-4403-930e-46bd81317799-kube-api-access-jxcwx\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.148218 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.148062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.148218 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.148132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25ac8c7-2946-4403-930e-46bd81317799-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxcwx\" (UniqueName: \"kubernetes.io/projected/f25ac8c7-2946-4403-930e-46bd81317799-kube-api-access-jxcwx\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25ac8c7-2946-4403-930e-46bd81317799-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249670 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.249670 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.249625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.251560 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.251536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25ac8c7-2946-4403-930e-46bd81317799-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.251723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.251704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25ac8c7-2946-4403-930e-46bd81317799-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.256212 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.256193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxcwx\" (UniqueName: \"kubernetes.io/projected/f25ac8c7-2946-4403-930e-46bd81317799-kube-api-access-jxcwx\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q\" (UID: \"f25ac8c7-2946-4403-930e-46bd81317799\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.354268 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.354190    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:13.627814 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:13.627787    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"]
Sep 19 11:42:13.629482 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:42:13.629447    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf25ac8c7_2946_4403_930e_46bd81317799.slice/crio-aeaf2185dfbad223d7900b9fe57da5453a36c222e14065bd5ea61dfbbdf6c7b2 WatchSource:0}: Error finding container aeaf2185dfbad223d7900b9fe57da5453a36c222e14065bd5ea61dfbbdf6c7b2: Status 404 returned error can't find the container with id aeaf2185dfbad223d7900b9fe57da5453a36c222e14065bd5ea61dfbbdf6c7b2
Sep 19 11:42:14.156669 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:14.156634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q" event={"ID":"f25ac8c7-2946-4403-930e-46bd81317799","Type":"ContainerStarted","Data":"b04d2443aae931ffb0025d51f62f8887c0bfa54bfb54d340a9d67bde4266dd53"}
Sep 19 11:42:14.156669 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:14.156675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q" event={"ID":"f25ac8c7-2946-4403-930e-46bd81317799","Type":"ContainerStarted","Data":"aeaf2185dfbad223d7900b9fe57da5453a36c222e14065bd5ea61dfbbdf6c7b2"}
Sep 19 11:42:14.174295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:14.174251    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q" podStartSLOduration=1.018748298 podStartE2EDuration="1.17423607s" totalImagesPullingTime="155.487772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:42:14.171559153 +0000 UTC m=+505.188595863" watchObservedRunningTime="2026-09-19 11:42:14.17423607 +0000 UTC m=+505.191272781"
Sep 19 11:42:14.354487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:14.354457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:16.542927 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:16.542878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:42:23.355131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:23.355095    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:23.367405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:23.367384    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:42:24.218891 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:42:24.218863    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q"
Sep 19 11:43:17.370332 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.370299    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-694b4547c-rljvc"]
Sep 19 11:43:17.374051 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.374031    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.380265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.380238    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-694b4547c-rljvc"]
Sep 19 11:43:17.439965 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.439933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c374c840-4955-4650-9df9-ede24d121ae8-tls-cert\") pod \"authorino-694b4547c-rljvc\" (UID: \"c374c840-4955-4650-9df9-ede24d121ae8\") " pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.440130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.439979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hfx\" (UniqueName: \"kubernetes.io/projected/c374c840-4955-4650-9df9-ede24d121ae8-kube-api-access-w6hfx\") pod \"authorino-694b4547c-rljvc\" (UID: \"c374c840-4955-4650-9df9-ede24d121ae8\") " pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.540515 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.540482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c374c840-4955-4650-9df9-ede24d121ae8-tls-cert\") pod \"authorino-694b4547c-rljvc\" (UID: \"c374c840-4955-4650-9df9-ede24d121ae8\") " pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.540515 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.540515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hfx\" (UniqueName: \"kubernetes.io/projected/c374c840-4955-4650-9df9-ede24d121ae8-kube-api-access-w6hfx\") pod \"authorino-694b4547c-rljvc\" (UID: \"c374c840-4955-4650-9df9-ede24d121ae8\") " pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.543000 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.542975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c374c840-4955-4650-9df9-ede24d121ae8-tls-cert\") pod \"authorino-694b4547c-rljvc\" (UID: \"c374c840-4955-4650-9df9-ede24d121ae8\") " pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.547559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.547538    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hfx\" (UniqueName: \"kubernetes.io/projected/c374c840-4955-4650-9df9-ede24d121ae8-kube-api-access-w6hfx\") pod \"authorino-694b4547c-rljvc\" (UID: \"c374c840-4955-4650-9df9-ede24d121ae8\") " pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.684961 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.684857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-694b4547c-rljvc"
Sep 19 11:43:17.951408 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:17.951376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-694b4547c-rljvc"]
Sep 19 11:43:17.953154 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:43:17.953126    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc374c840_4955_4650_9df9_ede24d121ae8.slice/crio-5e9a651236ccfe00e269ab3ef2dd0a4e84262a82442c9a5c0724aad865311e4a WatchSource:0}: Error finding container 5e9a651236ccfe00e269ab3ef2dd0a4e84262a82442c9a5c0724aad865311e4a: Status 404 returned error can't find the container with id 5e9a651236ccfe00e269ab3ef2dd0a4e84262a82442c9a5c0724aad865311e4a
Sep 19 11:43:18.479047 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:18.479011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694b4547c-rljvc" event={"ID":"c374c840-4955-4650-9df9-ede24d121ae8","Type":"ContainerStarted","Data":"5e9a651236ccfe00e269ab3ef2dd0a4e84262a82442c9a5c0724aad865311e4a"}
Sep 19 11:43:19.487176 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.487130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-694b4547c-rljvc" event={"ID":"c374c840-4955-4650-9df9-ede24d121ae8","Type":"ContainerStarted","Data":"d595cbc3077ab153eb7190036648dca3334020198a8ba8dc97f734c8f4e6a249"}
Sep 19 11:43:19.505344 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.505281    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-694b4547c-rljvc" podStartSLOduration=1.623979191 podStartE2EDuration="2.505260081s" totalImagesPullingTime="881.28089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:43:19.504439536 +0000 UTC m=+570.521476246" watchObservedRunningTime="2026-09-19 11:43:19.505260081 +0000 UTC m=+570.522296794"
Sep 19 11:43:19.533544 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.533510    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b696b768d-wszk9"]
Sep 19 11:43:19.533970 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.533897    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6b696b768d-wszk9" podUID="73076cb7-6f9a-4685-bb78-68582db6fd1e" containerName="authorino" containerID="cri-o://b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db" gracePeriod=30
Sep 19 11:43:19.793541 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.793512    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:43:19.862544 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.862503    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgt82\" (UniqueName: \"kubernetes.io/projected/73076cb7-6f9a-4685-bb78-68582db6fd1e-kube-api-access-qgt82\") pod \"73076cb7-6f9a-4685-bb78-68582db6fd1e\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") "
Sep 19 11:43:19.862726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.862568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/73076cb7-6f9a-4685-bb78-68582db6fd1e-tls-cert\") pod \"73076cb7-6f9a-4685-bb78-68582db6fd1e\" (UID: \"73076cb7-6f9a-4685-bb78-68582db6fd1e\") "
Sep 19 11:43:19.864600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.864568    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73076cb7-6f9a-4685-bb78-68582db6fd1e-kube-api-access-qgt82" (OuterVolumeSpecName: "kube-api-access-qgt82") pod "73076cb7-6f9a-4685-bb78-68582db6fd1e" (UID: "73076cb7-6f9a-4685-bb78-68582db6fd1e"). InnerVolumeSpecName "kube-api-access-qgt82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:43:19.872923 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.872878    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73076cb7-6f9a-4685-bb78-68582db6fd1e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "73076cb7-6f9a-4685-bb78-68582db6fd1e" (UID: "73076cb7-6f9a-4685-bb78-68582db6fd1e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:43:19.964228 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.964190    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgt82\" (UniqueName: \"kubernetes.io/projected/73076cb7-6f9a-4685-bb78-68582db6fd1e-kube-api-access-qgt82\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:43:19.964228 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:19.964221    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/73076cb7-6f9a-4685-bb78-68582db6fd1e-tls-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:43:20.494575 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.494540    2582 generic.go:356] "Generic (PLEG): container finished" podID="73076cb7-6f9a-4685-bb78-68582db6fd1e" containerID="b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db" exitCode=0
Sep 19 11:43:20.495045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.494602    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b696b768d-wszk9"
Sep 19 11:43:20.495045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.494623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b696b768d-wszk9" event={"ID":"73076cb7-6f9a-4685-bb78-68582db6fd1e","Type":"ContainerDied","Data":"b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db"}
Sep 19 11:43:20.495045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.494660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b696b768d-wszk9" event={"ID":"73076cb7-6f9a-4685-bb78-68582db6fd1e","Type":"ContainerDied","Data":"455b37bb1f8ddcba5229a16b88c383f8208cace719559a4d1e834e9aeb22f780"}
Sep 19 11:43:20.495045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.494681    2582 scope.go:117] "RemoveContainer" containerID="b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db"
Sep 19 11:43:20.503499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.503483    2582 scope.go:117] "RemoveContainer" containerID="b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db"
Sep 19 11:43:20.503784 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:43:20.503764    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db\": container with ID starting with b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db not found: ID does not exist" containerID="b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db"
Sep 19 11:43:20.503852 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.503792    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db"} err="failed to get container status \"b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db\": rpc error: code = NotFound desc = could not find container \"b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db\": container with ID starting with b59e984057cc69136018f75fccb29c3ed3cca9b12300a90708c4b4ecde2db2db not found: ID does not exist"
Sep 19 11:43:20.518748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.518721    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b696b768d-wszk9"]
Sep 19 11:43:20.522259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:20.522237    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b696b768d-wszk9"]
Sep 19 11:43:21.543826 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:21.543793    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73076cb7-6f9a-4685-bb78-68582db6fd1e" path="/var/lib/kubelet/pods/73076cb7-6f9a-4685-bb78-68582db6fd1e/volumes"
Sep 19 11:43:39.084523 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.084485    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"]
Sep 19 11:43:39.085083 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.085065    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73076cb7-6f9a-4685-bb78-68582db6fd1e" containerName="authorino"
Sep 19 11:43:39.085140 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.085088    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="73076cb7-6f9a-4685-bb78-68582db6fd1e" containerName="authorino"
Sep 19 11:43:39.085195 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.085183    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="73076cb7-6f9a-4685-bb78-68582db6fd1e" containerName="authorino"
Sep 19 11:43:39.090212 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.090190    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.092703 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.092681    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-333f49-openshift-default-dockercfg-s7dgs\""
Sep 19 11:43:39.098853 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.098819    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"]
Sep 19 11:43:39.245081 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf5v5\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-kube-api-access-wf5v5\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc265c8-88ed-45e7-a764-635300710093-istiod-ca-cert\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc265c8-88ed-45e7-a764-635300710093-istio-podinfo\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-istio-token\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-credential-socket\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245483 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-data\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245483 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-socket\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245483 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-envoy\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.245483 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.245393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-certs\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.346976 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.346879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf5v5\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-kube-api-access-wf5v5\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.346976 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.346958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc265c8-88ed-45e7-a764-635300710093-istiod-ca-cert\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc265c8-88ed-45e7-a764-635300710093-istio-podinfo\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-istio-token\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-credential-socket\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-data\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-socket\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-envoy\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-certs\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.347827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-data\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.348033 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.347867    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-socket\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.348418 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.348341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-certs\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.348527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.348394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-credential-socket\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.348527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.348470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc265c8-88ed-45e7-a764-635300710093-istiod-ca-cert\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.350539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.350511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-envoy\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.351150 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.351131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc265c8-88ed-45e7-a764-635300710093-istio-podinfo\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.356193 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.356168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-istio-token\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.356343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.356321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf5v5\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-kube-api-access-wf5v5\") pod \"e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") " pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.404756 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.404723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:39.686825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.686796    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"]
Sep 19 11:43:39.689049 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:43:39.689020    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc265c8_88ed_45e7_a764_635300710093.slice/crio-e274612e2b3a97c8c372f9d17a188cbdbce43c93989660ae652fa6dca7524b39 WatchSource:0}: Error finding container e274612e2b3a97c8c372f9d17a188cbdbce43c93989660ae652fa6dca7524b39: Status 404 returned error can't find the container with id e274612e2b3a97c8c372f9d17a188cbdbce43c93989660ae652fa6dca7524b39
Sep 19 11:43:39.691930 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.691882    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:39.692058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.691969    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:39.692058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:39.692013    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:40.595697 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:40.595655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" event={"ID":"3fc265c8-88ed-45e7-a764-635300710093","Type":"ContainerStarted","Data":"81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"}
Sep 19 11:43:40.596207 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:40.595720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" event={"ID":"3fc265c8-88ed-45e7-a764-635300710093","Type":"ContainerStarted","Data":"e274612e2b3a97c8c372f9d17a188cbdbce43c93989660ae652fa6dca7524b39"}
Sep 19 11:43:40.627940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:40.627872    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podStartSLOduration=1.627857723 podStartE2EDuration="1.627857723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:43:40.625454507 +0000 UTC m=+591.642491218" watchObservedRunningTime="2026-09-19 11:43:40.627857723 +0000 UTC m=+591.644894434"
Sep 19 11:43:41.405547 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:41.405509    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:41.410539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:41.410513    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:41.600655 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:41.600618    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:41.601594 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:41.601575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:43:45.078118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:45.078074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:43:47.793134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.793090    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"]
Sep 19 11:43:47.797222 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.797196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.799598 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.799571    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cb615d6f-openshift-default-dockercfg-cl9k5\""
Sep 19 11:43:47.809167 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.809144    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"]
Sep 19 11:43:47.934224 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istiod-ca-cert\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934425 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-envoy\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934425 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dhb\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-kube-api-access-n2dhb\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-data\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-certs\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-podinfo\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-credential-socket\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-socket\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:47.934716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:47.934690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-token\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035388 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-certs\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035557 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-podinfo\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035557 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-credential-socket\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035557 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-socket\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035557 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-token\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035557 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istiod-ca-cert\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035557 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-envoy\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhb\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-kube-api-access-n2dhb\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.035883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.035654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-data\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.036042 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.036012    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-credential-socket\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.036104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.036069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-socket\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.036184 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.036164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-data\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.036238 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.036196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-certs\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.036389 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.036372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istiod-ca-cert\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.037903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.037880    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-envoy\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.038057 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.037949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-podinfo\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.044453 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.044390    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dhb\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-kube-api-access-n2dhb\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.045063 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.045042    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-token\") pod \"e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") " pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.111100 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.111070    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:48.347813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.347715    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"]
Sep 19 11:43:48.352046 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.352021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.354513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.354489    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-7a524f-openshift-default-dockercfg-7x5cs\""
Sep 19 11:43:48.363630 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.363605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"]
Sep 19 11:43:48.394389 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.394361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"]
Sep 19 11:43:48.395199 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:43:48.395174    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f50b1fc_bcaa_43c7_8344_109d7239da6c.slice/crio-d0769a78b60fcbe5b32afb8e1835add86bc7cfd0fac41cc232eb113a926b8b54 WatchSource:0}: Error finding container d0769a78b60fcbe5b32afb8e1835add86bc7cfd0fac41cc232eb113a926b8b54: Status 404 returned error can't find the container with id d0769a78b60fcbe5b32afb8e1835add86bc7cfd0fac41cc232eb113a926b8b54
Sep 19 11:43:48.397469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.397440    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:48.397547 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.397501    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:48.397547 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.397527    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:48.541195 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-certs\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541195 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-token\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4dm\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-kube-api-access-fz4dm\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-envoy\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-data\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-podinfo\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-credential-socket\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541696 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74895687-fb84-4fb6-943f-d2766dd70f9a-istiod-ca-cert\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.541696 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.541532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-socket\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.641772 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.641672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" event={"ID":"8f50b1fc-bcaa-43c7-8344-109d7239da6c","Type":"ContainerStarted","Data":"584f75ac6e298e1b1e947f71f1d35f9719dd66bc8da65934a8df42bce1e8bdd0"}
Sep 19 11:43:48.641772 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.641740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" event={"ID":"8f50b1fc-bcaa-43c7-8344-109d7239da6c","Type":"ContainerStarted","Data":"d0769a78b60fcbe5b32afb8e1835add86bc7cfd0fac41cc232eb113a926b8b54"}
Sep 19 11:43:48.642144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74895687-fb84-4fb6-943f-d2766dd70f9a-istiod-ca-cert\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-socket\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-certs\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-token\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4dm\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-kube-api-access-fz4dm\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-envoy\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-data\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-podinfo\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.642589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.642512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-credential-socket\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.643058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.643011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-certs\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.643173 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.643121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-credential-socket\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.643358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.643290    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-data\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.643471 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.643458    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-socket\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.643518 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.643475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74895687-fb84-4fb6-943f-d2766dd70f9a-istiod-ca-cert\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.645347 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.645326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-envoy\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.645668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.645648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-podinfo\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.650049 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.650022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-token\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.650266 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.650246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4dm\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-kube-api-access-fz4dm\") pod \"e2e-autores-7a524f-openshift-default-7df9788c44-szcgq\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") " pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.663473 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.663436    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" podStartSLOduration=1.663423834 podStartE2EDuration="1.663423834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:43:48.661221295 +0000 UTC m=+599.678258007" watchObservedRunningTime="2026-09-19 11:43:48.663423834 +0000 UTC m=+599.680460544"
Sep 19 11:43:48.665461 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.665440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:48.944487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.944455    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"]
Sep 19 11:43:48.945482 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:43:48.945458    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74895687_fb84_4fb6_943f_d2766dd70f9a.slice/crio-948d2f807953a88966c9b0e62d7e6f1e3b0f099e5a485c8e47129c889a74b180 WatchSource:0}: Error finding container 948d2f807953a88966c9b0e62d7e6f1e3b0f099e5a485c8e47129c889a74b180: Status 404 returned error can't find the container with id 948d2f807953a88966c9b0e62d7e6f1e3b0f099e5a485c8e47129c889a74b180
Sep 19 11:43:48.947870 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.947841    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:48.947969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.947901    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:48.947969 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:48.947947    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:43:49.111570 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.111490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:49.116899 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.116875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:49.648928 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.648870    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" event={"ID":"74895687-fb84-4fb6-943f-d2766dd70f9a","Type":"ContainerStarted","Data":"331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"}
Sep 19 11:43:49.649127 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.648958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" event={"ID":"74895687-fb84-4fb6-943f-d2766dd70f9a","Type":"ContainerStarted","Data":"948d2f807953a88966c9b0e62d7e6f1e3b0f099e5a485c8e47129c889a74b180"}
Sep 19 11:43:49.649203 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.649144    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:49.650300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.650278    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:43:49.666359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.666342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:49.669681 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:49.669644    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podStartSLOduration=1.669631546 podStartE2EDuration="1.669631546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:43:49.668402074 +0000 UTC m=+600.685438777" watchObservedRunningTime="2026-09-19 11:43:49.669631546 +0000 UTC m=+600.686668256"
Sep 19 11:43:50.671901 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:50.671871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:51.659224 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:51.659188    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:51.660235 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:51.660210    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:43:53.839199 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.839166    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"]
Sep 19 11:43:53.844077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.844054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:53.846816 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.846788    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-7a524f\""
Sep 19 11:43:53.846971 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.846828    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-7a524f-dockercfg-jpnvd\""
Sep 19 11:43:53.853787 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.853760    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"]
Sep 19 11:43:53.895265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.895221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d3cc9d-5498-4f97-9f3c-28690438745c-plugins-config-volume\") pod \"payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") " pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:53.895484 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.895309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9cqz\" (UniqueName: \"kubernetes.io/projected/88d3cc9d-5498-4f97-9f3c-28690438745c-kube-api-access-h9cqz\") pod \"payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") " pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:53.996017 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.995983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9cqz\" (UniqueName: \"kubernetes.io/projected/88d3cc9d-5498-4f97-9f3c-28690438745c-kube-api-access-h9cqz\") pod \"payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") " pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:53.996205 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.996134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d3cc9d-5498-4f97-9f3c-28690438745c-plugins-config-volume\") pod \"payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") " pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:53.996840 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:53.996816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d3cc9d-5498-4f97-9f3c-28690438745c-plugins-config-volume\") pod \"payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") " pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:54.005281 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.005224    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9cqz\" (UniqueName: \"kubernetes.io/projected/88d3cc9d-5498-4f97-9f3c-28690438745c-kube-api-access-h9cqz\") pod \"payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") " pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:54.156111 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.156014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:54.431793 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.431767    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"]
Sep 19 11:43:54.433415 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:43:54.433388    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d3cc9d_5498_4f97_9f3c_28690438745c.slice/crio-b526c884cb59c8e16b0eaeae876ce716383f1d6854d249a4fe1e0fcace739796 WatchSource:0}: Error finding container b526c884cb59c8e16b0eaeae876ce716383f1d6854d249a4fe1e0fcace739796: Status 404 returned error can't find the container with id b526c884cb59c8e16b0eaeae876ce716383f1d6854d249a4fe1e0fcace739796
Sep 19 11:43:54.680417 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.680385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr" event={"ID":"88d3cc9d-5498-4f97-9f3c-28690438745c","Type":"ContainerStarted","Data":"b526c884cb59c8e16b0eaeae876ce716383f1d6854d249a4fe1e0fcace739796"}
Sep 19 11:43:54.927282 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.927245    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"]
Sep 19 11:43:54.932702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.932672    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:54.935311 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.935110    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cb615d6f-serving-cert\""
Sep 19 11:43:54.947461 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:54.947430    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"]
Sep 19 11:43:55.007776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.007738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlnqn\" (UniqueName: \"kubernetes.io/projected/774282cf-95bb-43d2-88bb-09369fc858ce-kube-api-access-jlnqn\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.007977 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.007822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-maas-api-tls\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.007977 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.007946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-metrics-certs\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.008118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.008034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774282cf-95bb-43d2-88bb-09369fc858ce-openshift-service-ca\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.109307 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.109274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlnqn\" (UniqueName: \"kubernetes.io/projected/774282cf-95bb-43d2-88bb-09369fc858ce-kube-api-access-jlnqn\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.109307 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.109318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-maas-api-tls\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.109550 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.109522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-metrics-certs\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.109642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.109627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774282cf-95bb-43d2-88bb-09369fc858ce-openshift-service-ca\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.110522 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.110495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774282cf-95bb-43d2-88bb-09369fc858ce-openshift-service-ca\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.111798 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.111776    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-metrics-certs\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.111907 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.111891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-maas-api-tls\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.118728 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.118700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlnqn\" (UniqueName: \"kubernetes.io/projected/774282cf-95bb-43d2-88bb-09369fc858ce-kube-api-access-jlnqn\") pod \"maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.254861 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.254827    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:55.556804 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:55.556774    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"]
Sep 19 11:43:56.707087 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.706988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr" event={"ID":"88d3cc9d-5498-4f97-9f3c-28690438745c","Type":"ContainerStarted","Data":"1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c"}
Sep 19 11:43:56.707534 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.707243    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:43:56.709343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.709313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st" event={"ID":"774282cf-95bb-43d2-88bb-09369fc858ce","Type":"ContainerStarted","Data":"ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161"}
Sep 19 11:43:56.709486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.709363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st" event={"ID":"774282cf-95bb-43d2-88bb-09369fc858ce","Type":"ContainerStarted","Data":"29a7b8fba7a1bb50d5c6c67b723f126141cdfa0cbb2fed9084adb2bbeee160bd"}
Sep 19 11:43:56.709486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.709405    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:43:56.723537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.723489    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr" podStartSLOduration=2.116315782 podStartE2EDuration="3.723472415s" totalImagesPullingTime="1.607156633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:43:56.72240678 +0000 UTC m=+607.739443491" watchObservedRunningTime="2026-09-19 11:43:56.723472415 +0000 UTC m=+607.740509131"
Sep 19 11:43:56.738466 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:43:56.738414    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st" podStartSLOduration=2.377322072 podStartE2EDuration="2.738396954s" totalImagesPullingTime="361.074882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:43:56.73775001 +0000 UTC m=+607.754786720" watchObservedRunningTime="2026-09-19 11:43:56.738396954 +0000 UTC m=+607.755433665"
Sep 19 11:44:02.739038 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:02.739009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:44:02.939654 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:02.939605    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"]
Sep 19 11:44:02.944087 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:02.944064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:02.946532 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:02.946508    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d8d8bb-openshift-default-dockercfg-nz5b8\""
Sep 19 11:44:02.957549 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:02.957519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"]
Sep 19 11:44:03.010104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-envoy\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-socket\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-certs\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istiod-ca-cert\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-token\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-podinfo\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzj8\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-kube-api-access-sqzj8\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-credential-socket\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.010366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.010306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-data\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.111672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-socket\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.111850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-certs\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.111850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istiod-ca-cert\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.111850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-token\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-podinfo\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzj8\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-kube-api-access-sqzj8\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.111988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-credential-socket\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-data\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-socket\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-envoy\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112362 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-certs\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112423 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-credential-socket\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istiod-ca-cert\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.112585 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.112557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-data\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.114605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.114582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-podinfo\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.114738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.114715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-envoy\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.119892 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.119861    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-token\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.120491 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.120470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzj8\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-kube-api-access-sqzj8\") pod \"e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") " pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.257025 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.256990    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:03.535899 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.535869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"]
Sep 19 11:44:03.537392 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:44:03.537359    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5c8ee1_6df8_4371_b96a_6c0dc41463da.slice/crio-a6a06a14c0b62a69a9e52fe93ac80e1fccda25ce111fb71018ec329e8c060667 WatchSource:0}: Error finding container a6a06a14c0b62a69a9e52fe93ac80e1fccda25ce111fb71018ec329e8c060667: Status 404 returned error can't find the container with id a6a06a14c0b62a69a9e52fe93ac80e1fccda25ce111fb71018ec329e8c060667
Sep 19 11:44:03.539886 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.539853    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:03.539995 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.539934    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:03.539995 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.539967    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:03.772820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.772776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" event={"ID":"8a5c8ee1-6df8-4371-b96a-6c0dc41463da","Type":"ContainerStarted","Data":"7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"}
Sep 19 11:44:03.773353 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.772848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" event={"ID":"8a5c8ee1-6df8-4371-b96a-6c0dc41463da","Type":"ContainerStarted","Data":"a6a06a14c0b62a69a9e52fe93ac80e1fccda25ce111fb71018ec329e8c060667"}
Sep 19 11:44:03.797162 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:03.797051    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podStartSLOduration=1.797030464 podStartE2EDuration="1.797030464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:44:03.79231381 +0000 UTC m=+614.809350522" watchObservedRunningTime="2026-09-19 11:44:03.797030464 +0000 UTC m=+614.814067175"
Sep 19 11:44:04.257710 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.257681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:04.259302 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.259072    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 11:44:04.259302 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.259124    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 11:44:04.780196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.780162    2582 generic.go:356] "Generic (PLEG): container finished" podID="3fc265c8-88ed-45e7-a764-635300710093" containerID="81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b" exitCode=0
Sep 19 11:44:04.780582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.780235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" event={"ID":"3fc265c8-88ed-45e7-a764-635300710093","Type":"ContainerDied","Data":"81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"}
Sep 19 11:44:04.780713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.780697    2582 scope.go:117] "RemoveContainer" containerID="81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"
Sep 19 11:44:04.781863 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.781835    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:04.781966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.781906    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:04.782014 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:04.781963    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:05.262668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:05.262644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:05.795938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:05.794988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" event={"ID":"3fc265c8-88ed-45e7-a764-635300710093","Type":"ContainerStarted","Data":"205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee"}
Sep 19 11:44:05.796432 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:05.796313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:05.799967 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:05.798502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:06.405862 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:06.405827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:44:06.406112 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:06.406094    2582 patch_prober.go:28] interesting pod/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 11:44:06.406185 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:06.406150    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 11:44:07.405823 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:07.405782    2582 patch_prober.go:28] interesting pod/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 11:44:07.406278 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:07.405841    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 11:44:07.735629 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:07.735599    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:44:08.405604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:08.405570    2582 patch_prober.go:28] interesting pod/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 11:44:08.405794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:08.405635    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 11:44:09.406144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:09.406103    2582 patch_prober.go:28] interesting pod/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 11:44:09.406562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:09.406180    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 11:44:10.405497 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:10.405460    2582 patch_prober.go:28] interesting pod/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 19 11:44:10.405673 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:10.405535    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 19 11:44:11.263907 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:11.263861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:44:11.409844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:11.409815    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:44:11.410179 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:11.410160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:44:11.411027 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:11.411006    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:44:20.692105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:20.692057    2582 patch_prober.go:28] interesting pod/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 11:44:20.692476 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:20.692162    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" podUID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 11:44:20.796531 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:20.793554    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"]
Sep 19 11:44:20.796531 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:20.793784    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st" podUID="774282cf-95bb-43d2-88bb-09369fc858ce" containerName="maas-api" containerID="cri-o://ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161" gracePeriod=30
Sep 19 11:44:21.073129 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.073102    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:44:21.167715 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.167657    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"]
Sep 19 11:44:21.168360 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.168295    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" podUID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" containerName="istio-proxy" containerID="cri-o://584f75ac6e298e1b1e947f71f1d35f9719dd66bc8da65934a8df42bce1e8bdd0" gracePeriod=30
Sep 19 11:44:21.221317 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.221282    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-metrics-certs\") pod \"774282cf-95bb-43d2-88bb-09369fc858ce\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") "
Sep 19 11:44:21.221516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.221371    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774282cf-95bb-43d2-88bb-09369fc858ce-openshift-service-ca\") pod \"774282cf-95bb-43d2-88bb-09369fc858ce\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") "
Sep 19 11:44:21.221516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.221433    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlnqn\" (UniqueName: \"kubernetes.io/projected/774282cf-95bb-43d2-88bb-09369fc858ce-kube-api-access-jlnqn\") pod \"774282cf-95bb-43d2-88bb-09369fc858ce\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") "
Sep 19 11:44:21.221637 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.221517    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-maas-api-tls\") pod \"774282cf-95bb-43d2-88bb-09369fc858ce\" (UID: \"774282cf-95bb-43d2-88bb-09369fc858ce\") "
Sep 19 11:44:21.222266 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.222210    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774282cf-95bb-43d2-88bb-09369fc858ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "774282cf-95bb-43d2-88bb-09369fc858ce" (UID: "774282cf-95bb-43d2-88bb-09369fc858ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:44:21.224865 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.224813    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "774282cf-95bb-43d2-88bb-09369fc858ce" (UID: "774282cf-95bb-43d2-88bb-09369fc858ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:44:21.224865 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.224837    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774282cf-95bb-43d2-88bb-09369fc858ce-kube-api-access-jlnqn" (OuterVolumeSpecName: "kube-api-access-jlnqn") pod "774282cf-95bb-43d2-88bb-09369fc858ce" (UID: "774282cf-95bb-43d2-88bb-09369fc858ce"). InnerVolumeSpecName "kube-api-access-jlnqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:44:21.225359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.225325    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "774282cf-95bb-43d2-88bb-09369fc858ce" (UID: "774282cf-95bb-43d2-88bb-09369fc858ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:44:21.322500 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.322467    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774282cf-95bb-43d2-88bb-09369fc858ce-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:21.322500 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.322497    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlnqn\" (UniqueName: \"kubernetes.io/projected/774282cf-95bb-43d2-88bb-09369fc858ce-kube-api-access-jlnqn\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:21.322500 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.322508    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:21.322781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.322516    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774282cf-95bb-43d2-88bb-09369fc858ce-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:21.904806 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.904719    2582 generic.go:356] "Generic (PLEG): container finished" podID="774282cf-95bb-43d2-88bb-09369fc858ce" containerID="ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161" exitCode=0
Sep 19 11:44:21.904806 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.904799    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"
Sep 19 11:44:21.905283 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.904811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st" event={"ID":"774282cf-95bb-43d2-88bb-09369fc858ce","Type":"ContainerDied","Data":"ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161"}
Sep 19 11:44:21.905283 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.904867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st" event={"ID":"774282cf-95bb-43d2-88bb-09369fc858ce","Type":"ContainerDied","Data":"29a7b8fba7a1bb50d5c6c67b723f126141cdfa0cbb2fed9084adb2bbeee160bd"}
Sep 19 11:44:21.905283 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.904891    2582 scope.go:117] "RemoveContainer" containerID="ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161"
Sep 19 11:44:21.915051 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.915027    2582 scope.go:117] "RemoveContainer" containerID="ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161"
Sep 19 11:44:21.915385 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:44:21.915364    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161\": container with ID starting with ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161 not found: ID does not exist" containerID="ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161"
Sep 19 11:44:21.915477 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.915392    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161"} err="failed to get container status \"ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161\": rpc error: code = NotFound desc = could not find container \"ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161\": container with ID starting with ff1bc5d54dea6ba96fb8181cac522107cbd2a94fcd2c9a58224c2d6d5e7f6161 not found: ID does not exist"
Sep 19 11:44:21.927345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.927320    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"]
Sep 19 11:44:21.929814 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:21.929789    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb615d6f-694bf5c56c-5q4st"]
Sep 19 11:44:22.147327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.146557    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"]
Sep 19 11:44:22.147327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.147200    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774282cf-95bb-43d2-88bb-09369fc858ce" containerName="maas-api"
Sep 19 11:44:22.147327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.147220    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="774282cf-95bb-43d2-88bb-09369fc858ce" containerName="maas-api"
Sep 19 11:44:22.147327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.147317    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="774282cf-95bb-43d2-88bb-09369fc858ce" containerName="maas-api"
Sep 19 11:44:22.152723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.152696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.155399 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.155316    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9cf8a188-gw-openshift-default-dockercfg-xdv5z\""
Sep 19 11:44:22.164570 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.164458    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"]
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20998af-8e78-43e7-be07-791d93d3a43d-istio-podinfo\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-credential-socket\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255585    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-certs\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20998af-8e78-43e7-be07-791d93d3a43d-istiod-ca-cert\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-data\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p57r\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-kube-api-access-4p57r\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-envoy\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-socket\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.255938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.255830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-istio-token\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.356850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.356811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20998af-8e78-43e7-be07-791d93d3a43d-istio-podinfo\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.356880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-credential-socket\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.356936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-certs\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.356977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20998af-8e78-43e7-be07-791d93d3a43d-istiod-ca-cert\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-data\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p57r\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-kube-api-access-4p57r\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-envoy\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-socket\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-istio-token\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-credential-socket\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357586 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357369    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-certs\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.357896 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.357871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-socket\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.358159 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.358121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-data\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.358273 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.358197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20998af-8e78-43e7-be07-791d93d3a43d-istiod-ca-cert\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.359620 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.359599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-envoy\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.360050 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.360035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20998af-8e78-43e7-be07-791d93d3a43d-istio-podinfo\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.365125 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.365093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-istio-token\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.366258 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.366234    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p57r\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-kube-api-access-4p57r\") pod \"e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") " pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.468354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.468269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:22.701091 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.701051    2582 patch_prober.go:28] interesting pod/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 11:44:22.701253 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.701121    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 11:44:22.760168 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.760139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"]
Sep 19 11:44:22.761067 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:44:22.761028    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20998af_8e78_43e7_be07_791d93d3a43d.slice/crio-ab00f87bb7caaeac178d849810430b583ff638322c544f1ce461cde5e03331cd WatchSource:0}: Error finding container ab00f87bb7caaeac178d849810430b583ff638322c544f1ce461cde5e03331cd: Status 404 returned error can't find the container with id ab00f87bb7caaeac178d849810430b583ff638322c544f1ce461cde5e03331cd
Sep 19 11:44:22.764160 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.764123    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:22.764248 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.764204    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:22.764288 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.764244    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:22.915526 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.915423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" event={"ID":"d20998af-8e78-43e7-be07-791d93d3a43d","Type":"ContainerStarted","Data":"904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"}
Sep 19 11:44:22.915526 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.915489    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" event={"ID":"d20998af-8e78-43e7-be07-791d93d3a43d","Type":"ContainerStarted","Data":"ab00f87bb7caaeac178d849810430b583ff638322c544f1ce461cde5e03331cd"}
Sep 19 11:44:22.918509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.918481    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" containerID="584f75ac6e298e1b1e947f71f1d35f9719dd66bc8da65934a8df42bce1e8bdd0" exitCode=0
Sep 19 11:44:22.918648 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.918558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" event={"ID":"8f50b1fc-bcaa-43c7-8344-109d7239da6c","Type":"ContainerDied","Data":"584f75ac6e298e1b1e947f71f1d35f9719dd66bc8da65934a8df42bce1e8bdd0"}
Sep 19 11:44:22.937274 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:22.937209    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podStartSLOduration=0.937188882 podStartE2EDuration="937.188882ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:44:22.936011812 +0000 UTC m=+633.953048535" watchObservedRunningTime="2026-09-19 11:44:22.937188882 +0000 UTC m=+633.954225594"
Sep 19 11:44:23.047302 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.047204    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:44:23.166562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166530    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2dhb\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-kube-api-access-n2dhb\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166616    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-certs\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-token\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166689    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-envoy\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-credential-socket\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-podinfo\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166814    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-socket\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166867    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istiod-ca-cert\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-data\") pod \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\" (UID: \"8f50b1fc-bcaa-43c7-8344-109d7239da6c\") "
Sep 19 11:44:23.166990 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.166964    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:44:23.167499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.167233    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:44:23.167499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.167421    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.167499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.167442    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.167499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.167454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:44:23.167499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.167466    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:44:23.167804 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.167655    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:44:23.169424 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.169383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-kube-api-access-n2dhb" (OuterVolumeSpecName: "kube-api-access-n2dhb") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "kube-api-access-n2dhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:44:23.169712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.169652    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:44:23.169712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.169676    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:44:23.169712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.169690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f50b1fc-bcaa-43c7-8344-109d7239da6c" (UID: "8f50b1fc-bcaa-43c7-8344-109d7239da6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:44:23.268430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268395    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.268430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268425    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.268430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268434    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.269370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268442    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.269370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268452    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.269370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268459    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f50b1fc-bcaa-43c7-8344-109d7239da6c-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.269370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.268471    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2dhb\" (UniqueName: \"kubernetes.io/projected/8f50b1fc-bcaa-43c7-8344-109d7239da6c-kube-api-access-n2dhb\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:44:23.469378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.469294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:23.474709 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.474683    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:23.544410 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.544335    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774282cf-95bb-43d2-88bb-09369fc858ce" path="/var/lib/kubelet/pods/774282cf-95bb-43d2-88bb-09369fc858ce/volumes"
Sep 19 11:44:23.931513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.931425    2582 generic.go:356] "Generic (PLEG): container finished" podID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerID="331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4" exitCode=0
Sep 19 11:44:23.933713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.932162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" event={"ID":"74895687-fb84-4fb6-943f-d2766dd70f9a","Type":"ContainerDied","Data":"331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"}
Sep 19 11:44:23.933713 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.932687    2582 scope.go:117] "RemoveContainer" containerID="331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"
Sep 19 11:44:23.934721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.934677    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:23.934890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.934791    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:23.934890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.934852    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:23.936405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.936239    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"
Sep 19 11:44:23.936405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.936274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl" event={"ID":"8f50b1fc-bcaa-43c7-8344-109d7239da6c","Type":"ContainerDied","Data":"d0769a78b60fcbe5b32afb8e1835add86bc7cfd0fac41cc232eb113a926b8b54"}
Sep 19 11:44:23.936405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.936322    2582 scope.go:117] "RemoveContainer" containerID="584f75ac6e298e1b1e947f71f1d35f9719dd66bc8da65934a8df42bce1e8bdd0"
Sep 19 11:44:23.937905 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.936908    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:23.940460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.940406    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:23.970621 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.970591    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"]
Sep 19 11:44:23.974105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:23.974051    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cb615d6f-openshift-default-7fdb6559b6-2v2wl"]
Sep 19 11:44:24.945135 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:24.945102    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" event={"ID":"74895687-fb84-4fb6-943f-d2766dd70f9a","Type":"ContainerStarted","Data":"0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff"}
Sep 19 11:44:25.544218 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:25.544188    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" path="/var/lib/kubelet/pods/8f50b1fc-bcaa-43c7-8344-109d7239da6c/volumes"
Sep 19 11:44:25.665768 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:25.665731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:44:25.665978 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:25.665957    2582 patch_prober.go:28] interesting pod/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 11:44:25.666042 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:25.666024    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 11:44:26.666214 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:26.666179    2582 patch_prober.go:28] interesting pod/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 11:44:26.666718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:26.666233    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 11:44:27.666684 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:27.666605    2582 patch_prober.go:28] interesting pod/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 11:44:27.666684 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:27.666671    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 11:44:28.163690 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.163655    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"]
Sep 19 11:44:28.164083 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.164070    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" containerName="istio-proxy"
Sep 19 11:44:28.164150 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.164084    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" containerName="istio-proxy"
Sep 19 11:44:28.164150 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.164143    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f50b1fc-bcaa-43c7-8344-109d7239da6c" containerName="istio-proxy"
Sep 19 11:44:28.166375 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.166358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.168769 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.168745    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-9cf8a188\""
Sep 19 11:44:28.176838 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.176278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"]
Sep 19 11:44:28.238861 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.238823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44cns\" (UniqueName: \"kubernetes.io/projected/e06387cd-ed0c-4b51-a141-dcf5d039a18d-kube-api-access-44cns\") pod \"payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") " pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.239242 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.239219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06387cd-ed0c-4b51-a141-dcf5d039a18d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") " pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.342101 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.340562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44cns\" (UniqueName: \"kubernetes.io/projected/e06387cd-ed0c-4b51-a141-dcf5d039a18d-kube-api-access-44cns\") pod \"payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") " pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.342101 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.340723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06387cd-ed0c-4b51-a141-dcf5d039a18d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") " pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.342101 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.341663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06387cd-ed0c-4b51-a141-dcf5d039a18d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") " pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.350162 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.350133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44cns\" (UniqueName: \"kubernetes.io/projected/e06387cd-ed0c-4b51-a141-dcf5d039a18d-kube-api-access-44cns\") pod \"payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") " pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.486470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.486429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.665821 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.665789    2582 patch_prober.go:28] interesting pod/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 11:44:28.666029 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.665844    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 11:44:28.806365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.792089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"]
Sep 19 11:44:28.970323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.970207    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf" event={"ID":"e06387cd-ed0c-4b51-a141-dcf5d039a18d","Type":"ContainerStarted","Data":"778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069"}
Sep 19 11:44:28.970323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.970265    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf" event={"ID":"e06387cd-ed0c-4b51-a141-dcf5d039a18d","Type":"ContainerStarted","Data":"720c10134a4173fd519ee16fcc0e1afd0f0aa5d9b90971910c62eb6fd31f08f5"}
Sep 19 11:44:28.970323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.970294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:28.993405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:28.993345    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf" podStartSLOduration=0.993323312 podStartE2EDuration="993.323312ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:44:28.987674526 +0000 UTC m=+640.004711254" watchObservedRunningTime="2026-09-19 11:44:28.993323312 +0000 UTC m=+640.010360024"
Sep 19 11:44:29.666173 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:29.666135    2582 patch_prober.go:28] interesting pod/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 19 11:44:29.666348 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:29.666192    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 19 11:44:30.669740 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:30.669711    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:44:30.670146 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:30.670030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:44:30.670801 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:30.670783    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:44:33.761540 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:33.761504    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:44:34.020128 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:34.020044    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerID="7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812" exitCode=0
Sep 19 11:44:34.020324 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:34.020116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" event={"ID":"8a5c8ee1-6df8-4371-b96a-6c0dc41463da","Type":"ContainerDied","Data":"7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"}
Sep 19 11:44:34.020658 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:34.020639    2582 scope.go:117] "RemoveContainer" containerID="7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"
Sep 19 11:44:34.022025 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:34.021989    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:34.022151 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:34.022081    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:34.022151 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:34.022122    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:35.027509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:35.027472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" event={"ID":"8a5c8ee1-6df8-4371-b96a-6c0dc41463da","Type":"ContainerStarted","Data":"593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e"}
Sep 19 11:44:35.257640 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:35.257604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:35.258773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:35.258751    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 11:44:35.258845 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:35.258797    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 11:44:35.796708 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:35.796670    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:36.258318 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:36.258288    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 11:44:36.258705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:36.258341    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 11:44:37.257580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:37.257535    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 11:44:37.257750 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:37.257621    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 11:44:38.258397 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:38.258362    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 11:44:38.258783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:38.258417    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 11:44:39.258202 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:39.258160    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 19 11:44:39.258382 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:39.258222    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 19 11:44:39.981130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:39.981094    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:44:40.306758 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:40.306665    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:40.308101 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:40.308071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:44:45.088250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:45.088217    2582 generic.go:356] "Generic (PLEG): container finished" podID="d20998af-8e78-43e7-be07-791d93d3a43d" containerID="904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1" exitCode=0
Sep 19 11:44:45.088758 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:45.088296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" event={"ID":"d20998af-8e78-43e7-be07-791d93d3a43d","Type":"ContainerDied","Data":"904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"}
Sep 19 11:44:45.088826 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:45.088798    2582 scope.go:117] "RemoveContainer" containerID="904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"
Sep 19 11:44:45.090023 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:45.089983    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:45.090131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:45.090064    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:45.090131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:45.090098    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:44:46.104308 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:46.104272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" event={"ID":"d20998af-8e78-43e7-be07-791d93d3a43d","Type":"ContainerStarted","Data":"d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17"}
Sep 19 11:44:46.469084 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:46.468995    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:46.469345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:46.469321    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 19 11:44:46.469435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:46.469377    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 19 11:44:47.469462 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:47.469430    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 19 11:44:47.469851 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:47.469502    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 19 11:44:48.469528 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:48.469494    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 19 11:44:48.469907 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:48.469560    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 19 11:44:49.468979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:49.468955    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 19 11:44:49.469054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:49.469009    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 19 11:44:50.469213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:50.469180    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 19 11:44:50.469611 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:50.469236    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 19 11:44:51.469131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:51.469093    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 19 11:44:51.469303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:51.469155    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 19 11:44:52.473267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:52.473238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:52.473696 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:52.473535    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:44:52.474305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:44:52.474289    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:45:00.141652 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.141616    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"]
Sep 19 11:45:00.147306 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.147283    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"]
Sep 19 11:45:00.147425 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.147389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"
Sep 19 11:45:00.149694 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.149666    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnlmc\""
Sep 19 11:45:00.151829 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.151796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"
Sep 19 11:45:00.155324 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.155302    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"]
Sep 19 11:45:00.158505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.158485    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"]
Sep 19 11:45:00.162851 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.162830    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"
Sep 19 11:45:00.164121 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.164099    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"]
Sep 19 11:45:00.170120 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.170101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"
Sep 19 11:45:00.171002 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.170977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"
Sep 19 11:45:00.175202 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.175175    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"]
Sep 19 11:45:00.223800 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.223776    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"
Sep 19 11:45:00.450256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.450225    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"]
Sep 19 11:45:00.451601 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:00.451576    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1145a6_4d4e_4f81_a512_f89a1c9e640a.slice/crio-c2c94c771fa188dcacd4406280e9a65e40f1d09358c465fc5d947a73f5698f92 WatchSource:0}: Error finding container c2c94c771fa188dcacd4406280e9a65e40f1d09358c465fc5d947a73f5698f92: Status 404 returned error can't find the container with id c2c94c771fa188dcacd4406280e9a65e40f1d09358c465fc5d947a73f5698f92
Sep 19 11:45:00.453609 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.453585    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:45:00.477941 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.477903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"]
Sep 19 11:45:00.479168 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:00.479145    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5504cf4_e4d2_4150_a252_f378f5ba91f8.slice/crio-641d2ef27893c7bc1412601e234ba04e5ab490da7181eb848d150e41809034e3 WatchSource:0}: Error finding container 641d2ef27893c7bc1412601e234ba04e5ab490da7181eb848d150e41809034e3: Status 404 returned error can't find the container with id 641d2ef27893c7bc1412601e234ba04e5ab490da7181eb848d150e41809034e3
Sep 19 11:45:00.517348 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:00.517326    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"]
Sep 19 11:45:00.517903 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:00.517881    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511b4d49_1ffd_48fb_aaae_ec9d7151354f.slice/crio-955d04f106c6249d949606dce19c31d6e7300ac4a72550ade99b9ec5aaf705aa WatchSource:0}: Error finding container 955d04f106c6249d949606dce19c31d6e7300ac4a72550ade99b9ec5aaf705aa: Status 404 returned error can't find the container with id 955d04f106c6249d949606dce19c31d6e7300ac4a72550ade99b9ec5aaf705aa
Sep 19 11:45:01.215118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:01.215081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7" event={"ID":"511b4d49-1ffd-48fb-aaae-ec9d7151354f","Type":"ContainerStarted","Data":"955d04f106c6249d949606dce19c31d6e7300ac4a72550ade99b9ec5aaf705aa"}
Sep 19 11:45:01.217355 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:01.217324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96" event={"ID":"b5504cf4-e4d2-4150-a252-f378f5ba91f8","Type":"ContainerStarted","Data":"641d2ef27893c7bc1412601e234ba04e5ab490da7181eb848d150e41809034e3"}
Sep 19 11:45:01.219307 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:01.219283    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw" event={"ID":"0b1145a6-4d4e-4f81-a512-f89a1c9e640a","Type":"ContainerStarted","Data":"c2c94c771fa188dcacd4406280e9a65e40f1d09358c465fc5d947a73f5698f92"}
Sep 19 11:45:03.232548 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:03.232517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7" event={"ID":"511b4d49-1ffd-48fb-aaae-ec9d7151354f","Type":"ContainerStarted","Data":"d2406c61a4c6e04c7594d6ce561a57de80ea3170fd57c099762e8932ddf106f1"}
Sep 19 11:45:03.234124 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:03.234094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96" event={"ID":"b5504cf4-e4d2-4150-a252-f378f5ba91f8","Type":"ContainerStarted","Data":"5fb2ce2e4fbcdfab303e59b38ff0bf0e6c73541d42868d36d19877cf2537ea01"}
Sep 19 11:45:03.235616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:03.235592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw" event={"ID":"0b1145a6-4d4e-4f81-a512-f89a1c9e640a","Type":"ContainerStarted","Data":"3e8bc15d5f1ce3e3c1dafb7a111cfa14c59ea57d988798908ca3a5a7795c87e4"}
Sep 19 11:45:03.266723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:03.266661    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96" podStartSLOduration=1.183866179 podStartE2EDuration="3.266643765s" totalImagesPullingTime="2.082777586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:03.263943442 +0000 UTC m=+674.280980153" watchObservedRunningTime="2026-09-19 11:45:03.266643765 +0000 UTC m=+674.283680480"
Sep 19 11:45:03.266890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:03.266749    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7" podStartSLOduration=1.227602052 podStartE2EDuration="3.266742072s" totalImagesPullingTime="2.03914002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:03.245756503 +0000 UTC m=+674.262793215" watchObservedRunningTime="2026-09-19 11:45:03.266742072 +0000 UTC m=+674.283778783"
Sep 19 11:45:03.277504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:03.277451    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw" podStartSLOduration=1.172342602 podStartE2EDuration="3.277414022s" totalImagesPullingTime="2.10507142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:03.276636102 +0000 UTC m=+674.293672814" watchObservedRunningTime="2026-09-19 11:45:03.277414022 +0000 UTC m=+674.294450808"
Sep 19 11:45:04.242131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:04.242092    2582 generic.go:356] "Generic (PLEG): container finished" podID="511b4d49-1ffd-48fb-aaae-ec9d7151354f" containerID="d2406c61a4c6e04c7594d6ce561a57de80ea3170fd57c099762e8932ddf106f1" exitCode=0
Sep 19 11:45:04.242538 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:04.242142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7" event={"ID":"511b4d49-1ffd-48fb-aaae-ec9d7151354f","Type":"ContainerDied","Data":"d2406c61a4c6e04c7594d6ce561a57de80ea3170fd57c099762e8932ddf106f1"}
Sep 19 11:45:04.243640 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:04.243615    2582 generic.go:356] "Generic (PLEG): container finished" podID="b5504cf4-e4d2-4150-a252-f378f5ba91f8" containerID="5fb2ce2e4fbcdfab303e59b38ff0bf0e6c73541d42868d36d19877cf2537ea01" exitCode=0
Sep 19 11:45:04.243770 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:04.243693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96" event={"ID":"b5504cf4-e4d2-4150-a252-f378f5ba91f8","Type":"ContainerDied","Data":"5fb2ce2e4fbcdfab303e59b38ff0bf0e6c73541d42868d36d19877cf2537ea01"}
Sep 19 11:45:04.245302 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:04.245282    2582 generic.go:356] "Generic (PLEG): container finished" podID="0b1145a6-4d4e-4f81-a512-f89a1c9e640a" containerID="3e8bc15d5f1ce3e3c1dafb7a111cfa14c59ea57d988798908ca3a5a7795c87e4" exitCode=0
Sep 19 11:45:04.245409 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:04.245358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw" event={"ID":"0b1145a6-4d4e-4f81-a512-f89a1c9e640a","Type":"ContainerDied","Data":"3e8bc15d5f1ce3e3c1dafb7a111cfa14c59ea57d988798908ca3a5a7795c87e4"}
Sep 19 11:45:05.397159 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:05.397130    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"
Sep 19 11:45:05.444373 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:05.444349    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"
Sep 19 11:45:05.474197 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:05.474170    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"
Sep 19 11:45:05.962989 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:05.962884    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"]
Sep 19 11:45:05.963202 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:05.963169    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf" podUID="e06387cd-ed0c-4b51-a141-dcf5d039a18d" containerName="payload-processing" containerID="cri-o://778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069" gracePeriod=30
Sep 19 11:45:06.203507 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.203479    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:45:06.260937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.260889    2582 generic.go:356] "Generic (PLEG): container finished" podID="e06387cd-ed0c-4b51-a141-dcf5d039a18d" containerID="778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069" exitCode=0
Sep 19 11:45:06.261103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.260951    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"
Sep 19 11:45:06.261103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.260950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf" event={"ID":"e06387cd-ed0c-4b51-a141-dcf5d039a18d","Type":"ContainerDied","Data":"778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069"}
Sep 19 11:45:06.261103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.261014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf" event={"ID":"e06387cd-ed0c-4b51-a141-dcf5d039a18d","Type":"ContainerDied","Data":"720c10134a4173fd519ee16fcc0e1afd0f0aa5d9b90971910c62eb6fd31f08f5"}
Sep 19 11:45:06.261103 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.261044    2582 scope.go:117] "RemoveContainer" containerID="778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069"
Sep 19 11:45:06.263774 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.263751    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"
Sep 19 11:45:06.263906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.263754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7" event={"ID":"511b4d49-1ffd-48fb-aaae-ec9d7151354f","Type":"ContainerDied","Data":"955d04f106c6249d949606dce19c31d6e7300ac4a72550ade99b9ec5aaf705aa"}
Sep 19 11:45:06.263906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.263891    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="955d04f106c6249d949606dce19c31d6e7300ac4a72550ade99b9ec5aaf705aa"
Sep 19 11:45:06.266172 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.265779    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"
Sep 19 11:45:06.266172 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.265796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96" event={"ID":"b5504cf4-e4d2-4150-a252-f378f5ba91f8","Type":"ContainerDied","Data":"641d2ef27893c7bc1412601e234ba04e5ab490da7181eb848d150e41809034e3"}
Sep 19 11:45:06.266172 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.265834    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="641d2ef27893c7bc1412601e234ba04e5ab490da7181eb848d150e41809034e3"
Sep 19 11:45:06.267544 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.267521    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw" event={"ID":"0b1145a6-4d4e-4f81-a512-f89a1c9e640a","Type":"ContainerDied","Data":"c2c94c771fa188dcacd4406280e9a65e40f1d09358c465fc5d947a73f5698f92"}
Sep 19 11:45:06.267701 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.267552    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"
Sep 19 11:45:06.267701 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.267566    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2c94c771fa188dcacd4406280e9a65e40f1d09358c465fc5d947a73f5698f92"
Sep 19 11:45:06.286825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.285215    2582 scope.go:117] "RemoveContainer" containerID="778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069"
Sep 19 11:45:06.286825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.285560    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"]
Sep 19 11:45:06.286825 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:45:06.285630    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069\": container with ID starting with 778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069 not found: ID does not exist" containerID="778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069"
Sep 19 11:45:06.286825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.285659    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069"} err="failed to get container status \"778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069\": rpc error: code = NotFound desc = could not find container \"778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069\": container with ID starting with 778c09eafac3ecba4d4c05de89e051bf26af20db5c678cc6c992198b53268069 not found: ID does not exist"
Sep 19 11:45:06.286825 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.285777    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" containerID="cri-o://d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17" gracePeriod=30
Sep 19 11:45:06.358901 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.358873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44cns\" (UniqueName: \"kubernetes.io/projected/e06387cd-ed0c-4b51-a141-dcf5d039a18d-kube-api-access-44cns\") pod \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") "
Sep 19 11:45:06.359061 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.358964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06387cd-ed0c-4b51-a141-dcf5d039a18d-plugins-config-volume\") pod \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\" (UID: \"e06387cd-ed0c-4b51-a141-dcf5d039a18d\") "
Sep 19 11:45:06.359317 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.359295    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06387cd-ed0c-4b51-a141-dcf5d039a18d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e06387cd-ed0c-4b51-a141-dcf5d039a18d" (UID: "e06387cd-ed0c-4b51-a141-dcf5d039a18d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:45:06.360855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.360830    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06387cd-ed0c-4b51-a141-dcf5d039a18d-kube-api-access-44cns" (OuterVolumeSpecName: "kube-api-access-44cns") pod "e06387cd-ed0c-4b51-a141-dcf5d039a18d" (UID: "e06387cd-ed0c-4b51-a141-dcf5d039a18d"). InnerVolumeSpecName "kube-api-access-44cns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:45:06.460032 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.459993    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06387cd-ed0c-4b51-a141-dcf5d039a18d-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:06.460032 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.460027    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44cns\" (UniqueName: \"kubernetes.io/projected/e06387cd-ed0c-4b51-a141-dcf5d039a18d-kube-api-access-44cns\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:06.582435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.582407    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"]
Sep 19 11:45:06.586603 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:06.586578    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9cf8a188-5bf667886-7tvbf"]
Sep 19 11:45:07.476582 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:07.476546    2582 patch_prober.go:28] interesting pod/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:45:07.477000 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:07.476603    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:45:07.544189 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:07.544154    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06387cd-ed0c-4b51-a141-dcf5d039a18d" path="/var/lib/kubelet/pods/e06387cd-ed0c-4b51-a141-dcf5d039a18d/volumes"
Sep 19 11:45:11.132623 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.132589    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"]
Sep 19 11:45:11.133179 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133159    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5504cf4-e4d2-4150-a252-f378f5ba91f8" containerName="cleanup"
Sep 19 11:45:11.133265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133181    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5504cf4-e4d2-4150-a252-f378f5ba91f8" containerName="cleanup"
Sep 19 11:45:11.133265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133193    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06387cd-ed0c-4b51-a141-dcf5d039a18d" containerName="payload-processing"
Sep 19 11:45:11.133265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133201    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06387cd-ed0c-4b51-a141-dcf5d039a18d" containerName="payload-processing"
Sep 19 11:45:11.133265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133211    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b1145a6-4d4e-4f81-a512-f89a1c9e640a" containerName="cleanup"
Sep 19 11:45:11.133265 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133219    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b1145a6-4d4e-4f81-a512-f89a1c9e640a" containerName="cleanup"
Sep 19 11:45:11.133519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133269    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="511b4d49-1ffd-48fb-aaae-ec9d7151354f" containerName="cleanup"
Sep 19 11:45:11.133519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133277    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="511b4d49-1ffd-48fb-aaae-ec9d7151354f" containerName="cleanup"
Sep 19 11:45:11.133519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133364    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5504cf4-e4d2-4150-a252-f378f5ba91f8" containerName="cleanup"
Sep 19 11:45:11.133519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133379    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="511b4d49-1ffd-48fb-aaae-ec9d7151354f" containerName="cleanup"
Sep 19 11:45:11.133519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133388    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b1145a6-4d4e-4f81-a512-f89a1c9e640a" containerName="cleanup"
Sep 19 11:45:11.133519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.133398    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06387cd-ed0c-4b51-a141-dcf5d039a18d" containerName="payload-processing"
Sep 19 11:45:11.138252 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.138225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.144329 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.144306    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5deb747f-serving-cert\""
Sep 19 11:45:11.152132 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.152102    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"]
Sep 19 11:45:11.306824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.306791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-maas-api-tls\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.306992 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.306834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwlmn\" (UniqueName: \"kubernetes.io/projected/d6d63460-e445-44c2-8646-efb4e2bbd51f-kube-api-access-cwlmn\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.306992 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.306901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d63460-e445-44c2-8646-efb4e2bbd51f-openshift-service-ca\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.307121 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.307103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-metrics-certs\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.407740 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.407718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-maas-api-tls\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.407820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.407747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwlmn\" (UniqueName: \"kubernetes.io/projected/d6d63460-e445-44c2-8646-efb4e2bbd51f-kube-api-access-cwlmn\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.407820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.407772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d63460-e445-44c2-8646-efb4e2bbd51f-openshift-service-ca\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.407946 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.407848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-metrics-certs\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.408677 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.408642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d63460-e445-44c2-8646-efb4e2bbd51f-openshift-service-ca\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.410327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.410297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-maas-api-tls\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.410560 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.410541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-metrics-certs\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.415638 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.415615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwlmn\" (UniqueName: \"kubernetes.io/projected/d6d63460-e445-44c2-8646-efb4e2bbd51f-kube-api-access-cwlmn\") pod \"maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.455503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.455477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:11.553033 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.553005    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:45:11.711144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p57r\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-kube-api-access-4p57r\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-credential-socket\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711136    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20998af-8e78-43e7-be07-791d93d3a43d-istio-podinfo\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711198    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-socket\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-data\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20998af-8e78-43e7-be07-791d93d3a43d-istiod-ca-cert\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711317    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-certs\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711363    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-istio-token\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711677 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711467    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-envoy\") pod \"d20998af-8e78-43e7-be07-791d93d3a43d\" (UID: \"d20998af-8e78-43e7-be07-791d93d3a43d\") "
Sep 19 11:45:11.711953 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:45:11.711953 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711880    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:45:11.711953 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.711941    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20998af-8e78-43e7-be07-791d93d3a43d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:45:11.712247 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.712137    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:45:11.712247 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.712216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:45:11.713445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.713422    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d20998af-8e78-43e7-be07-791d93d3a43d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:45:11.713541 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.713490    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-kube-api-access-4p57r" (OuterVolumeSpecName: "kube-api-access-4p57r") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "kube-api-access-4p57r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:45:11.714040 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.714017    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:45:11.714040 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.714033    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d20998af-8e78-43e7-be07-791d93d3a43d" (UID: "d20998af-8e78-43e7-be07-791d93d3a43d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:45:11.744434 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.744406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"]
Sep 19 11:45:11.747037 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:11.747013    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d63460_e445_44c2_8646_efb4e2bbd51f.slice/crio-420750e790797c147aff40e73ad0bf0a15a496a909a8f9cdadfd0456a5dd078e WatchSource:0}: Error finding container 420750e790797c147aff40e73ad0bf0a15a496a909a8f9cdadfd0456a5dd078e: Status 404 returned error can't find the container with id 420750e790797c147aff40e73ad0bf0a15a496a909a8f9cdadfd0456a5dd078e
Sep 19 11:45:11.747659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.747554    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"]
Sep 19 11:45:11.748099 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.748071    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy"
Sep 19 11:45:11.748099 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.748091    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy"
Sep 19 11:45:11.748254 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.748107    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy"
Sep 19 11:45:11.748254 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.748116    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy"
Sep 19 11:45:11.748254 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.748238    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy"
Sep 19 11:45:11.752669 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.752652    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:11.755070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.755042    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5deb747f-dockercfg-qtjlc\""
Sep 19 11:45:11.755070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.755067    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5deb747f\""
Sep 19 11:45:11.771540 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.768125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"]
Sep 19 11:45:11.812988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.812953    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.812988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.812983    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.812988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.812993    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20998af-8e78-43e7-be07-791d93d3a43d-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.813204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.813001    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.813204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.813009    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.813204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.813016    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.813204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.813024    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p57r\" (UniqueName: \"kubernetes.io/projected/d20998af-8e78-43e7-be07-791d93d3a43d-kube-api-access-4p57r\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.813204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.813032    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20998af-8e78-43e7-be07-791d93d3a43d-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.813204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.813040    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20998af-8e78-43e7-be07-791d93d3a43d-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:11.913941 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.913885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2x2\" (UniqueName: \"kubernetes.io/projected/732828f3-b328-4213-bd7e-a5d194431142-kube-api-access-6z2x2\") pod \"payload-pre-processing-e2e-ait-5deb747f-546768b558-52442\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:11.914108 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:11.914050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/732828f3-b328-4213-bd7e-a5d194431142-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5deb747f-546768b558-52442\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:12.014908 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.014864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2x2\" (UniqueName: \"kubernetes.io/projected/732828f3-b328-4213-bd7e-a5d194431142-kube-api-access-6z2x2\") pod \"payload-pre-processing-e2e-ait-5deb747f-546768b558-52442\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:12.015142 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.015014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/732828f3-b328-4213-bd7e-a5d194431142-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5deb747f-546768b558-52442\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:12.015900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.015876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/732828f3-b328-4213-bd7e-a5d194431142-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5deb747f-546768b558-52442\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:12.022365 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.022345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2x2\" (UniqueName: \"kubernetes.io/projected/732828f3-b328-4213-bd7e-a5d194431142-kube-api-access-6z2x2\") pod \"payload-pre-processing-e2e-ait-5deb747f-546768b558-52442\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:12.066397 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.066374    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:12.309494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.309415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7" event={"ID":"d6d63460-e445-44c2-8646-efb4e2bbd51f","Type":"ContainerStarted","Data":"4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3"}
Sep 19 11:45:12.309494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.309476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7" event={"ID":"d6d63460-e445-44c2-8646-efb4e2bbd51f","Type":"ContainerStarted","Data":"420750e790797c147aff40e73ad0bf0a15a496a909a8f9cdadfd0456a5dd078e"}
Sep 19 11:45:12.310054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.309624    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:12.311705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.311542    2582 generic.go:356] "Generic (PLEG): container finished" podID="d20998af-8e78-43e7-be07-791d93d3a43d" containerID="d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17" exitCode=0
Sep 19 11:45:12.311705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.311601    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"
Sep 19 11:45:12.311705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.311616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" event={"ID":"d20998af-8e78-43e7-be07-791d93d3a43d","Type":"ContainerDied","Data":"d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17"}
Sep 19 11:45:12.311705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.311663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8" event={"ID":"d20998af-8e78-43e7-be07-791d93d3a43d","Type":"ContainerDied","Data":"ab00f87bb7caaeac178d849810430b583ff638322c544f1ce461cde5e03331cd"}
Sep 19 11:45:12.311705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.311692    2582 scope.go:117] "RemoveContainer" containerID="d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17"
Sep 19 11:45:12.325107 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.325085    2582 scope.go:117] "RemoveContainer" containerID="904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"
Sep 19 11:45:12.331278 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.331239    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7" podStartSLOduration=0.915318535 podStartE2EDuration="1.331226501s" totalImagesPullingTime="415.907966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:12.328097061 +0000 UTC m=+683.345133782" watchObservedRunningTime="2026-09-19 11:45:12.331226501 +0000 UTC m=+683.348263282"
Sep 19 11:45:12.334356 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.334332    2582 scope.go:117] "RemoveContainer" containerID="d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17"
Sep 19 11:45:12.334623 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:45:12.334605    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17\": container with ID starting with d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17 not found: ID does not exist" containerID="d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17"
Sep 19 11:45:12.334686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.334630    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17"} err="failed to get container status \"d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17\": rpc error: code = NotFound desc = could not find container \"d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17\": container with ID starting with d5d5e48d16759538906da2965da9a2536b2b29a32438a918c18409320f40ae17 not found: ID does not exist"
Sep 19 11:45:12.334686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.334647    2582 scope.go:117] "RemoveContainer" containerID="904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"
Sep 19 11:45:12.334940 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:45:12.334898    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1\": container with ID starting with 904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1 not found: ID does not exist" containerID="904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"
Sep 19 11:45:12.334940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.334932    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1"} err="failed to get container status \"904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1\": rpc error: code = NotFound desc = could not find container \"904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1\": container with ID starting with 904a9dc52536613f4eff738b10e760e8fa4c8a817941d5e7e70cccfb6c59cbd1 not found: ID does not exist"
Sep 19 11:45:12.341507 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.341486    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"]
Sep 19 11:45:12.342961 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:12.342936    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732828f3_b328_4213_bd7e_a5d194431142.slice/crio-3e3584e1e2b1c9c84fb559c38f08db1cce21f009932cff3a9e4761d711d1cfd2 WatchSource:0}: Error finding container 3e3584e1e2b1c9c84fb559c38f08db1cce21f009932cff3a9e4761d711d1cfd2: Status 404 returned error can't find the container with id 3e3584e1e2b1c9c84fb559c38f08db1cce21f009932cff3a9e4761d711d1cfd2
Sep 19 11:45:12.346532 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.346494    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"]
Sep 19 11:45:12.349146 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:12.349127    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9cf8a188-gw-openshift-default-798d899d7b-lbgn8"]
Sep 19 11:45:13.321348 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:13.321304    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442" event={"ID":"732828f3-b328-4213-bd7e-a5d194431142","Type":"ContainerStarted","Data":"236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22"}
Sep 19 11:45:13.321765 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:13.321372    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442" event={"ID":"732828f3-b328-4213-bd7e-a5d194431142","Type":"ContainerStarted","Data":"3e3584e1e2b1c9c84fb559c38f08db1cce21f009932cff3a9e4761d711d1cfd2"}
Sep 19 11:45:13.321765 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:13.321541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:13.337263 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:13.337215    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442" podStartSLOduration=2.3371996729999998 podStartE2EDuration="2.337199673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:13.336090492 +0000 UTC m=+684.353127204" watchObservedRunningTime="2026-09-19 11:45:13.337199673 +0000 UTC m=+684.354236383"
Sep 19 11:45:13.544309 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:13.544274    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" path="/var/lib/kubelet/pods/d20998af-8e78-43e7-be07-791d93d3a43d/volumes"
Sep 19 11:45:14.040674 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:14.040639    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:45:18.326980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:18.326953    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:24.330066 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:24.330037    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:41.832792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:41.832756    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"]
Sep 19 11:45:41.833388 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:41.833015    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7" podUID="d6d63460-e445-44c2-8646-efb4e2bbd51f" containerName="maas-api" containerID="cri-o://4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3" gracePeriod=30
Sep 19 11:45:41.889633 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:41.889601    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"]
Sep 19 11:45:41.889897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:41.889848    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442" podUID="732828f3-b328-4213-bd7e-a5d194431142" containerName="payload-pre-processing" containerID="cri-o://236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22" gracePeriod=30
Sep 19 11:45:42.188142 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.188043    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:42.223123 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.223102    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:42.320065 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320034    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-maas-api-tls\") pod \"d6d63460-e445-44c2-8646-efb4e2bbd51f\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") "
Sep 19 11:45:42.320301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwlmn\" (UniqueName: \"kubernetes.io/projected/d6d63460-e445-44c2-8646-efb4e2bbd51f-kube-api-access-cwlmn\") pod \"d6d63460-e445-44c2-8646-efb4e2bbd51f\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") "
Sep 19 11:45:42.320301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320165    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/732828f3-b328-4213-bd7e-a5d194431142-plugins-config-volume\") pod \"732828f3-b328-4213-bd7e-a5d194431142\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") "
Sep 19 11:45:42.320301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320214    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d63460-e445-44c2-8646-efb4e2bbd51f-openshift-service-ca\") pod \"d6d63460-e445-44c2-8646-efb4e2bbd51f\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") "
Sep 19 11:45:42.320301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320257    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z2x2\" (UniqueName: \"kubernetes.io/projected/732828f3-b328-4213-bd7e-a5d194431142-kube-api-access-6z2x2\") pod \"732828f3-b328-4213-bd7e-a5d194431142\" (UID: \"732828f3-b328-4213-bd7e-a5d194431142\") "
Sep 19 11:45:42.320301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320281    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-metrics-certs\") pod \"d6d63460-e445-44c2-8646-efb4e2bbd51f\" (UID: \"d6d63460-e445-44c2-8646-efb4e2bbd51f\") "
Sep 19 11:45:42.320586 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320555    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6d63460-e445-44c2-8646-efb4e2bbd51f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6d63460-e445-44c2-8646-efb4e2bbd51f" (UID: "d6d63460-e445-44c2-8646-efb4e2bbd51f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:45:42.320646 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320623    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d63460-e445-44c2-8646-efb4e2bbd51f-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:42.320697 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.320641    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/732828f3-b328-4213-bd7e-a5d194431142-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "732828f3-b328-4213-bd7e-a5d194431142" (UID: "732828f3-b328-4213-bd7e-a5d194431142"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:45:42.322329 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.322304    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6d63460-e445-44c2-8646-efb4e2bbd51f" (UID: "d6d63460-e445-44c2-8646-efb4e2bbd51f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:45:42.322446 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.322328    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d6d63460-e445-44c2-8646-efb4e2bbd51f" (UID: "d6d63460-e445-44c2-8646-efb4e2bbd51f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:45:42.322704 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.322688    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6d63460-e445-44c2-8646-efb4e2bbd51f-kube-api-access-cwlmn" (OuterVolumeSpecName: "kube-api-access-cwlmn") pod "d6d63460-e445-44c2-8646-efb4e2bbd51f" (UID: "d6d63460-e445-44c2-8646-efb4e2bbd51f"). InnerVolumeSpecName "kube-api-access-cwlmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:45:42.322704 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.322710    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/732828f3-b328-4213-bd7e-a5d194431142-kube-api-access-6z2x2" (OuterVolumeSpecName: "kube-api-access-6z2x2") pod "732828f3-b328-4213-bd7e-a5d194431142" (UID: "732828f3-b328-4213-bd7e-a5d194431142"). InnerVolumeSpecName "kube-api-access-6z2x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:45:42.421372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.421291    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwlmn\" (UniqueName: \"kubernetes.io/projected/d6d63460-e445-44c2-8646-efb4e2bbd51f-kube-api-access-cwlmn\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:42.421372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.421322    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/732828f3-b328-4213-bd7e-a5d194431142-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:42.421372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.421331    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z2x2\" (UniqueName: \"kubernetes.io/projected/732828f3-b328-4213-bd7e-a5d194431142-kube-api-access-6z2x2\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:42.421372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.421340    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:42.421372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.421349    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6d63460-e445-44c2-8646-efb4e2bbd51f-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:45:42.492221 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.492182    2582 generic.go:356] "Generic (PLEG): container finished" podID="d6d63460-e445-44c2-8646-efb4e2bbd51f" containerID="4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3" exitCode=0
Sep 19 11:45:42.492391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.492228    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"
Sep 19 11:45:42.492391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.492274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7" event={"ID":"d6d63460-e445-44c2-8646-efb4e2bbd51f","Type":"ContainerDied","Data":"4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3"}
Sep 19 11:45:42.492391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.492326    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7" event={"ID":"d6d63460-e445-44c2-8646-efb4e2bbd51f","Type":"ContainerDied","Data":"420750e790797c147aff40e73ad0bf0a15a496a909a8f9cdadfd0456a5dd078e"}
Sep 19 11:45:42.492391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.492348    2582 scope.go:117] "RemoveContainer" containerID="4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3"
Sep 19 11:45:42.493715 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.493690    2582 generic.go:356] "Generic (PLEG): container finished" podID="732828f3-b328-4213-bd7e-a5d194431142" containerID="236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22" exitCode=0
Sep 19 11:45:42.493834 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.493730    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"
Sep 19 11:45:42.493834 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.493779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442" event={"ID":"732828f3-b328-4213-bd7e-a5d194431142","Type":"ContainerDied","Data":"236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22"}
Sep 19 11:45:42.493834 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.493828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442" event={"ID":"732828f3-b328-4213-bd7e-a5d194431142","Type":"ContainerDied","Data":"3e3584e1e2b1c9c84fb559c38f08db1cce21f009932cff3a9e4761d711d1cfd2"}
Sep 19 11:45:42.501839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.501821    2582 scope.go:117] "RemoveContainer" containerID="4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3"
Sep 19 11:45:42.502150 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:45:42.502125    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3\": container with ID starting with 4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3 not found: ID does not exist" containerID="4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3"
Sep 19 11:45:42.502230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.502164    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3"} err="failed to get container status \"4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3\": rpc error: code = NotFound desc = could not find container \"4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3\": container with ID starting with 4b17916272cfac5999f9ac3aa3581753cef2a2bf8852b82c7c3613eab31010b3 not found: ID does not exist"
Sep 19 11:45:42.502230 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.502184    2582 scope.go:117] "RemoveContainer" containerID="236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22"
Sep 19 11:45:42.510209 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.510193    2582 scope.go:117] "RemoveContainer" containerID="236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22"
Sep 19 11:45:42.510488 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:45:42.510471    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22\": container with ID starting with 236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22 not found: ID does not exist" containerID="236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22"
Sep 19 11:45:42.510538 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.510494    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22"} err="failed to get container status \"236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22\": rpc error: code = NotFound desc = could not find container \"236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22\": container with ID starting with 236d21d0016cde589b4b0e7245df55f79f1c7998a863310cec09490db5a50f22 not found: ID does not exist"
Sep 19 11:45:42.517344 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.517321    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"]
Sep 19 11:45:42.520647 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.520623    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5deb747f-5bb8ff894d-pbzc7"]
Sep 19 11:45:42.534264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.532667    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"]
Sep 19 11:45:42.537174 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:42.537145    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5deb747f-546768b558-52442"]
Sep 19 11:45:43.543876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.543842    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="732828f3-b328-4213-bd7e-a5d194431142" path="/var/lib/kubelet/pods/732828f3-b328-4213-bd7e-a5d194431142/volumes"
Sep 19 11:45:43.544312 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.544295    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6d63460-e445-44c2-8646-efb4e2bbd51f" path="/var/lib/kubelet/pods/d6d63460-e445-44c2-8646-efb4e2bbd51f/volumes"
Sep 19 11:45:43.918908 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.918835    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"]
Sep 19 11:45:43.919469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919445    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d63460-e445-44c2-8646-efb4e2bbd51f" containerName="maas-api"
Sep 19 11:45:43.919469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919466    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d63460-e445-44c2-8646-efb4e2bbd51f" containerName="maas-api"
Sep 19 11:45:43.919624 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919489    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="732828f3-b328-4213-bd7e-a5d194431142" containerName="payload-pre-processing"
Sep 19 11:45:43.919624 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919499    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="732828f3-b328-4213-bd7e-a5d194431142" containerName="payload-pre-processing"
Sep 19 11:45:43.919624 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919586    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20998af-8e78-43e7-be07-791d93d3a43d" containerName="istio-proxy"
Sep 19 11:45:43.919624 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919602    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="732828f3-b328-4213-bd7e-a5d194431142" containerName="payload-pre-processing"
Sep 19 11:45:43.919624 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.919612    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6d63460-e445-44c2-8646-efb4e2bbd51f" containerName="maas-api"
Sep 19 11:45:43.924333 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.924312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:43.926724 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.926705    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-db360f2c-openshift-default-dockercfg-fr86j\""
Sep 19 11:45:43.936002 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:43.935979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"]
Sep 19 11:45:44.037763 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.037720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istiod-ca-cert\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.037998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.037772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6dds\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-kube-api-access-x6dds\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.037998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.037853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-envoy\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.037998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.037892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-podinfo\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.037998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.037943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-socket\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.037998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.037997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-certs\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.038269 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.038038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-credential-socket\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.038269 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.038084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-token\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.038269 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.038122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-data\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.138939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.138883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-credential-socket\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.138964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-token\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.138995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-data\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istiod-ca-cert\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6dds\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-kube-api-access-x6dds\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-envoy\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-podinfo\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-socket\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-certs\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-credential-socket\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139436 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-data\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139747 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-certs\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.139814 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.139798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-socket\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.140133 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.140085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istiod-ca-cert\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.141745 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.141719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-envoy\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.141881 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.141845    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-podinfo\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.146770 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.146743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-token\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.147089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.147072    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6dds\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-kube-api-access-x6dds\") pod \"e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") " pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.237711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.237686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:44.535539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.535496    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"]
Sep 19 11:45:44.535855 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:44.535833    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd335f7_ca62_4957_a401_ac68ef8aaad3.slice/crio-96baac55086a51434752d097d94c85da3f16c1503cc87aca396bcaf17fa5f510 WatchSource:0}: Error finding container 96baac55086a51434752d097d94c85da3f16c1503cc87aca396bcaf17fa5f510: Status 404 returned error can't find the container with id 96baac55086a51434752d097d94c85da3f16c1503cc87aca396bcaf17fa5f510
Sep 19 11:45:44.538170 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.538141    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:45:44.538246 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.538199    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:45:44.538246 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.538229    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:45:44.589468 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:44.589439    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:45:45.514090 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.514046    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" event={"ID":"1fd335f7-ca62-4957-a401-ac68ef8aaad3","Type":"ContainerStarted","Data":"f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"}
Sep 19 11:45:45.514253 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.514145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" event={"ID":"1fd335f7-ca62-4957-a401-ac68ef8aaad3","Type":"ContainerStarted","Data":"96baac55086a51434752d097d94c85da3f16c1503cc87aca396bcaf17fa5f510"}
Sep 19 11:45:45.534639 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.534589    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podStartSLOduration=2.534573872 podStartE2EDuration="2.534573872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:45.532092146 +0000 UTC m=+716.549128907" watchObservedRunningTime="2026-09-19 11:45:45.534573872 +0000 UTC m=+716.551610583"
Sep 19 11:45:45.622821 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.622786    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"]
Sep 19 11:45:45.626527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.626506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.629094 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.629070    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-37daed\"/\"default-dockercfg-m4n4d\""
Sep 19 11:45:45.629224 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.629111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-37daed\"/\"simulator-w4-37daed-kserve-self-signed-certs\""
Sep 19 11:45:45.629224 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.629171    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-37daed\"/\"openshift-service-ca.crt\""
Sep 19 11:45:45.629224 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.629185    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-37daed\"/\"kube-root-ca.crt\""
Sep 19 11:45:45.636703 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.636683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"]
Sep 19 11:45:45.758974 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.758937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-model-cache\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.759152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.759034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-home\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.759152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.759080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwl6r\" (UniqueName: \"kubernetes.io/projected/410c2df2-caca-41ad-84ee-ad1f755aa035-kube-api-access-dwl6r\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.759152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.759115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410c2df2-caca-41ad-84ee-ad1f755aa035-tls-certs\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.759278 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.759160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-dshm\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.759278 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.759252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-tmp-dir\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860078 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.859997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-tmp-dir\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860078 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-model-cache\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-home\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwl6r\" (UniqueName: \"kubernetes.io/projected/410c2df2-caca-41ad-84ee-ad1f755aa035-kube-api-access-dwl6r\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860301 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410c2df2-caca-41ad-84ee-ad1f755aa035-tls-certs\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-dshm\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-model-cache\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860423    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-tmp-dir\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.860469 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.860462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-home\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.862428 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.862408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-dshm\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.862619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.862601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410c2df2-caca-41ad-84ee-ad1f755aa035-tls-certs\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.868852 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.868831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwl6r\" (UniqueName: \"kubernetes.io/projected/410c2df2-caca-41ad-84ee-ad1f755aa035-kube-api-access-dwl6r\") pod \"simulator-w4-37daed-kserve-996d898bb-f7mlz\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") " pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:45.938121 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:45.938091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:46.217770 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.217734    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"]
Sep 19 11:45:46.218035 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:46.217995    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410c2df2_caca_41ad_84ee_ad1f755aa035.slice/crio-69e029769abf6fa9b71625ed3ea2cd6372dcfe94031235c79db41913a32734a7 WatchSource:0}: Error finding container 69e029769abf6fa9b71625ed3ea2cd6372dcfe94031235c79db41913a32734a7: Status 404 returned error can't find the container with id 69e029769abf6fa9b71625ed3ea2cd6372dcfe94031235c79db41913a32734a7
Sep 19 11:45:46.238499 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.238363    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:46.244137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.244112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:46.522843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.522794    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" event={"ID":"410c2df2-caca-41ad-84ee-ad1f755aa035","Type":"ContainerStarted","Data":"f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd"}
Sep 19 11:45:46.522843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.522847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" event={"ID":"410c2df2-caca-41ad-84ee-ad1f755aa035","Type":"ContainerStarted","Data":"69e029769abf6fa9b71625ed3ea2cd6372dcfe94031235c79db41913a32734a7"}
Sep 19 11:45:46.523428 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.523192    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:46.524028 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.524009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:45:46.542792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.542742    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" podStartSLOduration=1.542727943 podStartE2EDuration="1.542727943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:46.541486246 +0000 UTC m=+717.558522960" watchObservedRunningTime="2026-09-19 11:45:46.542727943 +0000 UTC m=+717.559764654"
Sep 19 11:45:46.938721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:46.938640    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:51.128221 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.128185    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"]
Sep 19 11:45:51.133826 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.133765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.136276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.136241    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-db360f2c-serving-cert\""
Sep 19 11:45:51.140257 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.140236    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"]
Sep 19 11:45:51.219524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.219496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be85c4b-29da-4643-9a03-f2be58150237-openshift-service-ca\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.219680 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.219610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-metrics-certs\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.219680 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.219657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4p5\" (UniqueName: \"kubernetes.io/projected/1be85c4b-29da-4643-9a03-f2be58150237-kube-api-access-fw4p5\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.219810 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.219685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-maas-api-tls\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.320688 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.320647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-metrics-certs\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.320875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.320700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4p5\" (UniqueName: \"kubernetes.io/projected/1be85c4b-29da-4643-9a03-f2be58150237-kube-api-access-fw4p5\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.320875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.320729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-maas-api-tls\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.320875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.320829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be85c4b-29da-4643-9a03-f2be58150237-openshift-service-ca\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.321618 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.321591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be85c4b-29da-4643-9a03-f2be58150237-openshift-service-ca\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.323204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.323182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-metrics-certs\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.323298 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.323227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-maas-api-tls\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.327934 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.327894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4p5\" (UniqueName: \"kubernetes.io/projected/1be85c4b-29da-4643-9a03-f2be58150237-kube-api-access-fw4p5\") pod \"maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.447675 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.447582    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:51.754093 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:51.754064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"]
Sep 19 11:45:51.754707 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:45:51.754678    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be85c4b_29da_4643_9a03_f2be58150237.slice/crio-4826044ce17fb712c32838ae3485fc6f0d2fba4d29c2126d5582b2f00744736c WatchSource:0}: Error finding container 4826044ce17fb712c32838ae3485fc6f0d2fba4d29c2126d5582b2f00744736c: Status 404 returned error can't find the container with id 4826044ce17fb712c32838ae3485fc6f0d2fba4d29c2126d5582b2f00744736c
Sep 19 11:45:52.558018 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:52.557962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq" event={"ID":"1be85c4b-29da-4643-9a03-f2be58150237","Type":"ContainerStarted","Data":"2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca"}
Sep 19 11:45:52.558386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:52.558045    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:45:52.558386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:52.558072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq" event={"ID":"1be85c4b-29da-4643-9a03-f2be58150237","Type":"ContainerStarted","Data":"4826044ce17fb712c32838ae3485fc6f0d2fba4d29c2126d5582b2f00744736c"}
Sep 19 11:45:52.574676 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:52.574631    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq" podStartSLOduration=1.137746221 podStartE2EDuration="1.574615688s" totalImagesPullingTime="436.869467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:45:52.573307393 +0000 UTC m=+723.590344113" watchObservedRunningTime="2026-09-19 11:45:52.574615688 +0000 UTC m=+723.591652399"
Sep 19 11:45:55.938271 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:55.938237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:55.950431 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:55.950402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:56.593679 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:56.593650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:45:58.568705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:45:58.568671    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:46:02.047497 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:02.047459    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:46:12.685883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:12.685847    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerID="f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50" exitCode=0
Sep 19 11:46:12.686438 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:12.685947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" event={"ID":"1fd335f7-ca62-4957-a401-ac68ef8aaad3","Type":"ContainerDied","Data":"f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"}
Sep 19 11:46:12.686585 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:12.686568    2582 scope.go:117] "RemoveContainer" containerID="f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"
Sep 19 11:46:12.687788 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:12.687761    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:46:12.687861 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:12.687834    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:46:12.687897 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:12.687869    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:46:13.693862 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:13.693826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" event={"ID":"1fd335f7-ca62-4957-a401-ac68ef8aaad3","Type":"ContainerStarted","Data":"71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d"}
Sep 19 11:46:14.238807 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:14.238777    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:46:14.239974 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:14.239949    2582 patch_prober.go:28] interesting pod/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 19 11:46:14.240086 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:14.240009    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 19 11:46:15.238502 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:15.238467    2582 patch_prober.go:28] interesting pod/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 19 11:46:15.238880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:15.238526    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 19 11:46:16.238894 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:16.238862    2582 patch_prober.go:28] interesting pod/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 19 11:46:16.239291 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:16.238956    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 19 11:46:16.523370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:16.523281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:46:17.238548 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:17.238512    2582 patch_prober.go:28] interesting pod/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 19 11:46:17.238725 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:17.238574    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 19 11:46:18.238277 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:18.238239    2582 patch_prober.go:28] interesting pod/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 19 11:46:18.238657 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:18.238301    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 19 11:46:19.239502 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:19.239071    2582 patch_prober.go:28] interesting pod/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 19 11:46:19.239502 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:19.239134    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 19 11:46:20.242815 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:20.242787    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:46:20.243853 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:20.243833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:46:29.313576 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.313531    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"]
Sep 19 11:46:29.314003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.313767    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq" podUID="1be85c4b-29da-4643-9a03-f2be58150237" containerName="maas-api" containerID="cri-o://2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca" gracePeriod=30
Sep 19 11:46:29.593580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.593493    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:46:29.630052 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.630024    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw4p5\" (UniqueName: \"kubernetes.io/projected/1be85c4b-29da-4643-9a03-f2be58150237-kube-api-access-fw4p5\") pod \"1be85c4b-29da-4643-9a03-f2be58150237\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") "
Sep 19 11:46:29.630227 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.630202    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-maas-api-tls\") pod \"1be85c4b-29da-4643-9a03-f2be58150237\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") "
Sep 19 11:46:29.630305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.630263    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-metrics-certs\") pod \"1be85c4b-29da-4643-9a03-f2be58150237\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") "
Sep 19 11:46:29.630375 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.630362    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be85c4b-29da-4643-9a03-f2be58150237-openshift-service-ca\") pod \"1be85c4b-29da-4643-9a03-f2be58150237\" (UID: \"1be85c4b-29da-4643-9a03-f2be58150237\") "
Sep 19 11:46:29.630790 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.630743    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1be85c4b-29da-4643-9a03-f2be58150237-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1be85c4b-29da-4643-9a03-f2be58150237" (UID: "1be85c4b-29da-4643-9a03-f2be58150237"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:46:29.632338 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.632308    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1be85c4b-29da-4643-9a03-f2be58150237" (UID: "1be85c4b-29da-4643-9a03-f2be58150237"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:46:29.632660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.632639    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1be85c4b-29da-4643-9a03-f2be58150237" (UID: "1be85c4b-29da-4643-9a03-f2be58150237"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:46:29.632735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.632643    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1be85c4b-29da-4643-9a03-f2be58150237-kube-api-access-fw4p5" (OuterVolumeSpecName: "kube-api-access-fw4p5") pod "1be85c4b-29da-4643-9a03-f2be58150237" (UID: "1be85c4b-29da-4643-9a03-f2be58150237"). InnerVolumeSpecName "kube-api-access-fw4p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:46:29.734886 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.734811    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw4p5\" (UniqueName: \"kubernetes.io/projected/1be85c4b-29da-4643-9a03-f2be58150237-kube-api-access-fw4p5\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:29.734886 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.734851    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:29.734886 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.734866    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be85c4b-29da-4643-9a03-f2be58150237-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:29.735210 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.734895    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1be85c4b-29da-4643-9a03-f2be58150237-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:29.793303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.793275    2582 generic.go:356] "Generic (PLEG): container finished" podID="1be85c4b-29da-4643-9a03-f2be58150237" containerID="2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca" exitCode=0
Sep 19 11:46:29.793470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.793319    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"
Sep 19 11:46:29.793470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.793355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq" event={"ID":"1be85c4b-29da-4643-9a03-f2be58150237","Type":"ContainerDied","Data":"2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca"}
Sep 19 11:46:29.793470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.793408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq" event={"ID":"1be85c4b-29da-4643-9a03-f2be58150237","Type":"ContainerDied","Data":"4826044ce17fb712c32838ae3485fc6f0d2fba4d29c2126d5582b2f00744736c"}
Sep 19 11:46:29.793470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.793432    2582 scope.go:117] "RemoveContainer" containerID="2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca"
Sep 19 11:46:29.803535 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.803519    2582 scope.go:117] "RemoveContainer" containerID="2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca"
Sep 19 11:46:29.803805 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:46:29.803785    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca\": container with ID starting with 2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca not found: ID does not exist" containerID="2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca"
Sep 19 11:46:29.803882 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.803815    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca"} err="failed to get container status \"2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca\": rpc error: code = NotFound desc = could not find container \"2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca\": container with ID starting with 2989eec687fc6ee1c54440c985d538466d6e8635f5a73003b21dad58683af3ca not found: ID does not exist"
Sep 19 11:46:29.814693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.814672    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"]
Sep 19 11:46:29.834069 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.834039    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-db360f2c-c75bc77fc-lnlgq"]
Sep 19 11:46:29.848303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.848226    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"]
Sep 19 11:46:29.848551 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:29.848518    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy" containerID="cri-o://71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d" gracePeriod=30
Sep 19 11:46:31.545005 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:31.544970    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be85c4b-29da-4643-9a03-f2be58150237" path="/var/lib/kubelet/pods/1be85c4b-29da-4643-9a03-f2be58150237/volumes"
Sep 19 11:46:35.103864 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.103840    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:46:35.190137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-envoy\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-socket\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190138    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-data\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190164    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6dds\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-kube-api-access-x6dds\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190195    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-token\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-certs\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-credential-socket\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190308    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istiod-ca-cert\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190414 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190333    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-podinfo\") pod \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\" (UID: \"1fd335f7-ca62-4957-a401-ac68ef8aaad3\") "
Sep 19 11:46:35.190716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190468    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:46:35.190716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190670    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:46:35.190823 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:46:35.190880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190817    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:46:35.190880 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190870    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.190986 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.190891    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.191048 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.191027    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:46:35.192737 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.192714    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:46:35.192845 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.192775    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-kube-api-access-x6dds" (OuterVolumeSpecName: "kube-api-access-x6dds") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "kube-api-access-x6dds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:46:35.192976 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.192956    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:46:35.193085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.192982    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fd335f7-ca62-4957-a401-ac68ef8aaad3" (UID: "1fd335f7-ca62-4957-a401-ac68ef8aaad3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:46:35.291672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291639    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6dds\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-kube-api-access-x6dds\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.291672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291666    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.291672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291677    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.291890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291686    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.291890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291694    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.291890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291702    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.291890 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.291710    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd335f7-ca62-4957-a401-ac68ef8aaad3-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:35.830073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.829979    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerID="71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d" exitCode=0
Sep 19 11:46:35.830073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.830044    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"
Sep 19 11:46:35.830073 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.830056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" event={"ID":"1fd335f7-ca62-4957-a401-ac68ef8aaad3","Type":"ContainerDied","Data":"71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d"}
Sep 19 11:46:35.830305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.830108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57" event={"ID":"1fd335f7-ca62-4957-a401-ac68ef8aaad3","Type":"ContainerDied","Data":"96baac55086a51434752d097d94c85da3f16c1503cc87aca396bcaf17fa5f510"}
Sep 19 11:46:35.830305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.830133    2582 scope.go:117] "RemoveContainer" containerID="71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d"
Sep 19 11:46:35.839257 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.839239    2582 scope.go:117] "RemoveContainer" containerID="f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"
Sep 19 11:46:35.847287 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.847268    2582 scope.go:117] "RemoveContainer" containerID="71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d"
Sep 19 11:46:35.847567 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:46:35.847549    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d\": container with ID starting with 71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d not found: ID does not exist" containerID="71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d"
Sep 19 11:46:35.847616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.847577    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d"} err="failed to get container status \"71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d\": rpc error: code = NotFound desc = could not find container \"71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d\": container with ID starting with 71adb1db8d5cc8cf2021a6067a0adab60c494bc247fb8a991d9eb27e4b33306d not found: ID does not exist"
Sep 19 11:46:35.847616 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.847592    2582 scope.go:117] "RemoveContainer" containerID="f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"
Sep 19 11:46:35.847798 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:46:35.847782    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50\": container with ID starting with f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50 not found: ID does not exist" containerID="f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"
Sep 19 11:46:35.847840 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.847802    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50"} err="failed to get container status \"f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50\": rpc error: code = NotFound desc = could not find container \"f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50\": container with ID starting with f550219c5f4ef739959961a651ceb161e2cfa849a5c7f7e92f183fdd2be43e50 not found: ID does not exist"
Sep 19 11:46:35.860030 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.860008    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"]
Sep 19 11:46:35.880256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:35.880233    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-db360f2c-openshift-default-78dc6dfc7b-qhc57"]
Sep 19 11:46:36.930723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:36.930693    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"]
Sep 19 11:46:36.932817 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:36.932798    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-7a524f-29830305-7wg96"]
Sep 19 11:46:36.953212 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:36.953183    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"]
Sep 19 11:46:36.953717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:36.953686    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr" podUID="88d3cc9d-5498-4f97-9f3c-28690438745c" containerName="payload-processing" containerID="cri-o://1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c" gracePeriod=30
Sep 19 11:46:37.238642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.238616    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:46:37.312184 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.312153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d3cc9d-5498-4f97-9f3c-28690438745c-plugins-config-volume\") pod \"88d3cc9d-5498-4f97-9f3c-28690438745c\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") "
Sep 19 11:46:37.312370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.312202    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9cqz\" (UniqueName: \"kubernetes.io/projected/88d3cc9d-5498-4f97-9f3c-28690438745c-kube-api-access-h9cqz\") pod \"88d3cc9d-5498-4f97-9f3c-28690438745c\" (UID: \"88d3cc9d-5498-4f97-9f3c-28690438745c\") "
Sep 19 11:46:37.312495 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.312469    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88d3cc9d-5498-4f97-9f3c-28690438745c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88d3cc9d-5498-4f97-9f3c-28690438745c" (UID: "88d3cc9d-5498-4f97-9f3c-28690438745c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:46:37.312637 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.312623    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88d3cc9d-5498-4f97-9f3c-28690438745c-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:37.314177 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.314155    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d3cc9d-5498-4f97-9f3c-28690438745c-kube-api-access-h9cqz" (OuterVolumeSpecName: "kube-api-access-h9cqz") pod "88d3cc9d-5498-4f97-9f3c-28690438745c" (UID: "88d3cc9d-5498-4f97-9f3c-28690438745c"). InnerVolumeSpecName "kube-api-access-h9cqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:46:37.414095 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.414050    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9cqz\" (UniqueName: \"kubernetes.io/projected/88d3cc9d-5498-4f97-9f3c-28690438745c-kube-api-access-h9cqz\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:46:37.544971 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.544941    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" path="/var/lib/kubelet/pods/1fd335f7-ca62-4957-a401-ac68ef8aaad3/volumes"
Sep 19 11:46:37.545275 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.545262    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5504cf4-e4d2-4150-a252-f378f5ba91f8" path="/var/lib/kubelet/pods/b5504cf4-e4d2-4150-a252-f378f5ba91f8/volumes"
Sep 19 11:46:37.843067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.842977    2582 generic.go:356] "Generic (PLEG): container finished" podID="88d3cc9d-5498-4f97-9f3c-28690438745c" containerID="1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c" exitCode=0
Sep 19 11:46:37.843067 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.843022    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"
Sep 19 11:46:37.843263 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.843062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr" event={"ID":"88d3cc9d-5498-4f97-9f3c-28690438745c","Type":"ContainerDied","Data":"1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c"}
Sep 19 11:46:37.843263 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.843110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr" event={"ID":"88d3cc9d-5498-4f97-9f3c-28690438745c","Type":"ContainerDied","Data":"b526c884cb59c8e16b0eaeae876ce716383f1d6854d249a4fe1e0fcace739796"}
Sep 19 11:46:37.843263 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.843133    2582 scope.go:117] "RemoveContainer" containerID="1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c"
Sep 19 11:46:37.852525 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.852503    2582 scope.go:117] "RemoveContainer" containerID="1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c"
Sep 19 11:46:37.852801 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:46:37.852782    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c\": container with ID starting with 1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c not found: ID does not exist" containerID="1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c"
Sep 19 11:46:37.852850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.852812    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c"} err="failed to get container status \"1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c\": rpc error: code = NotFound desc = could not find container \"1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c\": container with ID starting with 1c392d251d7963d44902ed186bcb1229b2cb9b09ea16af139b2e6930a5facc4c not found: ID does not exist"
Sep 19 11:46:37.859046 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.859022    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"]
Sep 19 11:46:37.865800 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:37.865779    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a524f-84fd6746c-vhbhr"]
Sep 19 11:46:38.645215 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:38.645169    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:46:39.545047 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:46:39.545012    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d3cc9d-5498-4f97-9f3c-28690438745c" path="/var/lib/kubelet/pods/88d3cc9d-5498-4f97-9f3c-28690438745c/volumes"
Sep 19 11:47:04.641848 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:04.641810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:47:15.523735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:15.523651    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"]
Sep 19 11:47:19.457680 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:19.457645    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"]
Sep 19 11:47:19.458165 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:19.457954    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy" containerID="cri-o://0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff" gracePeriod=30
Sep 19 11:47:20.161013 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.160972    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"]
Sep 19 11:47:20.161466 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161446    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be85c4b-29da-4643-9a03-f2be58150237" containerName="maas-api"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161468    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be85c4b-29da-4643-9a03-f2be58150237" containerName="maas-api"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161482    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161489    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161518    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161527    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d3cc9d-5498-4f97-9f3c-28690438745c" containerName="payload-processing"
Sep 19 11:47:20.161559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161551    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d3cc9d-5498-4f97-9f3c-28690438745c" containerName="payload-processing"
Sep 19 11:47:20.161900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161646    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d3cc9d-5498-4f97-9f3c-28690438745c" containerName="payload-processing"
Sep 19 11:47:20.161900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161659    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1be85c4b-29da-4643-9a03-f2be58150237" containerName="maas-api"
Sep 19 11:47:20.161900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161671    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy"
Sep 19 11:47:20.161900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.161682    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fd335f7-ca62-4957-a401-ac68ef8aaad3" containerName="istio-proxy"
Sep 19 11:47:20.164977 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.164944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.167296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.167262    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-a527d4-openshift-default-dockercfg-np2sg\""
Sep 19 11:47:20.176779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.176756    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"]
Sep 19 11:47:20.231869 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.231835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-certs\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.231869 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.231868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-envoy\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.231886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-socket\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.231980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-podinfo\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.232019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-credential-socket\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.232066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istiod-ca-cert\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.232129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-data\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.232170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-token\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.232250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.232202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzdb8\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-kube-api-access-tzdb8\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-certs\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333323 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-envoy\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-socket\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-podinfo\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-credential-socket\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istiod-ca-cert\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-data\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-token\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.333843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.333657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzdb8\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-kube-api-access-tzdb8\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.338723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.338183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-credential-socket\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.338723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.338183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-data\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.338723 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.338677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-podinfo\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.340032 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.339609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-socket\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.340652 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.340628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istiod-ca-cert\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.341051 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.341019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-certs\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.341600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.341559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-envoy\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.343693 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.343651    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-token\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.343832 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.343798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzdb8\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-kube-api-access-tzdb8\") pod \"e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") " pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.477260 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.477168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:20.751468 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.751443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"]
Sep 19 11:47:20.752688 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:47:20.752664    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0d3432_2bf2_4e87_8015_dbada7a4b40b.slice/crio-84615f0fa770ae19354d32a5fc32651fb1f4abee90c90ae2079c2b272a30fd73 WatchSource:0}: Error finding container 84615f0fa770ae19354d32a5fc32651fb1f4abee90c90ae2079c2b272a30fd73: Status 404 returned error can't find the container with id 84615f0fa770ae19354d32a5fc32651fb1f4abee90c90ae2079c2b272a30fd73
Sep 19 11:47:20.755051 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.755020    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:47:20.755157 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.755085    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:47:20.755157 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:20.755115    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:47:21.092717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.092629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" event={"ID":"fe0d3432-2bf2-4e87-8015-dbada7a4b40b","Type":"ContainerStarted","Data":"e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"}
Sep 19 11:47:21.092717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.092692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" event={"ID":"fe0d3432-2bf2-4e87-8015-dbada7a4b40b","Type":"ContainerStarted","Data":"84615f0fa770ae19354d32a5fc32651fb1f4abee90c90ae2079c2b272a30fd73"}
Sep 19 11:47:21.117058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.116909    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podStartSLOduration=1.116888473 podStartE2EDuration="1.116888473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:47:21.11554206 +0000 UTC m=+812.132578773" watchObservedRunningTime="2026-09-19 11:47:21.116888473 +0000 UTC m=+812.133925185"
Sep 19 11:47:21.138756 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.138722    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"]
Sep 19 11:47:21.140877 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.140853    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-37daed-29830305-78pq7"]
Sep 19 11:47:21.478474 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.478373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:21.483752 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.483721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:21.543505 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:21.543475    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="511b4d49-1ffd-48fb-aaae-ec9d7151354f" path="/var/lib/kubelet/pods/511b4d49-1ffd-48fb-aaae-ec9d7151354f/volumes"
Sep 19 11:47:22.098690 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:22.098657    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:22.099541 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:22.099513    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:24.709740 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.709716    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:47:24.884796 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.884768    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-certs\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.884984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.884807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-podinfo\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.884984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.884887    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74895687-fb84-4fb6-943f-d2766dd70f9a-istiod-ca-cert\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.884984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.884943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-envoy\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.884984 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.884973    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-token\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.885211 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-credential-socket\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.885211 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz4dm\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-kube-api-access-fz4dm\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.885211 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-data\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.885211 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885173    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-socket\") pod \"74895687-fb84-4fb6-943f-d2766dd70f9a\" (UID: \"74895687-fb84-4fb6-943f-d2766dd70f9a\") "
Sep 19 11:47:24.885428 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885087    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:24.885428 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885389    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:24.885533 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74895687-fb84-4fb6-943f-d2766dd70f9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:47:24.885587 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885531    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:24.885649 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885607    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.885649 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885629    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74895687-fb84-4fb6-943f-d2766dd70f9a-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.885755 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885651    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.885755 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885665    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.885755 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.885629    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:24.887320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.887293    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-kube-api-access-fz4dm" (OuterVolumeSpecName: "kube-api-access-fz4dm") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "kube-api-access-fz4dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:47:24.887524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.887493    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:24.887524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.887516    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:47:24.887524 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.887518    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74895687-fb84-4fb6-943f-d2766dd70f9a" (UID: "74895687-fb84-4fb6-943f-d2766dd70f9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:47:24.987064 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.987030    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.987064 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.987056    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.987064 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.987065    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.987064 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.987073    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:24.987416 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:24.987081    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz4dm\" (UniqueName: \"kubernetes.io/projected/74895687-fb84-4fb6-943f-d2766dd70f9a-kube-api-access-fz4dm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:25.117270 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.117235    2582 generic.go:356] "Generic (PLEG): container finished" podID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerID="0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff" exitCode=0
Sep 19 11:47:25.117476 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.117293    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"
Sep 19 11:47:25.117476 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.117315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" event={"ID":"74895687-fb84-4fb6-943f-d2766dd70f9a","Type":"ContainerDied","Data":"0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff"}
Sep 19 11:47:25.117476 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.117378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq" event={"ID":"74895687-fb84-4fb6-943f-d2766dd70f9a","Type":"ContainerDied","Data":"948d2f807953a88966c9b0e62d7e6f1e3b0f099e5a485c8e47129c889a74b180"}
Sep 19 11:47:25.117476 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.117409    2582 scope.go:117] "RemoveContainer" containerID="0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff"
Sep 19 11:47:25.127188 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.127171    2582 scope.go:117] "RemoveContainer" containerID="331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"
Sep 19 11:47:25.135883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.135864    2582 scope.go:117] "RemoveContainer" containerID="0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff"
Sep 19 11:47:25.136213 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:47:25.136190    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff\": container with ID starting with 0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff not found: ID does not exist" containerID="0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff"
Sep 19 11:47:25.136282 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.136226    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff"} err="failed to get container status \"0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff\": rpc error: code = NotFound desc = could not find container \"0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff\": container with ID starting with 0782fed794e649e839b65bd64380e3798816cec93ce687cd7dd472caf3c67eff not found: ID does not exist"
Sep 19 11:47:25.136282 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.136249    2582 scope.go:117] "RemoveContainer" containerID="331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"
Sep 19 11:47:25.136549 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:47:25.136528    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4\": container with ID starting with 331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4 not found: ID does not exist" containerID="331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"
Sep 19 11:47:25.136643 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.136551    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4"} err="failed to get container status \"331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4\": rpc error: code = NotFound desc = could not find container \"331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4\": container with ID starting with 331c8ee3384549be54627472146f0d1f6f9b9d1b1e5e9ae72a6641e378f2d1b4 not found: ID does not exist"
Sep 19 11:47:25.141143 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.141118    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"]
Sep 19 11:47:25.145441 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.145417    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-7a524f-openshift-default-7df9788c44-szcgq"]
Sep 19 11:47:25.482553 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.482521    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"]
Sep 19 11:47:25.482981 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.482966    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy"
Sep 19 11:47:25.483042 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.482983    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy"
Sep 19 11:47:25.483083 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.483068    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy"
Sep 19 11:47:25.483083 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.483079    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy"
Sep 19 11:47:25.487839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.487822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.490402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.490380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a527d4\""
Sep 19 11:47:25.499448 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.498247    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"]
Sep 19 11:47:25.543316 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.543284    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" path="/var/lib/kubelet/pods/74895687-fb84-4fb6-943f-d2766dd70f9a/volumes"
Sep 19 11:47:25.550602 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.550575    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:47:25.593454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.593429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5876a941-b9c2-425d-b33e-fdeb715bc0ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.593454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.593459    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2pdp\" (UniqueName: \"kubernetes.io/projected/5876a941-b9c2-425d-b33e-fdeb715bc0ea-kube-api-access-p2pdp\") pod \"payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.694758 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.694723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5876a941-b9c2-425d-b33e-fdeb715bc0ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.694968 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.694763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2pdp\" (UniqueName: \"kubernetes.io/projected/5876a941-b9c2-425d-b33e-fdeb715bc0ea-kube-api-access-p2pdp\") pod \"payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.695542 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.695519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5876a941-b9c2-425d-b33e-fdeb715bc0ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.701792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.701770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2pdp\" (UniqueName: \"kubernetes.io/projected/5876a941-b9c2-425d-b33e-fdeb715bc0ea-kube-api-access-p2pdp\") pod \"payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:25.800369 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:25.800282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:26.075959 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:26.075909    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"]
Sep 19 11:47:26.080809 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:47:26.079140    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5876a941_b9c2_425d_b33e_fdeb715bc0ea.slice/crio-543a195556061f3e1e8a94f5f0859eb0ee4155744063fdf08204b80e59dd73a1 WatchSource:0}: Error finding container 543a195556061f3e1e8a94f5f0859eb0ee4155744063fdf08204b80e59dd73a1: Status 404 returned error can't find the container with id 543a195556061f3e1e8a94f5f0859eb0ee4155744063fdf08204b80e59dd73a1
Sep 19 11:47:26.124871 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:26.124844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v" event={"ID":"5876a941-b9c2-425d-b33e-fdeb715bc0ea","Type":"ContainerStarted","Data":"543a195556061f3e1e8a94f5f0859eb0ee4155744063fdf08204b80e59dd73a1"}
Sep 19 11:47:27.133386 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:27.133351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v" event={"ID":"5876a941-b9c2-425d-b33e-fdeb715bc0ea","Type":"ContainerStarted","Data":"1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451"}
Sep 19 11:47:27.133862 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:27.133439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:27.149142 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:27.149086    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v" podStartSLOduration=2.149071519 podStartE2EDuration="2.149071519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:47:27.147290191 +0000 UTC m=+818.164326914" watchObservedRunningTime="2026-09-19 11:47:27.149071519 +0000 UTC m=+818.166108292"
Sep 19 11:47:30.545267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.545229    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" podUID="410c2df2-caca-41ad-84ee-ad1f755aa035" containerName="main" containerID="cri-o://f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd" gracePeriod=45
Sep 19 11:47:30.583041 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.583003    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" podUID="410c2df2-caca-41ad-84ee-ad1f755aa035" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": dial tcp 10.133.0.59:8000: connect: connection refused"
Sep 19 11:47:30.791486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.791463    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:47:30.944131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-home\") pod \"410c2df2-caca-41ad-84ee-ad1f755aa035\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") "
Sep 19 11:47:30.944131 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-tmp-dir\") pod \"410c2df2-caca-41ad-84ee-ad1f755aa035\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") "
Sep 19 11:47:30.944349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944149    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-model-cache\") pod \"410c2df2-caca-41ad-84ee-ad1f755aa035\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") "
Sep 19 11:47:30.944349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwl6r\" (UniqueName: \"kubernetes.io/projected/410c2df2-caca-41ad-84ee-ad1f755aa035-kube-api-access-dwl6r\") pod \"410c2df2-caca-41ad-84ee-ad1f755aa035\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") "
Sep 19 11:47:30.944349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944226    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410c2df2-caca-41ad-84ee-ad1f755aa035-tls-certs\") pod \"410c2df2-caca-41ad-84ee-ad1f755aa035\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") "
Sep 19 11:47:30.944349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-dshm\") pod \"410c2df2-caca-41ad-84ee-ad1f755aa035\" (UID: \"410c2df2-caca-41ad-84ee-ad1f755aa035\") "
Sep 19 11:47:30.944568 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944330    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-home" (OuterVolumeSpecName: "home") pod "410c2df2-caca-41ad-84ee-ad1f755aa035" (UID: "410c2df2-caca-41ad-84ee-ad1f755aa035"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:30.944568 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "410c2df2-caca-41ad-84ee-ad1f755aa035" (UID: "410c2df2-caca-41ad-84ee-ad1f755aa035"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:30.944568 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944441    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-model-cache" (OuterVolumeSpecName: "model-cache") pod "410c2df2-caca-41ad-84ee-ad1f755aa035" (UID: "410c2df2-caca-41ad-84ee-ad1f755aa035"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:30.944721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944605    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:30.944721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944627    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:30.944721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.944668    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:30.946447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.946416    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-dshm" (OuterVolumeSpecName: "dshm") pod "410c2df2-caca-41ad-84ee-ad1f755aa035" (UID: "410c2df2-caca-41ad-84ee-ad1f755aa035"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:47:30.946447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.946435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410c2df2-caca-41ad-84ee-ad1f755aa035-kube-api-access-dwl6r" (OuterVolumeSpecName: "kube-api-access-dwl6r") pod "410c2df2-caca-41ad-84ee-ad1f755aa035" (UID: "410c2df2-caca-41ad-84ee-ad1f755aa035"). InnerVolumeSpecName "kube-api-access-dwl6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:47:30.946595 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:30.946486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410c2df2-caca-41ad-84ee-ad1f755aa035-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "410c2df2-caca-41ad-84ee-ad1f755aa035" (UID: "410c2df2-caca-41ad-84ee-ad1f755aa035"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:47:31.045381 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.045347    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwl6r\" (UniqueName: \"kubernetes.io/projected/410c2df2-caca-41ad-84ee-ad1f755aa035-kube-api-access-dwl6r\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:31.045381 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.045381    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410c2df2-caca-41ad-84ee-ad1f755aa035-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:31.045583 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.045396    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410c2df2-caca-41ad-84ee-ad1f755aa035-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:47:31.167672 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.167640    2582 generic.go:356] "Generic (PLEG): container finished" podID="410c2df2-caca-41ad-84ee-ad1f755aa035" containerID="f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd" exitCode=0
Sep 19 11:47:31.167839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.167693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" event={"ID":"410c2df2-caca-41ad-84ee-ad1f755aa035","Type":"ContainerDied","Data":"f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd"}
Sep 19 11:47:31.167839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.167705    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"
Sep 19 11:47:31.167839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.167721    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz" event={"ID":"410c2df2-caca-41ad-84ee-ad1f755aa035","Type":"ContainerDied","Data":"69e029769abf6fa9b71625ed3ea2cd6372dcfe94031235c79db41913a32734a7"}
Sep 19 11:47:31.167839 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.167736    2582 scope.go:117] "RemoveContainer" containerID="f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd"
Sep 19 11:47:31.177332 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.177309    2582 scope.go:117] "RemoveContainer" containerID="f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd"
Sep 19 11:47:31.177614 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:47:31.177594    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd\": container with ID starting with f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd not found: ID does not exist" containerID="f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd"
Sep 19 11:47:31.177678 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.177621    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd"} err="failed to get container status \"f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd\": rpc error: code = NotFound desc = could not find container \"f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd\": container with ID starting with f22cb499beb03aab1df72644354ff22caa191a29f101d897256d189eb62b03bd not found: ID does not exist"
Sep 19 11:47:31.190619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.190591    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"]
Sep 19 11:47:31.192731 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.192710    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-37daed/simulator-w4-37daed-kserve-996d898bb-f7mlz"]
Sep 19 11:47:31.544593 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:31.544562    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410c2df2-caca-41ad-84ee-ad1f755aa035" path="/var/lib/kubelet/pods/410c2df2-caca-41ad-84ee-ad1f755aa035/volumes"
Sep 19 11:47:38.141457 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:38.141422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:47:51.053385 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:51.053348    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:47:52.099841 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.099805    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:52.100305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.099890    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:52.296043 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.296009    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerID="e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267" exitCode=0
Sep 19 11:47:52.296206 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.296082    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" event={"ID":"fe0d3432-2bf2-4e87-8015-dbada7a4b40b","Type":"ContainerDied","Data":"e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"}
Sep 19 11:47:52.296494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.296480    2582 scope.go:117] "RemoveContainer" containerID="e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"
Sep 19 11:47:52.297646 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.297615    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:47:52.297753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.297698    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:47:52.297753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:52.297742    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:47:53.303487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:53.303454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" event={"ID":"fe0d3432-2bf2-4e87-8015-dbada7a4b40b","Type":"ContainerStarted","Data":"ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3"}
Sep 19 11:47:53.478026 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:53.477985    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:53.478535 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:53.478506    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:53.478738 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:53.478702    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:54.478260 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:54.478220    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:54.478745 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:54.478286    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:55.478351 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:55.478308    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:55.478836 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:55.478384    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:56.478378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:56.478338    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:56.478989 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:56.478409    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:57.477872 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:57.477828    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:57.478098 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:57.477900    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:58.477535 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:58.477499    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 19 11:47:58.478139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:58.478104    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 19 11:47:59.481981 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:59.481951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:59.482372 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:59.482216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:47:59.482952 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:47:59.482932    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:48:05.412730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.412693    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"]
Sep 19 11:48:05.413306 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.413285    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy"
Sep 19 11:48:05.413402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.413309    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74895687-fb84-4fb6-943f-d2766dd70f9a" containerName="istio-proxy"
Sep 19 11:48:05.413402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.413341    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410c2df2-caca-41ad-84ee-ad1f755aa035" containerName="main"
Sep 19 11:48:05.413402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.413351    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="410c2df2-caca-41ad-84ee-ad1f755aa035" containerName="main"
Sep 19 11:48:05.413559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.413438    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="410c2df2-caca-41ad-84ee-ad1f755aa035" containerName="main"
Sep 19 11:48:05.416980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.416957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.419347 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.419328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c4de155d-openshift-default-dockercfg-q7wx6\""
Sep 19 11:48:05.429752 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.429727    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"]
Sep 19 11:48:05.514637 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-certs\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.514637 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c779482d-522b-47ff-85bc-9858e847b5e1-istio-podinfo\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.514835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-socket\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.514835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-istio-token\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.514835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-data\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.514835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-envoy\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.514835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv5h2\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-kube-api-access-jv5h2\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.515052 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c779482d-522b-47ff-85bc-9858e847b5e1-istiod-ca-cert\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.515052 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.514967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-credential-socket\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.616315 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.616276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv5h2\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-kube-api-access-jv5h2\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.616645 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.616627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c779482d-522b-47ff-85bc-9858e847b5e1-istiod-ca-cert\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.616792 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.616773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-credential-socket\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.616956 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.616940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-certs\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.617077 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.617063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c779482d-522b-47ff-85bc-9858e847b5e1-istio-podinfo\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.617185 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.617172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-socket\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.618276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.618254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-istio-token\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.618736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.618715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-data\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.619241 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.619223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-envoy\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.619644 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.618148    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-socket\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.619758 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.617327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-credential-socket\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.619845 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.617536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-certs\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.619952 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.619138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-data\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.620052 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.617894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c779482d-522b-47ff-85bc-9858e847b5e1-istiod-ca-cert\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.622460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.622431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-envoy\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.622795 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.622776    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c779482d-522b-47ff-85bc-9858e847b5e1-istio-podinfo\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.625764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.625724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv5h2\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-kube-api-access-jv5h2\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.626596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.626240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-istio-token\") pod \"e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") " pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:05.727727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:05.727651    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:06.065454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.065421    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"]
Sep 19 11:48:06.068589 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.068543    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:48:06.068836 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.068812    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:48:06.069033 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.069008    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:48:06.383231 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.383143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" event={"ID":"c779482d-522b-47ff-85bc-9858e847b5e1","Type":"ContainerStarted","Data":"5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"}
Sep 19 11:48:06.383231 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.383197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" event={"ID":"c779482d-522b-47ff-85bc-9858e847b5e1","Type":"ContainerStarted","Data":"281bc44c99fad3de927abc71665755fa435fa68439fe5957a7f117b49cc6545d"}
Sep 19 11:48:06.405736 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.405684    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podStartSLOduration=1.405669589 podStartE2EDuration="1.405669589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:48:06.403131696 +0000 UTC m=+857.420168407" watchObservedRunningTime="2026-09-19 11:48:06.405669589 +0000 UTC m=+857.422706378"
Sep 19 11:48:06.728134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:06.728052    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:07.734144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:07.734115    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:08.393980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:08.393950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:08.394840 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:08.394824    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:14.846460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.846427    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"]
Sep 19 11:48:14.850148 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.850132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:14.852784 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.852762    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c4de155d-dockercfg-sfbdg\""
Sep 19 11:48:14.852959 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.852788    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c4de155d\""
Sep 19 11:48:14.859580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.859554    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"]
Sep 19 11:48:14.880608 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.880586    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"]
Sep 19 11:48:14.883963 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.883946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:14.892937 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.892893    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"]
Sep 19 11:48:14.917180 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.917146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a698d99b-b273-454c-a148-eaf056d631f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:14.917303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:14.917182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsrz\" (UniqueName: \"kubernetes.io/projected/a698d99b-b273-454c-a148-eaf056d631f3-kube-api-access-tdsrz\") pod \"payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:15.018668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.018622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a698d99b-b273-454c-a148-eaf056d631f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:15.018668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.018668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsrz\" (UniqueName: \"kubernetes.io/projected/a698d99b-b273-454c-a148-eaf056d631f3-kube-api-access-tdsrz\") pod \"payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:15.018946 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.018695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8l6k\" (UniqueName: \"kubernetes.io/projected/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-kube-api-access-l8l6k\") pod \"payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") " pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.018946 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.018747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-plugins-config-volume\") pod \"payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") " pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.019408 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.019386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a698d99b-b273-454c-a148-eaf056d631f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:15.025862 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.025842    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsrz\" (UniqueName: \"kubernetes.io/projected/a698d99b-b273-454c-a148-eaf056d631f3-kube-api-access-tdsrz\") pod \"payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:15.120340 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.120256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8l6k\" (UniqueName: \"kubernetes.io/projected/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-kube-api-access-l8l6k\") pod \"payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") " pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.120340 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.120305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-plugins-config-volume\") pod \"payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") " pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.121035 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.121013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-plugins-config-volume\") pod \"payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") " pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.128129 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.128107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8l6k\" (UniqueName: \"kubernetes.io/projected/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-kube-api-access-l8l6k\") pod \"payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") " pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.162607 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.162578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:15.195040 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.194995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:15.437105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.437080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"]
Sep 19 11:48:15.438617 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:48:15.438579    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda698d99b_b273_454c_a148_eaf056d631f3.slice/crio-2dbf0a084e4f89de33ff9a3ac1c9a248d5ac39b17775a4b11eed1159cad61f8b WatchSource:0}: Error finding container 2dbf0a084e4f89de33ff9a3ac1c9a248d5ac39b17775a4b11eed1159cad61f8b: Status 404 returned error can't find the container with id 2dbf0a084e4f89de33ff9a3ac1c9a248d5ac39b17775a4b11eed1159cad61f8b
Sep 19 11:48:15.474650 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:15.474625    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"]
Sep 19 11:48:15.477998 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:48:15.477975    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86ded3b_4bf6_4cf2_a6fa_b60220010f00.slice/crio-ddf8ff6068512aa7c9029199dced2a99ccc4c7433b4a36678d1ffd806b82ba22 WatchSource:0}: Error finding container ddf8ff6068512aa7c9029199dced2a99ccc4c7433b4a36678d1ffd806b82ba22: Status 404 returned error can't find the container with id ddf8ff6068512aa7c9029199dced2a99ccc4c7433b4a36678d1ffd806b82ba22
Sep 19 11:48:16.444583 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.444548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89" event={"ID":"b86ded3b-4bf6-4cf2-a6fa-b60220010f00","Type":"ContainerStarted","Data":"1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c"}
Sep 19 11:48:16.445085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.444614    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:16.445085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.444639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89" event={"ID":"b86ded3b-4bf6-4cf2-a6fa-b60220010f00","Type":"ContainerStarted","Data":"ddf8ff6068512aa7c9029199dced2a99ccc4c7433b4a36678d1ffd806b82ba22"}
Sep 19 11:48:16.446188 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.446164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k" event={"ID":"a698d99b-b273-454c-a148-eaf056d631f3","Type":"ContainerStarted","Data":"65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb"}
Sep 19 11:48:16.446303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.446203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k" event={"ID":"a698d99b-b273-454c-a148-eaf056d631f3","Type":"ContainerStarted","Data":"2dbf0a084e4f89de33ff9a3ac1c9a248d5ac39b17775a4b11eed1159cad61f8b"}
Sep 19 11:48:16.446303 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.446281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:16.460963 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.460888    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89" podStartSLOduration=2.460872672 podStartE2EDuration="2.460872672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:48:16.459152135 +0000 UTC m=+867.476188846" watchObservedRunningTime="2026-09-19 11:48:16.460872672 +0000 UTC m=+867.477909408"
Sep 19 11:48:16.475768 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:16.475718    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k" podStartSLOduration=2.475701582 podStartE2EDuration="2.475701582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:48:16.473168432 +0000 UTC m=+867.490205146" watchObservedRunningTime="2026-09-19 11:48:16.475701582 +0000 UTC m=+867.492738301"
Sep 19 11:48:24.756843 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:24.756810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:48:27.454562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:27.454534    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:27.455002 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:27.454982    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:36.565413 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:36.565375    2582 generic.go:356] "Generic (PLEG): container finished" podID="c779482d-522b-47ff-85bc-9858e847b5e1" containerID="5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909" exitCode=0
Sep 19 11:48:36.565837 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:36.565444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" event={"ID":"c779482d-522b-47ff-85bc-9858e847b5e1","Type":"ContainerDied","Data":"5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"}
Sep 19 11:48:36.565900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:36.565872    2582 scope.go:117] "RemoveContainer" containerID="5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"
Sep 19 11:48:36.567226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:36.567196    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:48:36.567293 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:36.567279    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:48:36.567343 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:36.567327    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:48:37.572720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:37.572676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" event={"ID":"c779482d-522b-47ff-85bc-9858e847b5e1","Type":"ContainerStarted","Data":"8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397"}
Sep 19 11:48:37.728403 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:37.728368    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:37.729633 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:37.729607    2582 patch_prober.go:28] interesting pod/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 19 11:48:37.729739 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:37.729669    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 19 11:48:38.394609 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:38.394575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:38.728642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:38.728561    2582 patch_prober.go:28] interesting pod/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 19 11:48:38.728642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:38.728621    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 19 11:48:39.728821 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:39.728787    2582 patch_prober.go:28] interesting pod/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 19 11:48:39.729259 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:39.728862    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 19 11:48:40.728196 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:40.728160    2582 patch_prober.go:28] interesting pod/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 19 11:48:40.728368 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:40.728214    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 19 11:48:41.727994 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.727961    2582 patch_prober.go:28] interesting pod/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 19 11:48:41.728378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.728019    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 19 11:48:41.824071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.824036    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"]
Sep 19 11:48:41.826538 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.826513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:41.828804 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.828773    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d8d8bb\"/\"default-dockercfg-64hkv\""
Sep 19 11:48:41.829846 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.829823    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d8d8bb\"/\"kube-root-ca.crt\""
Sep 19 11:48:41.830008 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.829985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d8d8bb\"/\"test-model-d8d8bb-kserve-self-signed-certs\""
Sep 19 11:48:41.830086 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.829987    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d8d8bb\"/\"openshift-service-ca.crt\""
Sep 19 11:48:41.837220 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.837197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"]
Sep 19 11:48:41.906569 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.906527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-model-cache\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:41.906569 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.906571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlgw\" (UniqueName: \"kubernetes.io/projected/f555bf68-41a8-46e8-852a-ea305f57f8e8-kube-api-access-9tlgw\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:41.906798 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.906698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f555bf68-41a8-46e8-852a-ea305f57f8e8-tls-certs\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:41.906798 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.906736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-dshm\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:41.906798 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.906755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-tmp-dir\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:41.906904 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:41.906843    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-home\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.007529 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.007490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-model-cache\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.007730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.007549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlgw\" (UniqueName: \"kubernetes.io/projected/f555bf68-41a8-46e8-852a-ea305f57f8e8-kube-api-access-9tlgw\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.007730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.007637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f555bf68-41a8-46e8-852a-ea305f57f8e8-tls-certs\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.007730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.007672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-dshm\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.007730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.007692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-tmp-dir\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.008007 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.007754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-home\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.008070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.008001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-model-cache\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.008144 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.008122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-home\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.008243 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.008222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-tmp-dir\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.010031 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.010006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-dshm\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.010319 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.010300    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f555bf68-41a8-46e8-852a-ea305f57f8e8-tls-certs\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.017953 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.017890    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlgw\" (UniqueName: \"kubernetes.io/projected/f555bf68-41a8-46e8-852a-ea305f57f8e8-kube-api-access-9tlgw\") pod \"test-model-d8d8bb-kserve-66c9b76474-wgj2z\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") " pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.137352 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.137276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:42.429533 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.429503    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"]
Sep 19 11:48:42.431478 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:48:42.431452    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf555bf68_41a8_46e8_852a_ea305f57f8e8.slice/crio-394e5613e0653bb29663d32cb8293d8809b79f7c05fefac720e89caf6e59ea80 WatchSource:0}: Error finding container 394e5613e0653bb29663d32cb8293d8809b79f7c05fefac720e89caf6e59ea80: Status 404 returned error can't find the container with id 394e5613e0653bb29663d32cb8293d8809b79f7c05fefac720e89caf6e59ea80
Sep 19 11:48:42.613999 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.613955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" event={"ID":"f555bf68-41a8-46e8-852a-ea305f57f8e8","Type":"ContainerStarted","Data":"f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac"}
Sep 19 11:48:42.614202 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.614016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" event={"ID":"f555bf68-41a8-46e8-852a-ea305f57f8e8","Type":"ContainerStarted","Data":"394e5613e0653bb29663d32cb8293d8809b79f7c05fefac720e89caf6e59ea80"}
Sep 19 11:48:42.630204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.630147    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" podStartSLOduration=1.630125523 podStartE2EDuration="1.630125523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:48:42.629518702 +0000 UTC m=+893.646555415" watchObservedRunningTime="2026-09-19 11:48:42.630125523 +0000 UTC m=+893.647162235"
Sep 19 11:48:42.732771 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.732736    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:42.733820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:42.733801    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:48:43.138266 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:43.138189    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:44.340454 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:44.340416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:48:52.137867 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:52.137832    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:52.151554 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:52.151528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:52.681619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:52.681590    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:48:53.817450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:53.817413    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"]
Sep 19 11:48:53.817882 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:53.817632    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89" podUID="b86ded3b-4bf6-4cf2-a6fa-b60220010f00" containerName="payload-processing" containerID="cri-o://1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c" gracePeriod=30
Sep 19 11:48:53.824458 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:53.824426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"]
Sep 19 11:48:53.824712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:53.824662    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k" podUID="a698d99b-b273-454c-a148-eaf056d631f3" containerName="payload-pre-processing" containerID="cri-o://65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb" gracePeriod=30
Sep 19 11:48:54.103437 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.103410    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:54.106350 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.106327    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:54.236059 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236020    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a698d99b-b273-454c-a148-eaf056d631f3-plugins-config-volume\") pod \"a698d99b-b273-454c-a148-eaf056d631f3\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") "
Sep 19 11:48:54.236226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-plugins-config-volume\") pod \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") "
Sep 19 11:48:54.236226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdsrz\" (UniqueName: \"kubernetes.io/projected/a698d99b-b273-454c-a148-eaf056d631f3-kube-api-access-tdsrz\") pod \"a698d99b-b273-454c-a148-eaf056d631f3\" (UID: \"a698d99b-b273-454c-a148-eaf056d631f3\") "
Sep 19 11:48:54.236369 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236277    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8l6k\" (UniqueName: \"kubernetes.io/projected/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-kube-api-access-l8l6k\") pod \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\" (UID: \"b86ded3b-4bf6-4cf2-a6fa-b60220010f00\") "
Sep 19 11:48:54.236514 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236484    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a698d99b-b273-454c-a148-eaf056d631f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a698d99b-b273-454c-a148-eaf056d631f3" (UID: "a698d99b-b273-454c-a148-eaf056d631f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:48:54.236591 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236515    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b86ded3b-4bf6-4cf2-a6fa-b60220010f00" (UID: "b86ded3b-4bf6-4cf2-a6fa-b60220010f00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:48:54.236783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236759    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a698d99b-b273-454c-a148-eaf056d631f3-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:48:54.236883 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.236784    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:48:54.238430 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.238402    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a698d99b-b273-454c-a148-eaf056d631f3-kube-api-access-tdsrz" (OuterVolumeSpecName: "kube-api-access-tdsrz") pod "a698d99b-b273-454c-a148-eaf056d631f3" (UID: "a698d99b-b273-454c-a148-eaf056d631f3"). InnerVolumeSpecName "kube-api-access-tdsrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:48:54.238513 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.238435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-kube-api-access-l8l6k" (OuterVolumeSpecName: "kube-api-access-l8l6k") pod "b86ded3b-4bf6-4cf2-a6fa-b60220010f00" (UID: "b86ded3b-4bf6-4cf2-a6fa-b60220010f00"). InnerVolumeSpecName "kube-api-access-l8l6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:48:54.338201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.338113    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8l6k\" (UniqueName: \"kubernetes.io/projected/b86ded3b-4bf6-4cf2-a6fa-b60220010f00-kube-api-access-l8l6k\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:48:54.338201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.338141    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdsrz\" (UniqueName: \"kubernetes.io/projected/a698d99b-b273-454c-a148-eaf056d631f3-kube-api-access-tdsrz\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:48:54.683420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.683327    2582 generic.go:356] "Generic (PLEG): container finished" podID="a698d99b-b273-454c-a148-eaf056d631f3" containerID="65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb" exitCode=0
Sep 19 11:48:54.683420 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.683382    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"
Sep 19 11:48:54.683642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.683416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k" event={"ID":"a698d99b-b273-454c-a148-eaf056d631f3","Type":"ContainerDied","Data":"65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb"}
Sep 19 11:48:54.683642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.683470    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k" event={"ID":"a698d99b-b273-454c-a148-eaf056d631f3","Type":"ContainerDied","Data":"2dbf0a084e4f89de33ff9a3ac1c9a248d5ac39b17775a4b11eed1159cad61f8b"}
Sep 19 11:48:54.683642 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.683495    2582 scope.go:117] "RemoveContainer" containerID="65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb"
Sep 19 11:48:54.685105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.685080    2582 generic.go:356] "Generic (PLEG): container finished" podID="b86ded3b-4bf6-4cf2-a6fa-b60220010f00" containerID="1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c" exitCode=0
Sep 19 11:48:54.685291 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.685121    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"
Sep 19 11:48:54.685427 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.685139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89" event={"ID":"b86ded3b-4bf6-4cf2-a6fa-b60220010f00","Type":"ContainerDied","Data":"1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c"}
Sep 19 11:48:54.685485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.685443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89" event={"ID":"b86ded3b-4bf6-4cf2-a6fa-b60220010f00","Type":"ContainerDied","Data":"ddf8ff6068512aa7c9029199dced2a99ccc4c7433b4a36678d1ffd806b82ba22"}
Sep 19 11:48:54.695349 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.695324    2582 scope.go:117] "RemoveContainer" containerID="65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb"
Sep 19 11:48:54.695681 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:48:54.695656    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb\": container with ID starting with 65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb not found: ID does not exist" containerID="65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb"
Sep 19 11:48:54.695779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.695690    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb"} err="failed to get container status \"65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb\": rpc error: code = NotFound desc = could not find container \"65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb\": container with ID starting with 65779e950286813d2e77f9b2b61d80f1f665c54bcecc4b5d2861e365b040a2cb not found: ID does not exist"
Sep 19 11:48:54.695779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.695707    2582 scope.go:117] "RemoveContainer" containerID="1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c"
Sep 19 11:48:54.705020 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.705001    2582 scope.go:117] "RemoveContainer" containerID="1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c"
Sep 19 11:48:54.705388 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:48:54.705352    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c\": container with ID starting with 1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c not found: ID does not exist" containerID="1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c"
Sep 19 11:48:54.705492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.705383    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c"} err="failed to get container status \"1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c\": rpc error: code = NotFound desc = could not find container \"1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c\": container with ID starting with 1c3b0634fd61839756aff52b5c39a90eeb0843375c98018d27af40016339773c not found: ID does not exist"
Sep 19 11:48:54.707857 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.707834    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"]
Sep 19 11:48:54.713443 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.713420    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c4de155d-769bfff46b-nlq4k"]
Sep 19 11:48:54.722973 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.722952    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"]
Sep 19 11:48:54.725498 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:54.725476    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c4de155d-5d54887c97-7zd89"]
Sep 19 11:48:55.544126 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:55.544089    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a698d99b-b273-454c-a148-eaf056d631f3" path="/var/lib/kubelet/pods/a698d99b-b273-454c-a148-eaf056d631f3/volumes"
Sep 19 11:48:55.544498 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:48:55.544483    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86ded3b-4bf6-4cf2-a6fa-b60220010f00" path="/var/lib/kubelet/pods/b86ded3b-4bf6-4cf2-a6fa-b60220010f00/volumes"
Sep 19 11:49:00.801741 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:00.801706    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"]
Sep 19 11:49:00.802248 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:00.802006    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy" containerID="cri-o://8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397" gracePeriod=30
Sep 19 11:49:06.059504 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.059475    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:49:06.159973 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.159880    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-credential-socket\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.159973 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.159933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-certs\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.159983    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c779482d-522b-47ff-85bc-9858e847b5e1-istio-podinfo\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160008    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv5h2\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-kube-api-access-jv5h2\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-socket\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160071    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-data\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c779482d-522b-47ff-85bc-9858e847b5e1-istiod-ca-cert\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-istio-token\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-envoy\") pod \"c779482d-522b-47ff-85bc-9858e847b5e1\" (UID: \"c779482d-522b-47ff-85bc-9858e847b5e1\") "
Sep 19 11:49:06.160181 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160171    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:06.160599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160285    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:06.160599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:06.160599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:06.160599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160518    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c779482d-522b-47ff-85bc-9858e847b5e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:49:06.160783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160661    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.160783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160680    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.160783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160693    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c779482d-522b-47ff-85bc-9858e847b5e1-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.160783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160708    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.160783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.160722    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.162245 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.162218    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c779482d-522b-47ff-85bc-9858e847b5e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:49:06.162339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.162259    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-kube-api-access-jv5h2" (OuterVolumeSpecName: "kube-api-access-jv5h2") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "kube-api-access-jv5h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:49:06.162692 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.162677    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:06.162749 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.162694    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "c779482d-522b-47ff-85bc-9858e847b5e1" (UID: "c779482d-522b-47ff-85bc-9858e847b5e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:49:06.265359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.265326    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.265359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.265355    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c779482d-522b-47ff-85bc-9858e847b5e1-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.265359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.265364    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c779482d-522b-47ff-85bc-9858e847b5e1-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.265637 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.265373    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv5h2\" (UniqueName: \"kubernetes.io/projected/c779482d-522b-47ff-85bc-9858e847b5e1-kube-api-access-jv5h2\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:06.758502 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.758461    2582 generic.go:356] "Generic (PLEG): container finished" podID="c779482d-522b-47ff-85bc-9858e847b5e1" containerID="8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397" exitCode=0
Sep 19 11:49:06.758702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.758503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" event={"ID":"c779482d-522b-47ff-85bc-9858e847b5e1","Type":"ContainerDied","Data":"8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397"}
Sep 19 11:49:06.758702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.758521    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"
Sep 19 11:49:06.758702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.758568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx" event={"ID":"c779482d-522b-47ff-85bc-9858e847b5e1","Type":"ContainerDied","Data":"281bc44c99fad3de927abc71665755fa435fa68439fe5957a7f117b49cc6545d"}
Sep 19 11:49:06.758702 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.758599    2582 scope.go:117] "RemoveContainer" containerID="8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397"
Sep 19 11:49:06.771730 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.771709    2582 scope.go:117] "RemoveContainer" containerID="5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"
Sep 19 11:49:06.780572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.780547    2582 scope.go:117] "RemoveContainer" containerID="8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397"
Sep 19 11:49:06.780981 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:06.780955    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397\": container with ID starting with 8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397 not found: ID does not exist" containerID="8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397"
Sep 19 11:49:06.781082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.780988    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397"} err="failed to get container status \"8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397\": rpc error: code = NotFound desc = could not find container \"8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397\": container with ID starting with 8aa49e339245b2c074397c626d45e99f3ad55d8f2a61f3388dbea87706be8397 not found: ID does not exist"
Sep 19 11:49:06.781082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.781005    2582 scope.go:117] "RemoveContainer" containerID="5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"
Sep 19 11:49:06.781390 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:06.781369    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909\": container with ID starting with 5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909 not found: ID does not exist" containerID="5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"
Sep 19 11:49:06.781466 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.781396    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909"} err="failed to get container status \"5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909\": rpc error: code = NotFound desc = could not find container \"5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909\": container with ID starting with 5be58c301e595a1c62ba503f972632387c8a09cc976d0a1155a3c5a72178a909 not found: ID does not exist"
Sep 19 11:49:06.783388 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.783367    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"]
Sep 19 11:49:06.789294 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:06.789274    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c4de155d-openshift-default-6fbf4d6644-n7jbx"]
Sep 19 11:49:07.544289 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:07.544253    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" path="/var/lib/kubelet/pods/c779482d-522b-47ff-85bc-9858e847b5e1/volumes"
Sep 19 11:49:15.130183 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130145    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"]
Sep 19 11:49:15.130767 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130751    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy"
Sep 19 11:49:15.130929 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130769    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy"
Sep 19 11:49:15.130929 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130789    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a698d99b-b273-454c-a148-eaf056d631f3" containerName="payload-pre-processing"
Sep 19 11:49:15.130929 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130798    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a698d99b-b273-454c-a148-eaf056d631f3" containerName="payload-pre-processing"
Sep 19 11:49:15.130929 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130824    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86ded3b-4bf6-4cf2-a6fa-b60220010f00" containerName="payload-processing"
Sep 19 11:49:15.130929 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130833    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86ded3b-4bf6-4cf2-a6fa-b60220010f00" containerName="payload-processing"
Sep 19 11:49:15.131207 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130934    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy"
Sep 19 11:49:15.131207 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130945    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a698d99b-b273-454c-a148-eaf056d631f3" containerName="payload-pre-processing"
Sep 19 11:49:15.131207 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.130958    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86ded3b-4bf6-4cf2-a6fa-b60220010f00" containerName="payload-processing"
Sep 19 11:49:15.135799 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.135775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.138165 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.138143    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-4bb32d-openshift-default-dockercfg-944rq\""
Sep 19 11:49:15.146525 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.145992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"]
Sep 19 11:49:15.254415 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istiod-ca-cert\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-data\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-credential-socket\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-token\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw88k\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-kube-api-access-dw88k\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-podinfo\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254613 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-envoy\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-certs\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.254903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.254829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-socket\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istiod-ca-cert\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356577 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-data\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356577 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-credential-socket\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356577 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-token\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw88k\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-kube-api-access-dw88k\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-podinfo\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356764 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-envoy\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-certs\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-socket\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-data\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.356966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.356929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-credential-socket\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.357207 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.357172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-socket\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.357300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.357274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istiod-ca-cert\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.357396 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.357375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-certs\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.359203 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.359181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-envoy\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.359522 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.359501    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-podinfo\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.364511 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.364483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw88k\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-kube-api-access-dw88k\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.364715 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.364694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-token\") pod \"e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") " pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.449001 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.448904    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:15.725546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.725514    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"]
Sep 19 11:49:15.727530 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:49:15.727488    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae9eb5a_c0a8_451a_8cb7_2ccdf9d03b1d.slice/crio-7ce64dbc934c7f168f587a5ae724df23df7c756061b4025fc96a74f53b2a5d7b WatchSource:0}: Error finding container 7ce64dbc934c7f168f587a5ae724df23df7c756061b4025fc96a74f53b2a5d7b: Status 404 returned error can't find the container with id 7ce64dbc934c7f168f587a5ae724df23df7c756061b4025fc96a74f53b2a5d7b
Sep 19 11:49:15.729797 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.729766    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:49:15.729876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.729830    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:49:15.729876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.729858    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:49:15.823166 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.823131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" event={"ID":"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d","Type":"ContainerStarted","Data":"c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"}
Sep 19 11:49:15.823316 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.823187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" event={"ID":"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d","Type":"ContainerStarted","Data":"7ce64dbc934c7f168f587a5ae724df23df7c756061b4025fc96a74f53b2a5d7b"}
Sep 19 11:49:15.843662 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:15.843597    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podStartSLOduration=0.843581692 podStartE2EDuration="843.581692ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:49:15.8403365 +0000 UTC m=+926.857373213" watchObservedRunningTime="2026-09-19 11:49:15.843581692 +0000 UTC m=+926.860618402"
Sep 19 11:49:16.449999 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:16.449962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:16.455440 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:16.455407    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:16.831197 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:16.831164    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:16.832205 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:16.832183    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:20.944891 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:20.944860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:49:22.212828 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.212794    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"]
Sep 19 11:49:22.213237 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.213197    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy"
Sep 19 11:49:22.213237 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.213209    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy"
Sep 19 11:49:22.213313 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.213270    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c779482d-522b-47ff-85bc-9858e847b5e1" containerName="istio-proxy"
Sep 19 11:49:22.216464 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.216444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.219039 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.219021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-4bb32d-dockercfg-b7whl\""
Sep 19 11:49:22.219316 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.219302    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-4bb32d\""
Sep 19 11:49:22.224999 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.224972    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"]
Sep 19 11:49:22.329599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.329562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljl84\" (UniqueName: \"kubernetes.io/projected/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-kube-api-access-ljl84\") pod \"payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.329787 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.329611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.430988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.430943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljl84\" (UniqueName: \"kubernetes.io/projected/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-kube-api-access-ljl84\") pod \"payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.431194 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.431014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.431744 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.431718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.438797 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.438774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljl84\" (UniqueName: \"kubernetes.io/projected/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-kube-api-access-ljl84\") pod \"payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.528691 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.528659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:22.801537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.801507    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"]
Sep 19 11:49:22.802841 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:49:22.802815    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da28c9d_5428_4d2c_b247_8b3b9b22de0a.slice/crio-d363640f7dd7fcf02dab5b2114aecfccf27b8a49a3918d6e29f6a5ed373d1f68 WatchSource:0}: Error finding container d363640f7dd7fcf02dab5b2114aecfccf27b8a49a3918d6e29f6a5ed373d1f68: Status 404 returned error can't find the container with id d363640f7dd7fcf02dab5b2114aecfccf27b8a49a3918d6e29f6a5ed373d1f68
Sep 19 11:49:22.870056 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.870014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd" event={"ID":"5da28c9d-5428-4d2c-b247-8b3b9b22de0a","Type":"ContainerStarted","Data":"d363640f7dd7fcf02dab5b2114aecfccf27b8a49a3918d6e29f6a5ed373d1f68"}
Sep 19 11:49:22.941760 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.940331    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"]
Sep 19 11:49:22.941760 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:22.940568    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v" podUID="5876a941-b9c2-425d-b33e-fdeb715bc0ea" containerName="payload-pre-processing" containerID="cri-o://1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451" gracePeriod=30
Sep 19 11:49:23.227411 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.227371    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:49:23.339605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.339516    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2pdp\" (UniqueName: \"kubernetes.io/projected/5876a941-b9c2-425d-b33e-fdeb715bc0ea-kube-api-access-p2pdp\") pod \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") "
Sep 19 11:49:23.339780 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.339627    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5876a941-b9c2-425d-b33e-fdeb715bc0ea-plugins-config-volume\") pod \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\" (UID: \"5876a941-b9c2-425d-b33e-fdeb715bc0ea\") "
Sep 19 11:49:23.340030 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.340004    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5876a941-b9c2-425d-b33e-fdeb715bc0ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5876a941-b9c2-425d-b33e-fdeb715bc0ea" (UID: "5876a941-b9c2-425d-b33e-fdeb715bc0ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:49:23.341686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.341661    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5876a941-b9c2-425d-b33e-fdeb715bc0ea-kube-api-access-p2pdp" (OuterVolumeSpecName: "kube-api-access-p2pdp") pod "5876a941-b9c2-425d-b33e-fdeb715bc0ea" (UID: "5876a941-b9c2-425d-b33e-fdeb715bc0ea"). InnerVolumeSpecName "kube-api-access-p2pdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:49:23.441204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.441163    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2pdp\" (UniqueName: \"kubernetes.io/projected/5876a941-b9c2-425d-b33e-fdeb715bc0ea-kube-api-access-p2pdp\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:23.441204 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.441199    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5876a941-b9c2-425d-b33e-fdeb715bc0ea-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:23.877401 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.877355    2582 generic.go:356] "Generic (PLEG): container finished" podID="5876a941-b9c2-425d-b33e-fdeb715bc0ea" containerID="1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451" exitCode=0
Sep 19 11:49:23.877619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.877426    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"
Sep 19 11:49:23.877619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.877421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v" event={"ID":"5876a941-b9c2-425d-b33e-fdeb715bc0ea","Type":"ContainerDied","Data":"1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451"}
Sep 19 11:49:23.877619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.877484    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v" event={"ID":"5876a941-b9c2-425d-b33e-fdeb715bc0ea","Type":"ContainerDied","Data":"543a195556061f3e1e8a94f5f0859eb0ee4155744063fdf08204b80e59dd73a1"}
Sep 19 11:49:23.877619 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.877514    2582 scope.go:117] "RemoveContainer" containerID="1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451"
Sep 19 11:49:23.879517 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.879492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd" event={"ID":"5da28c9d-5428-4d2c-b247-8b3b9b22de0a","Type":"ContainerStarted","Data":"735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60"}
Sep 19 11:49:23.879630 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.879548    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:23.886996 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.886979    2582 scope.go:117] "RemoveContainer" containerID="1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451"
Sep 19 11:49:23.887311 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:23.887282    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451\": container with ID starting with 1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451 not found: ID does not exist" containerID="1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451"
Sep 19 11:49:23.887383 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.887321    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451"} err="failed to get container status \"1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451\": rpc error: code = NotFound desc = could not find container \"1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451\": container with ID starting with 1cde9096b588d72c49874eaad92673d750da85b8a585d826a3b24e8c10b2b451 not found: ID does not exist"
Sep 19 11:49:23.899873 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.899850    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"]
Sep 19 11:49:23.903510 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.903489    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a527d4-6bc7c44f94-c6g5v"]
Sep 19 11:49:23.920327 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:23.920284    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd" podStartSLOduration=1.920270338 podStartE2EDuration="1.920270338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:49:23.917754583 +0000 UTC m=+934.934791291" watchObservedRunningTime="2026-09-19 11:49:23.920270338 +0000 UTC m=+934.937307078"
Sep 19 11:49:25.544952 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:25.544893    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5876a941-b9c2-425d-b33e-fdeb715bc0ea" path="/var/lib/kubelet/pods/5876a941-b9c2-425d-b33e-fdeb715bc0ea/volumes"
Sep 19 11:49:29.288951 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:29.288901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"]
Sep 19 11:49:29.289380 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:29.289178    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" containerID="cri-o://ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3" gracePeriod=30
Sep 19 11:49:29.484507 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:29.484468    2582 patch_prober.go:28] interesting pod/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 11:49:29.484658 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:29.484527    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 11:49:34.544939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.544896    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:49:34.556511 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556458    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-socket\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556511 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556496    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzdb8\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-kube-api-access-tzdb8\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556699 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556523    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-credential-socket\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556699 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556551    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-token\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556699 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556600    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-podinfo\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556699 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-data\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556898 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556712    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-certs\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556898 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556760    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-envoy\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556898 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556763    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:34.556898 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556821    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istiod-ca-cert\") pod \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\" (UID: \"fe0d3432-2bf2-4e87-8015-dbada7a4b40b\") "
Sep 19 11:49:34.556898 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.556844    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:34.557187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557101    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:34.557237 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:49:34.557366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557336    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.557366 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557361    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.557492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557377    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.557492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557392    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.557492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.557458    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:34.558849 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.558823    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:49:34.558988 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.558964    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-kube-api-access-tzdb8" (OuterVolumeSpecName: "kube-api-access-tzdb8") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "kube-api-access-tzdb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:49:34.559134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.559113    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:49:34.559211 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.559132    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe0d3432-2bf2-4e87-8015-dbada7a4b40b" (UID: "fe0d3432-2bf2-4e87-8015-dbada7a4b40b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:49:34.658357 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.658327    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzdb8\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-kube-api-access-tzdb8\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.658357 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.658357    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.658553 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.658367    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.658553 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.658375    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.658553 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.658385    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe0d3432-2bf2-4e87-8015-dbada7a4b40b-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:49:34.888982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.888889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:49:34.946532 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.946500    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerID="ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3" exitCode=0
Sep 19 11:49:34.946721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.946558    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"
Sep 19 11:49:34.946721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.946568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" event={"ID":"fe0d3432-2bf2-4e87-8015-dbada7a4b40b","Type":"ContainerDied","Data":"ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3"}
Sep 19 11:49:34.946721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.946610    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m" event={"ID":"fe0d3432-2bf2-4e87-8015-dbada7a4b40b","Type":"ContainerDied","Data":"84615f0fa770ae19354d32a5fc32651fb1f4abee90c90ae2079c2b272a30fd73"}
Sep 19 11:49:34.946721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.946633    2582 scope.go:117] "RemoveContainer" containerID="ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3"
Sep 19 11:49:34.956991 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.956973    2582 scope.go:117] "RemoveContainer" containerID="e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"
Sep 19 11:49:34.967019 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.967002    2582 scope.go:117] "RemoveContainer" containerID="ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3"
Sep 19 11:49:34.967374 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:34.967350    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3\": container with ID starting with ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3 not found: ID does not exist" containerID="ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3"
Sep 19 11:49:34.967435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.967386    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3"} err="failed to get container status \"ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3\": rpc error: code = NotFound desc = could not find container \"ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3\": container with ID starting with ab6c975eff5d394180e5713db73e59a371edb5a64e481a0be553fda986f17bb3 not found: ID does not exist"
Sep 19 11:49:34.967435 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.967412    2582 scope.go:117] "RemoveContainer" containerID="e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"
Sep 19 11:49:34.967753 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:34.967732    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267\": container with ID starting with e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267 not found: ID does not exist" containerID="e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"
Sep 19 11:49:34.967858 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.967757    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267"} err="failed to get container status \"e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267\": rpc error: code = NotFound desc = could not find container \"e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267\": container with ID starting with e440e9d550879ffc06134c031fd2d5dc9f71a3073efe3379af127acab57f0267 not found: ID does not exist"
Sep 19 11:49:34.968993 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.968936    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"]
Sep 19 11:49:34.973450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:34.973428    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-a527d4-openshift-default-79d8f95bb8-7f78m"]
Sep 19 11:49:35.544233 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:35.544199    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" path="/var/lib/kubelet/pods/fe0d3432-2bf2-4e87-8015-dbada7a4b40b/volumes"
Sep 19 11:49:46.730841 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.730805    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"]
Sep 19 11:49:46.731434 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731414    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy"
Sep 19 11:49:46.731527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731438    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy"
Sep 19 11:49:46.731527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731449    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy"
Sep 19 11:49:46.731527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731458    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy"
Sep 19 11:49:46.731527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731480    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5876a941-b9c2-425d-b33e-fdeb715bc0ea" containerName="payload-pre-processing"
Sep 19 11:49:46.731527 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731489    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5876a941-b9c2-425d-b33e-fdeb715bc0ea" containerName="payload-pre-processing"
Sep 19 11:49:46.731766 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731612    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy"
Sep 19 11:49:46.731766 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.731625    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5876a941-b9c2-425d-b33e-fdeb715bc0ea" containerName="payload-pre-processing"
Sep 19 11:49:46.734604 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.734584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.738218 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.738195    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7eb15e\"/\"kube-root-ca.crt\""
Sep 19 11:49:46.738515 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.738498    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7eb15e\"/\"distinct-w0-7eb15e-kserve-self-signed-certs\""
Sep 19 11:49:46.738596 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.738519    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7eb15e\"/\"openshift-service-ca.crt\""
Sep 19 11:49:46.738663 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.738604    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7eb15e\"/\"default-dockercfg-dpgm7\""
Sep 19 11:49:46.743353 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.743331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"]
Sep 19 11:49:46.795563 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.795488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tls-certs\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.795844 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.795821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-home\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.796345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.795989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tmp-dir\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.796345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.796043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-model-cache\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.796345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.796120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-dshm\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.796345 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.796237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx2td\" (UniqueName: \"kubernetes.io/projected/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-kube-api-access-tx2td\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897410 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx2td\" (UniqueName: \"kubernetes.io/projected/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-kube-api-access-tx2td\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tls-certs\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-home\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tmp-dir\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-model-cache\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897600 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-dshm\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.897906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tmp-dir\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.898010 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.897965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-home\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.898108 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.898086    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-model-cache\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.899776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.899756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-dshm\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.899901 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.899883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tls-certs\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:46.904698 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:46.904677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx2td\" (UniqueName: \"kubernetes.io/projected/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-kube-api-access-tx2td\") pod \"distinct-w0-7eb15e-kserve-548b78c597-r8rkn\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") " pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:47.044938 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:47.044823    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:47.334877 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:47.334848    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"]
Sep 19 11:49:47.337780 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:49:47.337744    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89ab3d34_ec63_4fba_a15d_2c3c90d3a13d.slice/crio-bba8544a04514872af83470088d6483fe37297d4e3c6740112ee270de73bc6f3 WatchSource:0}: Error finding container bba8544a04514872af83470088d6483fe37297d4e3c6740112ee270de73bc6f3: Status 404 returned error can't find the container with id bba8544a04514872af83470088d6483fe37297d4e3c6740112ee270de73bc6f3
Sep 19 11:49:48.029302 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:48.029265    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" event={"ID":"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d","Type":"ContainerStarted","Data":"b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940"}
Sep 19 11:49:48.029744 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:48.029319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" event={"ID":"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d","Type":"ContainerStarted","Data":"bba8544a04514872af83470088d6483fe37297d4e3c6740112ee270de73bc6f3"}
Sep 19 11:49:48.044944 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:48.044900    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:48.047199 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:48.047151    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" podStartSLOduration=2.047135521 podStartE2EDuration="2.047135521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:49:48.045035697 +0000 UTC m=+959.062072410" watchObservedRunningTime="2026-09-19 11:49:48.047135521 +0000 UTC m=+959.064172231"
Sep 19 11:49:52.053858 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:52.053824    2582 generic.go:356] "Generic (PLEG): container finished" podID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerID="c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05" exitCode=0
Sep 19 11:49:52.054282 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:52.053894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" event={"ID":"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d","Type":"ContainerDied","Data":"c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"}
Sep 19 11:49:52.054403 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:52.054384    2582 scope.go:117] "RemoveContainer" containerID="c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"
Sep 19 11:49:52.055654 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:52.055620    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:49:52.055766 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:52.055711    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:49:52.055766 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:52.055743    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 19 11:49:53.060992 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:53.060953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" event={"ID":"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d","Type":"ContainerStarted","Data":"e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea"}
Sep 19 11:49:53.449769 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:53.449687    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:53.449981 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:53.449908    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 11:49:53.450086 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:53.450019    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 11:49:54.449813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:54.449778    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 11:49:54.450321 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:54.449832    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 11:49:55.268065 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.268032    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"]
Sep 19 11:49:55.268540 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.268524    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0d3432-2bf2-4e87-8015-dbada7a4b40b" containerName="istio-proxy"
Sep 19 11:49:55.275935 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.275150    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.278082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.278056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-176c86-serving-cert\""
Sep 19 11:49:55.286648 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.286623    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"]
Sep 19 11:49:55.411795 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.411749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.412017 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.411809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0015577-5579-4c5b-b84d-83c2d4bd4b37-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.412017 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.411854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9stl\" (UniqueName: \"kubernetes.io/projected/f0015577-5579-4c5b-b84d-83c2d4bd4b37-kube-api-access-p9stl\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.412134 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.412063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.449728 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.449701    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 11:49:55.449869 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.449829    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 11:49:55.513516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.513475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.513704 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.513536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0015577-5579-4c5b-b84d-83c2d4bd4b37-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.513704 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.513588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9stl\" (UniqueName: \"kubernetes.io/projected/f0015577-5579-4c5b-b84d-83c2d4bd4b37-kube-api-access-p9stl\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.513704 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:55.513631    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-serving-cert: secret "maas-api-e2e-shared-b-w2-176c86-serving-cert" not found
Sep 19 11:49:55.513876 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:49:55.513708    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls podName:f0015577-5579-4c5b-b84d-83c2d4bd4b37 nodeName:}" failed. No retries permitted until 2026-09-19 11:49:56.013691926 +0000 UTC m=+967.030728614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls") pod "maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" (UID: "f0015577-5579-4c5b-b84d-83c2d4bd4b37") : secret "maas-api-e2e-shared-b-w2-176c86-serving-cert" not found
Sep 19 11:49:55.513876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.513737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.514741 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.514717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0015577-5579-4c5b-b84d-83c2d4bd4b37-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.516215 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.516126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:55.522104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:55.522041    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9stl\" (UniqueName: \"kubernetes.io/projected/f0015577-5579-4c5b-b84d-83c2d4bd4b37-kube-api-access-p9stl\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:56.019170 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:56.019027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:56.022154 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:56.022125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:56.204572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:56.204502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:56.449666 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:56.449574    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 11:49:56.449666 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:56.449630    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 11:49:56.481325 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:56.479277    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"]
Sep 19 11:49:57.045985 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.045946    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:57.058601 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.058582    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:57.105384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.105253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" event={"ID":"f0015577-5579-4c5b-b84d-83c2d4bd4b37","Type":"ContainerStarted","Data":"0048106356fdb4157c44a336c7ddd212eb80e4fc29e532459385e2f9b6fbfc0c"}
Sep 19 11:49:57.105384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.105315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" event={"ID":"f0015577-5579-4c5b-b84d-83c2d4bd4b37","Type":"ContainerStarted","Data":"cd80a38be1de97b68034f61cc699da7533eef88a25ddaed5f6189b81218b5e2d"}
Sep 19 11:49:57.105384 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.105348    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:49:57.118493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.118467    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:49:57.121273 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.121232    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" podStartSLOduration=1.787140623 podStartE2EDuration="2.12119701s" totalImagesPullingTime="334.056387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:49:57.12064259 +0000 UTC m=+968.137679304" watchObservedRunningTime="2026-09-19 11:49:57.12119701 +0000 UTC m=+968.138233721"
Sep 19 11:49:57.449739 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.449653    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 11:49:57.449739 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:57.449721    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 11:49:58.457831 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:58.457801    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:58.458224 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:58.458113    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:58.458813 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:58.458798    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:49:58.945022 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:49:58.944986    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:50:03.117402 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:03.117374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:50:19.837594 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.837050    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"]
Sep 19 11:50:19.840862 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.840844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:19.843202 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.843172    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-6e19b2\"/\"noten-model-6e19b2-kserve-self-signed-certs\""
Sep 19 11:50:19.843202 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.843183    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-6e19b2\"/\"openshift-service-ca.crt\""
Sep 19 11:50:19.844555 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.844323    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-6e19b2\"/\"kube-root-ca.crt\""
Sep 19 11:50:19.844555 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.844344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-6e19b2\"/\"default-dockercfg-qg8s2\""
Sep 19 11:50:19.848376 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.848354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"]
Sep 19 11:50:19.958580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.958550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-model-cache\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:19.958762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.958604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46758af2-682c-46e0-a159-5a64f420fb4f-tls-certs\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:19.958762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.958627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-home\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:19.958762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.958667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-tmp-dir\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:19.958762 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.958688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzp6v\" (UniqueName: \"kubernetes.io/projected/46758af2-682c-46e0-a159-5a64f420fb4f-kube-api-access-fzp6v\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:19.958987 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:19.958758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-dshm\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzp6v\" (UniqueName: \"kubernetes.io/projected/46758af2-682c-46e0-a159-5a64f420fb4f-kube-api-access-fzp6v\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-dshm\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-model-cache\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46758af2-682c-46e0-a159-5a64f420fb4f-tls-certs\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059543 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-home\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059754 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-tmp-dir\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059970 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-model-cache\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.059970 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.059962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-tmp-dir\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.060095 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.060044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-home\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.061737 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.061715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-dshm\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.062066 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.062050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46758af2-682c-46e0-a159-5a64f420fb4f-tls-certs\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.066960 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.066936    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzp6v\" (UniqueName: \"kubernetes.io/projected/46758af2-682c-46e0-a159-5a64f420fb4f-kube-api-access-fzp6v\") pod \"noten-model-6e19b2-kserve-8f886454d-6zn94\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") " pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.151390 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.151296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:20.430111 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:20.430080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"]
Sep 19 11:50:20.431318 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:50:20.431281    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46758af2_682c_46e0_a159_5a64f420fb4f.slice/crio-89f8cfead4b0d6a4023ff36f803560d74f007490a4d506a07f22a0470842e898 WatchSource:0}: Error finding container 89f8cfead4b0d6a4023ff36f803560d74f007490a4d506a07f22a0470842e898: Status 404 returned error can't find the container with id 89f8cfead4b0d6a4023ff36f803560d74f007490a4d506a07f22a0470842e898
Sep 19 11:50:21.246986 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:21.246942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94" event={"ID":"46758af2-682c-46e0-a159-5a64f420fb4f","Type":"ContainerStarted","Data":"e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e"}
Sep 19 11:50:21.246986 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:21.246985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94" event={"ID":"46758af2-682c-46e0-a159-5a64f420fb4f","Type":"ContainerStarted","Data":"89f8cfead4b0d6a4023ff36f803560d74f007490a4d506a07f22a0470842e898"}
Sep 19 11:50:21.263047 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:21.262999    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94" podStartSLOduration=2.262978481 podStartE2EDuration="2.262978481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:50:21.261586686 +0000 UTC m=+992.278623398" watchObservedRunningTime="2026-09-19 11:50:21.262978481 +0000 UTC m=+992.280015194"
Sep 19 11:50:22.151399 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:22.151370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:30.151492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:30.151463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:30.164141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:30.164116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:30.309687 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:30.309657    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:50:34.954084 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:34.954051    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:50:39.368339 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.368297    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"]
Sep 19 11:50:39.373200 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.373178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.376024 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.376003    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fcfc8fcc\""
Sep 19 11:50:39.376158 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.376005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fcfc8fcc-dockercfg-9s669\""
Sep 19 11:50:39.381873 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.381716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"]
Sep 19 11:50:39.465054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.465023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1823e06-7317-4fcb-80cd-0206e6b98837-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.465214 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.465068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rj8\" (UniqueName: \"kubernetes.io/projected/c1823e06-7317-4fcb-80cd-0206e6b98837-kube-api-access-h2rj8\") pod \"payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.566346 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.566303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1823e06-7317-4fcb-80cd-0206e6b98837-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.566555 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.566359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rj8\" (UniqueName: \"kubernetes.io/projected/c1823e06-7317-4fcb-80cd-0206e6b98837-kube-api-access-h2rj8\") pod \"payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.567097 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.567075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1823e06-7317-4fcb-80cd-0206e6b98837-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.574139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.574111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rj8\" (UniqueName: \"kubernetes.io/projected/c1823e06-7317-4fcb-80cd-0206e6b98837-kube-api-access-h2rj8\") pod \"payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.686233 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.686152    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:39.970869 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:39.970833    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"]
Sep 19 11:50:39.972078 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:50:39.972055    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1823e06_7317_4fcb_80cd_0206e6b98837.slice/crio-496715ea0af93cb53bae573acb51febd0ccf11a57905fffa1c3f5419b9b258b2 WatchSource:0}: Error finding container 496715ea0af93cb53bae573acb51febd0ccf11a57905fffa1c3f5419b9b258b2: Status 404 returned error can't find the container with id 496715ea0af93cb53bae573acb51febd0ccf11a57905fffa1c3f5419b9b258b2
Sep 19 11:50:40.362209 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:40.362165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm" event={"ID":"c1823e06-7317-4fcb-80cd-0206e6b98837","Type":"ContainerStarted","Data":"86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7"}
Sep 19 11:50:40.362408 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:40.362240    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:40.362408 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:40.362261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm" event={"ID":"c1823e06-7317-4fcb-80cd-0206e6b98837","Type":"ContainerStarted","Data":"496715ea0af93cb53bae573acb51febd0ccf11a57905fffa1c3f5419b9b258b2"}
Sep 19 11:50:40.379748 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:40.379703    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm" podStartSLOduration=1.379690571 podStartE2EDuration="1.379690571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:50:40.377601736 +0000 UTC m=+1011.394638452" watchObservedRunningTime="2026-09-19 11:50:40.379690571 +0000 UTC m=+1011.396727282"
Sep 19 11:50:51.370000 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:51.369970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:50:57.554125 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:57.554009    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"]
Sep 19 11:50:59.626495 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:50:59.626463    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"]
Sep 19 11:51:06.212977 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:06.212947    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"]
Sep 19 11:51:06.216546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:06.216522    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-333f49-29830305-r7dfw"]
Sep 19 11:51:07.544182 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:07.544146    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b1145a6-4d4e-4f81-a512-f89a1c9e640a" path="/var/lib/kubelet/pods/0b1145a6-4d4e-4f81-a512-f89a1c9e640a/volumes"
Sep 19 11:51:11.962357 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:11.962318    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:51:12.576637 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.576602    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94" podUID="46758af2-682c-46e0-a159-5a64f420fb4f" containerName="main" containerID="cri-o://e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e" gracePeriod=45
Sep 19 11:51:12.764491 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.764454    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"]
Sep 19 11:51:12.764749 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.764723    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy" containerID="cri-o://205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee" gracePeriod=30
Sep 19 11:51:12.850040 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.850014    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:51:12.903534 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903504    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzp6v\" (UniqueName: \"kubernetes.io/projected/46758af2-682c-46e0-a159-5a64f420fb4f-kube-api-access-fzp6v\") pod \"46758af2-682c-46e0-a159-5a64f420fb4f\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") "
Sep 19 11:51:12.903719 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-dshm\") pod \"46758af2-682c-46e0-a159-5a64f420fb4f\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") "
Sep 19 11:51:12.903719 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903591    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-home\") pod \"46758af2-682c-46e0-a159-5a64f420fb4f\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") "
Sep 19 11:51:12.903719 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46758af2-682c-46e0-a159-5a64f420fb4f-tls-certs\") pod \"46758af2-682c-46e0-a159-5a64f420fb4f\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") "
Sep 19 11:51:12.903719 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903717    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-tmp-dir\") pod \"46758af2-682c-46e0-a159-5a64f420fb4f\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") "
Sep 19 11:51:12.903968 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903742    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-model-cache\") pod \"46758af2-682c-46e0-a159-5a64f420fb4f\" (UID: \"46758af2-682c-46e0-a159-5a64f420fb4f\") "
Sep 19 11:51:12.903968 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903903    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-home" (OuterVolumeSpecName: "home") pod "46758af2-682c-46e0-a159-5a64f420fb4f" (UID: "46758af2-682c-46e0-a159-5a64f420fb4f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:12.904080 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.903978    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46758af2-682c-46e0-a159-5a64f420fb4f" (UID: "46758af2-682c-46e0-a159-5a64f420fb4f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:12.904080 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.904054    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-model-cache" (OuterVolumeSpecName: "model-cache") pod "46758af2-682c-46e0-a159-5a64f420fb4f" (UID: "46758af2-682c-46e0-a159-5a64f420fb4f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:12.904195 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.904145    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:12.904195 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.904167    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:12.904306 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.904206    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:12.905980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.905951    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46758af2-682c-46e0-a159-5a64f420fb4f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46758af2-682c-46e0-a159-5a64f420fb4f" (UID: "46758af2-682c-46e0-a159-5a64f420fb4f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:51:12.906240 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.906218    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-dshm" (OuterVolumeSpecName: "dshm") pod "46758af2-682c-46e0-a159-5a64f420fb4f" (UID: "46758af2-682c-46e0-a159-5a64f420fb4f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:12.906299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:12.906237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46758af2-682c-46e0-a159-5a64f420fb4f-kube-api-access-fzp6v" (OuterVolumeSpecName: "kube-api-access-fzp6v") pod "46758af2-682c-46e0-a159-5a64f420fb4f" (UID: "46758af2-682c-46e0-a159-5a64f420fb4f"). InnerVolumeSpecName "kube-api-access-fzp6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:51:13.004751 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.004722    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46758af2-682c-46e0-a159-5a64f420fb4f-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:13.004751 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.004746    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzp6v\" (UniqueName: \"kubernetes.io/projected/46758af2-682c-46e0-a159-5a64f420fb4f-kube-api-access-fzp6v\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:13.004751 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.004756    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46758af2-682c-46e0-a159-5a64f420fb4f-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:13.557234 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.557201    2582 generic.go:356] "Generic (PLEG): container finished" podID="46758af2-682c-46e0-a159-5a64f420fb4f" containerID="e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e" exitCode=0
Sep 19 11:51:13.557391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.557256    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"
Sep 19 11:51:13.557391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.557288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94" event={"ID":"46758af2-682c-46e0-a159-5a64f420fb4f","Type":"ContainerDied","Data":"e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e"}
Sep 19 11:51:13.557391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.557372    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94" event={"ID":"46758af2-682c-46e0-a159-5a64f420fb4f","Type":"ContainerDied","Data":"89f8cfead4b0d6a4023ff36f803560d74f007490a4d506a07f22a0470842e898"}
Sep 19 11:51:13.557574 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.557398    2582 scope.go:117] "RemoveContainer" containerID="e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e"
Sep 19 11:51:13.572139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.572101    2582 scope.go:117] "RemoveContainer" containerID="e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e"
Sep 19 11:51:13.572614 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:13.572580    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e\": container with ID starting with e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e not found: ID does not exist" containerID="e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e"
Sep 19 11:51:13.572774 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.572623    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e"} err="failed to get container status \"e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e\": rpc error: code = NotFound desc = could not find container \"e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e\": container with ID starting with e6a568ac962ddb8e4f29e15e78518f798bd6a963b1f84f928020bb0bfd33961e not found: ID does not exist"
Sep 19 11:51:13.576334 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.576311    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"]
Sep 19 11:51:13.580222 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:13.580201    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-6e19b2/noten-model-6e19b2-kserve-8f886454d-6zn94"]
Sep 19 11:51:14.649105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.649059    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" podUID="f555bf68-41a8-46e8-852a-ea305f57f8e8" containerName="main" containerID="cri-o://f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac" gracePeriod=45
Sep 19 11:51:14.670741 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.670712    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" podUID="f555bf68-41a8-46e8-852a-ea305f57f8e8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": dial tcp 10.133.0.66:8000: connect: connection refused"
Sep 19 11:51:14.903424 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.903374    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:51:14.923591 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923562    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-model-cache\") pod \"f555bf68-41a8-46e8-852a-ea305f57f8e8\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") "
Sep 19 11:51:14.923735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923639    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-home\") pod \"f555bf68-41a8-46e8-852a-ea305f57f8e8\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") "
Sep 19 11:51:14.923735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923675    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f555bf68-41a8-46e8-852a-ea305f57f8e8-tls-certs\") pod \"f555bf68-41a8-46e8-852a-ea305f57f8e8\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") "
Sep 19 11:51:14.923735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-dshm\") pod \"f555bf68-41a8-46e8-852a-ea305f57f8e8\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") "
Sep 19 11:51:14.923939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tlgw\" (UniqueName: \"kubernetes.io/projected/f555bf68-41a8-46e8-852a-ea305f57f8e8-kube-api-access-9tlgw\") pod \"f555bf68-41a8-46e8-852a-ea305f57f8e8\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") "
Sep 19 11:51:14.923939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923801    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-tmp-dir\") pod \"f555bf68-41a8-46e8-852a-ea305f57f8e8\" (UID: \"f555bf68-41a8-46e8-852a-ea305f57f8e8\") "
Sep 19 11:51:14.923939 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.923853    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f555bf68-41a8-46e8-852a-ea305f57f8e8" (UID: "f555bf68-41a8-46e8-852a-ea305f57f8e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:14.924356 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.924216    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:14.924763 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.924729    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f555bf68-41a8-46e8-852a-ea305f57f8e8" (UID: "f555bf68-41a8-46e8-852a-ea305f57f8e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:14.924887 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.924869    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-home" (OuterVolumeSpecName: "home") pod "f555bf68-41a8-46e8-852a-ea305f57f8e8" (UID: "f555bf68-41a8-46e8-852a-ea305f57f8e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:14.926808 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.926778    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-dshm" (OuterVolumeSpecName: "dshm") pod "f555bf68-41a8-46e8-852a-ea305f57f8e8" (UID: "f555bf68-41a8-46e8-852a-ea305f57f8e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:14.926903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.926843    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f555bf68-41a8-46e8-852a-ea305f57f8e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f555bf68-41a8-46e8-852a-ea305f57f8e8" (UID: "f555bf68-41a8-46e8-852a-ea305f57f8e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:51:14.926903 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:14.926887    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f555bf68-41a8-46e8-852a-ea305f57f8e8-kube-api-access-9tlgw" (OuterVolumeSpecName: "kube-api-access-9tlgw") pod "f555bf68-41a8-46e8-852a-ea305f57f8e8" (UID: "f555bf68-41a8-46e8-852a-ea305f57f8e8"). InnerVolumeSpecName "kube-api-access-9tlgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:51:15.025021 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.024992    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:15.025021 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.025015    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f555bf68-41a8-46e8-852a-ea305f57f8e8-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:15.025021 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.025024    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:15.025241 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.025032    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tlgw\" (UniqueName: \"kubernetes.io/projected/f555bf68-41a8-46e8-852a-ea305f57f8e8-kube-api-access-9tlgw\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:15.025241 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.025040    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f555bf68-41a8-46e8-852a-ea305f57f8e8-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:15.544101 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.544064    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46758af2-682c-46e0-a159-5a64f420fb4f" path="/var/lib/kubelet/pods/46758af2-682c-46e0-a159-5a64f420fb4f/volumes"
Sep 19 11:51:15.571479 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.571454    2582 generic.go:356] "Generic (PLEG): container finished" podID="f555bf68-41a8-46e8-852a-ea305f57f8e8" containerID="f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac" exitCode=0
Sep 19 11:51:15.571605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.571492    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"
Sep 19 11:51:15.571605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.571532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" event={"ID":"f555bf68-41a8-46e8-852a-ea305f57f8e8","Type":"ContainerDied","Data":"f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac"}
Sep 19 11:51:15.571605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.571571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z" event={"ID":"f555bf68-41a8-46e8-852a-ea305f57f8e8","Type":"ContainerDied","Data":"394e5613e0653bb29663d32cb8293d8809b79f7c05fefac720e89caf6e59ea80"}
Sep 19 11:51:15.571605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.571590    2582 scope.go:117] "RemoveContainer" containerID="f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac"
Sep 19 11:51:15.580676 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.580659    2582 scope.go:117] "RemoveContainer" containerID="f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac"
Sep 19 11:51:15.580955 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:15.580931    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac\": container with ID starting with f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac not found: ID does not exist" containerID="f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac"
Sep 19 11:51:15.581015 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.580964    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac"} err="failed to get container status \"f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac\": rpc error: code = NotFound desc = could not find container \"f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac\": container with ID starting with f7ea07782d3b7aebfa1fb41b428ae2d68f2d9a4d40c373dde2b607fa74ba42ac not found: ID does not exist"
Sep 19 11:51:15.587287 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.587264    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"]
Sep 19 11:51:15.590501 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:15.590482    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d8d8bb/test-model-d8d8bb-kserve-66c9b76474-wgj2z"]
Sep 19 11:51:17.544487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:17.544450    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f555bf68-41a8-46e8-852a-ea305f57f8e8" path="/var/lib/kubelet/pods/f555bf68-41a8-46e8-852a-ea305f57f8e8/volumes"
Sep 19 11:51:18.026841 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.026817    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:51:18.057221 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-data\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057221 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057220    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-socket\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057421 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057246    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf5v5\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-kube-api-access-wf5v5\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057421 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-certs\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057421 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057301    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-credential-socket\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057421 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057347    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-envoy\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057425    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-istio-token\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057499    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:18.057660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057509    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc265c8-88ed-45e7-a764-635300710093-istiod-ca-cert\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.057660 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057609    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc265c8-88ed-45e7-a764-635300710093-istio-podinfo\") pod \"3fc265c8-88ed-45e7-a764-635300710093\" (UID: \"3fc265c8-88ed-45e7-a764-635300710093\") "
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057503    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-data" (OuterVolumeSpecName: "istio-data") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057712    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057823    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc265c8-88ed-45e7-a764-635300710093-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.057883    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.058132    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.058153    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.058169    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.058183    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.058256 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.058196    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc265c8-88ed-45e7-a764-635300710093-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.059525 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.059499    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:18.059711 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.059697    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fc265c8-88ed-45e7-a764-635300710093-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:51:18.059945 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.059899    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-kube-api-access-wf5v5" (OuterVolumeSpecName: "kube-api-access-wf5v5") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "kube-api-access-wf5v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:51:18.060031 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.059964    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-istio-token" (OuterVolumeSpecName: "istio-token") pod "3fc265c8-88ed-45e7-a764-635300710093" (UID: "3fc265c8-88ed-45e7-a764-635300710093"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:51:18.159509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.159436    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.159509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.159460    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc265c8-88ed-45e7-a764-635300710093-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.159509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.159469    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf5v5\" (UniqueName: \"kubernetes.io/projected/3fc265c8-88ed-45e7-a764-635300710093-kube-api-access-wf5v5\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.159509 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.159479    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc265c8-88ed-45e7-a764-635300710093-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:18.590487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.590451    2582 generic.go:356] "Generic (PLEG): container finished" podID="3fc265c8-88ed-45e7-a764-635300710093" containerID="205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee" exitCode=0
Sep 19 11:51:18.590997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.590495    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"
Sep 19 11:51:18.590997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.590534    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" event={"ID":"3fc265c8-88ed-45e7-a764-635300710093","Type":"ContainerDied","Data":"205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee"}
Sep 19 11:51:18.590997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.590606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8" event={"ID":"3fc265c8-88ed-45e7-a764-635300710093","Type":"ContainerDied","Data":"e274612e2b3a97c8c372f9d17a188cbdbce43c93989660ae652fa6dca7524b39"}
Sep 19 11:51:18.590997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.590674    2582 scope.go:117] "RemoveContainer" containerID="205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee"
Sep 19 11:51:18.600158 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.600141    2582 scope.go:117] "RemoveContainer" containerID="81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"
Sep 19 11:51:18.608486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.608467    2582 scope.go:117] "RemoveContainer" containerID="205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee"
Sep 19 11:51:18.608756 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:18.608739    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee\": container with ID starting with 205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee not found: ID does not exist" containerID="205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee"
Sep 19 11:51:18.608809 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.608765    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee"} err="failed to get container status \"205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee\": rpc error: code = NotFound desc = could not find container \"205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee\": container with ID starting with 205f61e19dcd5072add38b01426d55e8f5fed925940f8f4a32040894c2e41eee not found: ID does not exist"
Sep 19 11:51:18.608809 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.608781    2582 scope.go:117] "RemoveContainer" containerID="81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"
Sep 19 11:51:18.609099 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:18.609075    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b\": container with ID starting with 81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b not found: ID does not exist" containerID="81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"
Sep 19 11:51:18.609189 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.609114    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b"} err="failed to get container status \"81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b\": rpc error: code = NotFound desc = could not find container \"81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b\": container with ID starting with 81c28dd9652cb17619157d2d47c10a7918784a7fc689035eb3882cb26ff59a5b not found: ID does not exist"
Sep 19 11:51:18.611761 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.611740    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"]
Sep 19 11:51:18.615835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:18.615813    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-333f49-openshift-default-fdfc6dfc4-b9qz8"]
Sep 19 11:51:19.544085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:19.544055    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc265c8-88ed-45e7-a764-635300710093" path="/var/lib/kubelet/pods/3fc265c8-88ed-45e7-a764-635300710093/volumes"
Sep 19 11:51:30.167219 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:30.167159    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"]
Sep 19 11:51:30.167810 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:30.167461    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy" containerID="cri-o://593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e" gracePeriod=30
Sep 19 11:51:34.227649 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.227612    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"]
Sep 19 11:51:34.228218 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228201    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy"
Sep 19 11:51:34.228264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228222    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy"
Sep 19 11:51:34.228264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228232    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46758af2-682c-46e0-a159-5a64f420fb4f" containerName="main"
Sep 19 11:51:34.228264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228241    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="46758af2-682c-46e0-a159-5a64f420fb4f" containerName="main"
Sep 19 11:51:34.228264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228256    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f555bf68-41a8-46e8-852a-ea305f57f8e8" containerName="main"
Sep 19 11:51:34.228392 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228264    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f555bf68-41a8-46e8-852a-ea305f57f8e8" containerName="main"
Sep 19 11:51:34.228392 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228294    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy"
Sep 19 11:51:34.228392 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228302    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy"
Sep 19 11:51:34.228487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228397    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="46758af2-682c-46e0-a159-5a64f420fb4f" containerName="main"
Sep 19 11:51:34.228487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228409    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy"
Sep 19 11:51:34.228487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228419    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc265c8-88ed-45e7-a764-635300710093" containerName="istio-proxy"
Sep 19 11:51:34.228487 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.228428    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f555bf68-41a8-46e8-852a-ea305f57f8e8" containerName="main"
Sep 19 11:51:34.240283 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.240251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.241973 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.241944    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"]
Sep 19 11:51:34.243835 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.243807    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fcfc8fcc\"/\"openshift-service-ca.crt\""
Sep 19 11:51:34.243980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.243863    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fcfc8fcc\"/\"e2e-lifecycle-model-fcfc8fcc-kserve-self-signed-certs\""
Sep 19 11:51:34.243980 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.243895    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fcfc8fcc\"/\"default-dockercfg-dltj4\""
Sep 19 11:51:34.244107 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.243817    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fcfc8fcc\"/\"kube-root-ca.crt\""
Sep 19 11:51:34.319271 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.319238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-dshm\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.319271 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.319271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xct68\" (UniqueName: \"kubernetes.io/projected/65c08538-05b2-453f-8b12-3193f6799e82-kube-api-access-xct68\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.319552 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.319298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-model-cache\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.319552 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.319394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-home\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.319552 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.319427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-tmp-dir\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.319552 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.319516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c08538-05b2-453f-8b12-3193f6799e82-tls-certs\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421109 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-dshm\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xct68\" (UniqueName: \"kubernetes.io/projected/65c08538-05b2-453f-8b12-3193f6799e82-kube-api-access-xct68\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-model-cache\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-home\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-tmp-dir\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421299 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c08538-05b2-453f-8b12-3193f6799e82-tls-certs\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421583 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-model-cache\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421659 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421637    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-home\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.421706 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.421661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-tmp-dir\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.423483 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.423460    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-dshm\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.423855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.423834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c08538-05b2-453f-8b12-3193f6799e82-tls-certs\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.430104 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.430078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xct68\" (UniqueName: \"kubernetes.io/projected/65c08538-05b2-453f-8b12-3193f6799e82-kube-api-access-xct68\") pod \"e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") " pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.550563 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.550534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:34.821486 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:34.821454    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"]
Sep 19 11:51:34.823307 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:51:34.823277    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c08538_05b2_453f_8b12_3193f6799e82.slice/crio-e1ca270f76430942fe72c7148b248db9fba40b1ec26c065ad546ab75e4c578b1 WatchSource:0}: Error finding container e1ca270f76430942fe72c7148b248db9fba40b1ec26c065ad546ab75e4c578b1: Status 404 returned error can't find the container with id e1ca270f76430942fe72c7148b248db9fba40b1ec26c065ad546ab75e4c578b1
Sep 19 11:51:35.407261 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.407237    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:51:35.532431 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-credential-socket\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532617 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532452    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-token\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532617 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-socket\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532617 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-envoy\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532617 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532570    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-certs\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532617 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532591    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqzj8\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-kube-api-access-sqzj8\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532621    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-podinfo\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532700    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istiod-ca-cert\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532744    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:35.532900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532761    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-data\") pod \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\" (UID: \"8a5c8ee1-6df8-4371-b96a-6c0dc41463da\") "
Sep 19 11:51:35.532900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532828    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:35.532900 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.532864    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:35.533226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.533079    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:35.533226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.533154    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:51:35.533226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.533203    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.533226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.533220    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.533374 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.533228    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.533374 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.533237    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.535295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.535273    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:51:35.535295 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.535284    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:51:35.535485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.535370    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-kube-api-access-sqzj8" (OuterVolumeSpecName: "kube-api-access-sqzj8") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "kube-api-access-sqzj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:51:35.535485 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.535374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a5c8ee1-6df8-4371-b96a-6c0dc41463da" (UID: "8a5c8ee1-6df8-4371-b96a-6c0dc41463da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:51:35.634634 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.634603    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.634634 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.634629    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqzj8\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-kube-api-access-sqzj8\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.634634 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.634642    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.634852 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.634651    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.634852 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.634660    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5c8ee1-6df8-4371-b96a-6c0dc41463da-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:51:35.682592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.682491    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerID="593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e" exitCode=0
Sep 19 11:51:35.682592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.682546    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"
Sep 19 11:51:35.682592 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.682575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" event={"ID":"8a5c8ee1-6df8-4371-b96a-6c0dc41463da","Type":"ContainerDied","Data":"593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e"}
Sep 19 11:51:35.682876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.682636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd" event={"ID":"8a5c8ee1-6df8-4371-b96a-6c0dc41463da","Type":"ContainerDied","Data":"a6a06a14c0b62a69a9e52fe93ac80e1fccda25ce111fb71018ec329e8c060667"}
Sep 19 11:51:35.682876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.682669    2582 scope.go:117] "RemoveContainer" containerID="593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e"
Sep 19 11:51:35.684470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.684439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4" event={"ID":"65c08538-05b2-453f-8b12-3193f6799e82","Type":"ContainerStarted","Data":"29c5862d92eed96b319cfc0e9e99dfd83cd0b2b0b707a7f5e060864f68909fb9"}
Sep 19 11:51:35.684595 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.684486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4" event={"ID":"65c08538-05b2-453f-8b12-3193f6799e82","Type":"ContainerStarted","Data":"e1ca270f76430942fe72c7148b248db9fba40b1ec26c065ad546ab75e4c578b1"}
Sep 19 11:51:35.692062 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.692038    2582 scope.go:117] "RemoveContainer" containerID="7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"
Sep 19 11:51:35.700253 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.700237    2582 scope.go:117] "RemoveContainer" containerID="593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e"
Sep 19 11:51:35.700508 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:35.700490    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e\": container with ID starting with 593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e not found: ID does not exist" containerID="593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e"
Sep 19 11:51:35.700556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.700514    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e"} err="failed to get container status \"593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e\": rpc error: code = NotFound desc = could not find container \"593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e\": container with ID starting with 593b0ef1b8b761a8a62cc7e8a0bcfec27bf49d121724a64027b07c47177de56e not found: ID does not exist"
Sep 19 11:51:35.700556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.700532    2582 scope.go:117] "RemoveContainer" containerID="7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"
Sep 19 11:51:35.700798 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:35.700779    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812\": container with ID starting with 7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812 not found: ID does not exist" containerID="7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"
Sep 19 11:51:35.700854 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.700804    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812"} err="failed to get container status \"7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812\": rpc error: code = NotFound desc = could not find container \"7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812\": container with ID starting with 7c63f0ffa8fa488f0d778b42412777c8812471d3e55f528afec51764554f0812 not found: ID does not exist"
Sep 19 11:51:35.704650 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.704612    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4" podStartSLOduration=1.704598647 podStartE2EDuration="1.704598647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:51:35.702516409 +0000 UTC m=+1066.719553122" watchObservedRunningTime="2026-09-19 11:51:35.704598647 +0000 UTC m=+1066.721635357"
Sep 19 11:51:35.716703 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.716678    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"]
Sep 19 11:51:35.722494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:35.722471    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d8d8bb-openshift-default-677df5566d-2kmtd"]
Sep 19 11:51:36.550998 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:36.550963    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:37.284194 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.284159    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"]
Sep 19 11:51:37.284578 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.284559    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy"
Sep 19 11:51:37.284578 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.284579    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy"
Sep 19 11:51:37.284776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.284687    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy"
Sep 19 11:51:37.284776 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.284700    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy"
Sep 19 11:51:37.289470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.289450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.291694 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.291676    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-4937ff-serving-cert\""
Sep 19 11:51:37.312809 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.312686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"]
Sep 19 11:51:37.450606 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.450578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.450606 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.450610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqpzq\" (UniqueName: \"kubernetes.io/projected/dc781bdf-c421-4ae8-add5-3d970e495caf-kube-api-access-wqpzq\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.450833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.450656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc781bdf-c421-4ae8-add5-3d970e495caf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.450833 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.450771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.544229 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.544145    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" path="/var/lib/kubelet/pods/8a5c8ee1-6df8-4371-b96a-6c0dc41463da/volumes"
Sep 19 11:51:37.551507 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.551481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.551799 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.551523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqpzq\" (UniqueName: \"kubernetes.io/projected/dc781bdf-c421-4ae8-add5-3d970e495caf-kube-api-access-wqpzq\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.551799 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.551589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc781bdf-c421-4ae8-add5-3d970e495caf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.551799 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.551663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.551947 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:37.551819    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-serving-cert: secret "maas-api-e2e-shared-a-w3-4937ff-serving-cert" not found
Sep 19 11:51:37.551947 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:51:37.551885    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls podName:dc781bdf-c421-4ae8-add5-3d970e495caf nodeName:}" failed. No retries permitted until 2026-09-19 11:51:38.051866305 +0000 UTC m=+1069.068903001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls") pod "maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" (UID: "dc781bdf-c421-4ae8-add5-3d970e495caf") : secret "maas-api-e2e-shared-a-w3-4937ff-serving-cert" not found
Sep 19 11:51:37.552258 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.552238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc781bdf-c421-4ae8-add5-3d970e495caf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.553855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.553837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.561612 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.561595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqpzq\" (UniqueName: \"kubernetes.io/projected/dc781bdf-c421-4ae8-add5-3d970e495caf-kube-api-access-wqpzq\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:37.942473 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.942390    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"]
Sep 19 11:51:37.942791 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.942778    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy"
Sep 19 11:51:37.942840 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.942792    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5c8ee1-6df8-4371-b96a-6c0dc41463da" containerName="istio-proxy"
Sep 19 11:51:37.947045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.947028    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:37.949961 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.949940    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-4937ff-dockercfg-kqbf4\""
Sep 19 11:51:37.950076 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.949961    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-4937ff\""
Sep 19 11:51:37.956194 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:37.956169    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"]
Sep 19 11:51:38.057755 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.057716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.057940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.057815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:38.057940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.057846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hwss\" (UniqueName: \"kubernetes.io/projected/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-kube-api-access-2hwss\") pod \"payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.060335 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.060307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:38.159083 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.159051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.159250 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.159143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hwss\" (UniqueName: \"kubernetes.io/projected/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-kube-api-access-2hwss\") pod \"payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.159745 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.159727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.167222 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.167192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hwss\" (UniqueName: \"kubernetes.io/projected/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-kube-api-access-2hwss\") pod \"payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.204263 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.204196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:38.259467 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.259438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.474945 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.474903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"]
Sep 19 11:51:38.476338 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:51:38.476307    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc781bdf_c421_4ae8_add5_3d970e495caf.slice/crio-b70022e6393019b954609e62bbd76cc0801e1690199f8aa841f325ee7b3e8cab WatchSource:0}: Error finding container b70022e6393019b954609e62bbd76cc0801e1690199f8aa841f325ee7b3e8cab: Status 404 returned error can't find the container with id b70022e6393019b954609e62bbd76cc0801e1690199f8aa841f325ee7b3e8cab
Sep 19 11:51:38.477766 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.477750    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:51:38.538350 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.538296    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"]
Sep 19 11:51:38.540598 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:51:38.540573    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7611d9a8_19e0_403d_b05f_a56e11d4bcb3.slice/crio-ca4a74dbb60431aed48aba05f3cdadf3da2b4c8ee845f0be98debb3ab7b97857 WatchSource:0}: Error finding container ca4a74dbb60431aed48aba05f3cdadf3da2b4c8ee845f0be98debb3ab7b97857: Status 404 returned error can't find the container with id ca4a74dbb60431aed48aba05f3cdadf3da2b4c8ee845f0be98debb3ab7b97857
Sep 19 11:51:38.705234 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.705182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn" event={"ID":"7611d9a8-19e0-403d-b05f-a56e11d4bcb3","Type":"ContainerStarted","Data":"6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd"}
Sep 19 11:51:38.705695 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.705345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:51:38.705695 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.705384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn" event={"ID":"7611d9a8-19e0-403d-b05f-a56e11d4bcb3","Type":"ContainerStarted","Data":"ca4a74dbb60431aed48aba05f3cdadf3da2b4c8ee845f0be98debb3ab7b97857"}
Sep 19 11:51:38.706636 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.706605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" event={"ID":"dc781bdf-c421-4ae8-add5-3d970e495caf","Type":"ContainerStarted","Data":"b70022e6393019b954609e62bbd76cc0801e1690199f8aa841f325ee7b3e8cab"}
Sep 19 11:51:38.719391 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:38.719340    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn" podStartSLOduration=1.7193239139999998 podStartE2EDuration="1.719323914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:51:38.718662759 +0000 UTC m=+1069.735699471" watchObservedRunningTime="2026-09-19 11:51:38.719323914 +0000 UTC m=+1069.736360625"
Sep 19 11:51:39.713273 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:39.713233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" event={"ID":"dc781bdf-c421-4ae8-add5-3d970e495caf","Type":"ContainerStarted","Data":"a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8"}
Sep 19 11:51:39.713686 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:39.713385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:39.731165 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:39.731110    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" podStartSLOduration=2.27351649 podStartE2EDuration="2.731096022s" totalImagesPullingTime="457.579532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:51:39.729454384 +0000 UTC m=+1070.746491098" watchObservedRunningTime="2026-09-19 11:51:39.731096022 +0000 UTC m=+1070.748132733"
Sep 19 11:51:44.551106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:44.551022    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:44.563559 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:44.563531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:44.750820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:44.750786    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:51:45.724821 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:45.724793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 11:51:48.450720 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:48.450686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:51:49.587510 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:49.587471    2582 scope.go:117] "RemoveContainer" containerID="d2406c61a4c6e04c7594d6ce561a57de80ea3170fd57c099762e8932ddf106f1"
Sep 19 11:51:49.596037 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:49.596013    2582 scope.go:117] "RemoveContainer" containerID="3e8bc15d5f1ce3e3c1dafb7a111cfa14c59ea57d988798908ca3a5a7795c87e4"
Sep 19 11:51:49.605568 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:49.605538    2582 scope.go:117] "RemoveContainer" containerID="5fb2ce2e4fbcdfab303e59b38ff0bf0e6c73541d42868d36d19877cf2537ea01"
Sep 19 11:51:49.716267 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:51:49.716240    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 11:52:04.669696 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.669664    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"]
Sep 19 11:52:04.675631 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.675611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.678532 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.678504    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-4a8a59\""
Sep 19 11:52:04.678824 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.678803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-4a8a59-dockercfg-gh76n\""
Sep 19 11:52:04.680787 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.680764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"]
Sep 19 11:52:04.819783 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.819748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b54b50e-29fc-4b4f-904e-158f524acb56-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.819999 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.819969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzr9m\" (UniqueName: \"kubernetes.io/projected/5b54b50e-29fc-4b4f-904e-158f524acb56-kube-api-access-qzr9m\") pod \"payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.921478 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.921398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b54b50e-29fc-4b4f-904e-158f524acb56-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.921478 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.921466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzr9m\" (UniqueName: \"kubernetes.io/projected/5b54b50e-29fc-4b4f-904e-158f524acb56-kube-api-access-qzr9m\") pod \"payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.922160 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.922135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b54b50e-29fc-4b4f-904e-158f524acb56-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.928789 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.928767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzr9m\" (UniqueName: \"kubernetes.io/projected/5b54b50e-29fc-4b4f-904e-158f524acb56-kube-api-access-qzr9m\") pod \"payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:04.987801 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:04.987777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:05.259358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:05.259328    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"]
Sep 19 11:52:05.262821 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:52:05.262795    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b54b50e_29fc_4b4f_904e_158f524acb56.slice/crio-74f7b076ae059031585f7aced7b0989ffa74fe04ca6bbac90a48f34799df92dc WatchSource:0}: Error finding container 74f7b076ae059031585f7aced7b0989ffa74fe04ca6bbac90a48f34799df92dc: Status 404 returned error can't find the container with id 74f7b076ae059031585f7aced7b0989ffa74fe04ca6bbac90a48f34799df92dc
Sep 19 11:52:05.861863 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:05.861828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc" event={"ID":"5b54b50e-29fc-4b4f-904e-158f524acb56","Type":"ContainerStarted","Data":"f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318"}
Sep 19 11:52:05.862279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:05.861892    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:05.862279 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:05.861925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc" event={"ID":"5b54b50e-29fc-4b4f-904e-158f524acb56","Type":"ContainerStarted","Data":"74f7b076ae059031585f7aced7b0989ffa74fe04ca6bbac90a48f34799df92dc"}
Sep 19 11:52:05.877528 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:05.877481    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc" podStartSLOduration=1.8774662439999998 podStartE2EDuration="1.877466244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:52:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:52:05.876268127 +0000 UTC m=+1096.893304844" watchObservedRunningTime="2026-09-19 11:52:05.877466244 +0000 UTC m=+1096.894503005"
Sep 19 11:52:16.869580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:16.869554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 11:52:18.140996 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:18.140963    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:52:57.849187 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:52:57.849146    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:53:02.913275 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:02.913236    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"]
Sep 19 11:53:02.913765 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:02.913493    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm" podUID="c1823e06-7317-4fcb-80cd-0206e6b98837" containerName="payload-pre-processing" containerID="cri-o://86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7" gracePeriod=30
Sep 19 11:53:03.187445 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.187415    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:53:03.187751 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.187721    2582 generic.go:356] "Generic (PLEG): container finished" podID="c1823e06-7317-4fcb-80cd-0206e6b98837" containerID="86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7" exitCode=0
Sep 19 11:53:03.187830 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.187786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm" event={"ID":"c1823e06-7317-4fcb-80cd-0206e6b98837","Type":"ContainerDied","Data":"86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7"}
Sep 19 11:53:03.187875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.187835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm" event={"ID":"c1823e06-7317-4fcb-80cd-0206e6b98837","Type":"ContainerDied","Data":"496715ea0af93cb53bae573acb51febd0ccf11a57905fffa1c3f5419b9b258b2"}
Sep 19 11:53:03.187875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.187860    2582 scope.go:117] "RemoveContainer" containerID="86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7"
Sep 19 11:53:03.197827 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.197810    2582 scope.go:117] "RemoveContainer" containerID="86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7"
Sep 19 11:53:03.198157 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:53:03.198137    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7\": container with ID starting with 86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7 not found: ID does not exist" containerID="86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7"
Sep 19 11:53:03.198241 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.198168    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7"} err="failed to get container status \"86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7\": rpc error: code = NotFound desc = could not find container \"86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7\": container with ID starting with 86aabd41b9653b2516afc2ac2f953e49b33eed55bc4c80e75c5694cc12250bc7 not found: ID does not exist"
Sep 19 11:53:03.288571 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.288536    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2rj8\" (UniqueName: \"kubernetes.io/projected/c1823e06-7317-4fcb-80cd-0206e6b98837-kube-api-access-h2rj8\") pod \"c1823e06-7317-4fcb-80cd-0206e6b98837\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") "
Sep 19 11:53:03.288761 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.288614    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1823e06-7317-4fcb-80cd-0206e6b98837-plugins-config-volume\") pod \"c1823e06-7317-4fcb-80cd-0206e6b98837\" (UID: \"c1823e06-7317-4fcb-80cd-0206e6b98837\") "
Sep 19 11:53:03.288995 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.288973    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1823e06-7317-4fcb-80cd-0206e6b98837-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1823e06-7317-4fcb-80cd-0206e6b98837" (UID: "c1823e06-7317-4fcb-80cd-0206e6b98837"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:53:03.289114 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.289062    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1823e06-7317-4fcb-80cd-0206e6b98837-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:03.290794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.290768    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1823e06-7317-4fcb-80cd-0206e6b98837-kube-api-access-h2rj8" (OuterVolumeSpecName: "kube-api-access-h2rj8") pod "c1823e06-7317-4fcb-80cd-0206e6b98837" (UID: "c1823e06-7317-4fcb-80cd-0206e6b98837"). InnerVolumeSpecName "kube-api-access-h2rj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:53:03.389607 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:03.389579    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2rj8\" (UniqueName: \"kubernetes.io/projected/c1823e06-7317-4fcb-80cd-0206e6b98837-kube-api-access-h2rj8\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:04.194682 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:04.194657    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"
Sep 19 11:53:04.210650 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:04.210619    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"]
Sep 19 11:53:04.213415 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:04.213392    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcfc8fcc-57f9d97798-9n9gm"]
Sep 19 11:53:05.543927 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:05.543885    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1823e06-7317-4fcb-80cd-0206e6b98837" path="/var/lib/kubelet/pods/c1823e06-7317-4fcb-80cd-0206e6b98837/volumes"
Sep 19 11:53:11.127735 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:11.127697    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"]
Sep 19 11:53:26.148124 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.148033    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4" podUID="65c08538-05b2-453f-8b12-3193f6799e82" containerName="main" containerID="cri-o://29c5862d92eed96b319cfc0e9e99dfd83cd0b2b0b707a7f5e060864f68909fb9" gracePeriod=45
Sep 19 11:53:26.320336 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.320304    2582 generic.go:356] "Generic (PLEG): container finished" podID="65c08538-05b2-453f-8b12-3193f6799e82" containerID="29c5862d92eed96b319cfc0e9e99dfd83cd0b2b0b707a7f5e060864f68909fb9" exitCode=0
Sep 19 11:53:26.320488 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.320357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4" event={"ID":"65c08538-05b2-453f-8b12-3193f6799e82","Type":"ContainerDied","Data":"29c5862d92eed96b319cfc0e9e99dfd83cd0b2b0b707a7f5e060864f68909fb9"}
Sep 19 11:53:26.398966 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.398895    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:53:26.521201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-dshm\") pod \"65c08538-05b2-453f-8b12-3193f6799e82\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") "
Sep 19 11:53:26.521201 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-home\") pod \"65c08538-05b2-453f-8b12-3193f6799e82\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") "
Sep 19 11:53:26.521447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-model-cache\") pod \"65c08538-05b2-453f-8b12-3193f6799e82\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") "
Sep 19 11:53:26.521447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521267    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c08538-05b2-453f-8b12-3193f6799e82-tls-certs\") pod \"65c08538-05b2-453f-8b12-3193f6799e82\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") "
Sep 19 11:53:26.521447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521356    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-tmp-dir\") pod \"65c08538-05b2-453f-8b12-3193f6799e82\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") "
Sep 19 11:53:26.521447 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521407    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xct68\" (UniqueName: \"kubernetes.io/projected/65c08538-05b2-453f-8b12-3193f6799e82-kube-api-access-xct68\") pod \"65c08538-05b2-453f-8b12-3193f6799e82\" (UID: \"65c08538-05b2-453f-8b12-3193f6799e82\") "
Sep 19 11:53:26.521712 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.521680    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65c08538-05b2-453f-8b12-3193f6799e82" (UID: "65c08538-05b2-453f-8b12-3193f6799e82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:53:26.522242 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.522213    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-model-cache" (OuterVolumeSpecName: "model-cache") pod "65c08538-05b2-453f-8b12-3193f6799e82" (UID: "65c08538-05b2-453f-8b12-3193f6799e82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:53:26.522378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.522266    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-home" (OuterVolumeSpecName: "home") pod "65c08538-05b2-453f-8b12-3193f6799e82" (UID: "65c08538-05b2-453f-8b12-3193f6799e82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:53:26.523955 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.523910    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-dshm" (OuterVolumeSpecName: "dshm") pod "65c08538-05b2-453f-8b12-3193f6799e82" (UID: "65c08538-05b2-453f-8b12-3193f6799e82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:53:26.523955 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.523939    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c08538-05b2-453f-8b12-3193f6799e82-kube-api-access-xct68" (OuterVolumeSpecName: "kube-api-access-xct68") pod "65c08538-05b2-453f-8b12-3193f6799e82" (UID: "65c08538-05b2-453f-8b12-3193f6799e82"). InnerVolumeSpecName "kube-api-access-xct68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:53:26.524102 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.524080    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65c08538-05b2-453f-8b12-3193f6799e82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65c08538-05b2-453f-8b12-3193f6799e82" (UID: "65c08538-05b2-453f-8b12-3193f6799e82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:53:26.623226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.623197    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xct68\" (UniqueName: \"kubernetes.io/projected/65c08538-05b2-453f-8b12-3193f6799e82-kube-api-access-xct68\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:26.623226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.623225    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:26.623226 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.623239    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:26.623460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.623251    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:26.623460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.623263    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c08538-05b2-453f-8b12-3193f6799e82-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:26.623460 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:26.623273    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c08538-05b2-453f-8b12-3193f6799e82-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:53:27.327088 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:27.327056    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"
Sep 19 11:53:27.327539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:27.327083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4" event={"ID":"65c08538-05b2-453f-8b12-3193f6799e82","Type":"ContainerDied","Data":"e1ca270f76430942fe72c7148b248db9fba40b1ec26c065ad546ab75e4c578b1"}
Sep 19 11:53:27.327539 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:27.327139    2582 scope.go:117] "RemoveContainer" containerID="29c5862d92eed96b319cfc0e9e99dfd83cd0b2b0b707a7f5e060864f68909fb9"
Sep 19 11:53:27.348257 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:27.348228    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"]
Sep 19 11:53:27.353411 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:27.353385    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-fcfc8fcc/e2e-lifecycle-model-fcfc8fcc-kserve-cf8c7bc44-k9mg4"]
Sep 19 11:53:27.544503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:27.544463    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c08538-05b2-453f-8b12-3193f6799e82" path="/var/lib/kubelet/pods/65c08538-05b2-453f-8b12-3193f6799e82/volumes"
Sep 19 11:53:51.357745 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:53:51.357707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:54:30.842054 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:30.842021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:54:54.531055 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531022    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"]
Sep 19 11:54:54.533635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531423    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1823e06-7317-4fcb-80cd-0206e6b98837" containerName="payload-pre-processing"
Sep 19 11:54:54.533635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531434    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1823e06-7317-4fcb-80cd-0206e6b98837" containerName="payload-pre-processing"
Sep 19 11:54:54.533635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531446    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c08538-05b2-453f-8b12-3193f6799e82" containerName="main"
Sep 19 11:54:54.533635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531451    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c08538-05b2-453f-8b12-3193f6799e82" containerName="main"
Sep 19 11:54:54.533635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531513    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1823e06-7317-4fcb-80cd-0206e6b98837" containerName="payload-pre-processing"
Sep 19 11:54:54.533635 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.531521    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c08538-05b2-453f-8b12-3193f6799e82" containerName="main"
Sep 19 11:54:54.535320 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.535299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.537641 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.537613    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3c21ca-serving-cert\""
Sep 19 11:54:54.546952 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.546933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"]
Sep 19 11:54:54.586490 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.586464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a314dcc-c41e-4640-b2b3-f904033a10f5-openshift-service-ca\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.586643 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.586506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-metrics-certs\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.586721 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.586632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f7xp\" (UniqueName: \"kubernetes.io/projected/2a314dcc-c41e-4640-b2b3-f904033a10f5-kube-api-access-2f7xp\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.586785 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.586739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.687618 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.687584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a314dcc-c41e-4640-b2b3-f904033a10f5-openshift-service-ca\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.687618 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.687622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-metrics-certs\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.687876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.687675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f7xp\" (UniqueName: \"kubernetes.io/projected/2a314dcc-c41e-4640-b2b3-f904033a10f5-kube-api-access-2f7xp\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.687876 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.687718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.687876 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:54:54.687828    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-serving-cert: secret "maas-api-e2e-api-a-3c21ca-serving-cert" not found
Sep 19 11:54:54.688076 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:54:54.687897    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls podName:2a314dcc-c41e-4640-b2b3-f904033a10f5 nodeName:}" failed. No retries permitted until 2026-09-19 11:54:55.187875326 +0000 UTC m=+1266.204912018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls") pod "maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" (UID: "2a314dcc-c41e-4640-b2b3-f904033a10f5") : secret "maas-api-e2e-api-a-3c21ca-serving-cert" not found
Sep 19 11:54:54.688434 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.688409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a314dcc-c41e-4640-b2b3-f904033a10f5-openshift-service-ca\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.690286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.690258    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-metrics-certs\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:54.695529 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:54.695507    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f7xp\" (UniqueName: \"kubernetes.io/projected/2a314dcc-c41e-4640-b2b3-f904033a10f5-kube-api-access-2f7xp\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:55.192378 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:55.192346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:55.194678 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:55.194658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls\") pod \"maas-api-e2e-api-a-3c21ca-8557884949-6gtgd\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:55.450053 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:55.449966    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:55.728896 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:55.728866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"]
Sep 19 11:54:55.730796 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:54:55.730762    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a314dcc_c41e_4640_b2b3_f904033a10f5.slice/crio-ffdadc3c1d743c114e8cebf65a78ca06bfa1e5cc5d46734bad39f8d385fa1e61 WatchSource:0}: Error finding container ffdadc3c1d743c114e8cebf65a78ca06bfa1e5cc5d46734bad39f8d385fa1e61: Status 404 returned error can't find the container with id ffdadc3c1d743c114e8cebf65a78ca06bfa1e5cc5d46734bad39f8d385fa1e61
Sep 19 11:54:55.807863 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:55.807827    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" event={"ID":"2a314dcc-c41e-4640-b2b3-f904033a10f5","Type":"ContainerStarted","Data":"ffdadc3c1d743c114e8cebf65a78ca06bfa1e5cc5d46734bad39f8d385fa1e61"}
Sep 19 11:54:56.814754 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:56.814717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" event={"ID":"2a314dcc-c41e-4640-b2b3-f904033a10f5","Type":"ContainerStarted","Data":"6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329"}
Sep 19 11:54:56.815171 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:56.814789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:54:56.830341 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:54:56.830294    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" podStartSLOduration=2.450785643 podStartE2EDuration="2.830280773s" totalImagesPullingTime="379.49513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:54:56.829392528 +0000 UTC m=+1267.846429238" watchObservedRunningTime="2026-09-19 11:54:56.830280773 +0000 UTC m=+1267.847317497"
Sep 19 11:55:02.825479 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:02.825446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:55:06.056761 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:06.056727    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:55:29.535607 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.535572    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"]
Sep 19 11:55:29.541300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.541274    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.543586 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.543558    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c7b650-serving-cert\""
Sep 19 11:55:29.550003 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.549981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"]
Sep 19 11:55:29.630418 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.630378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.630572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.630423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc5486e-84cd-4507-9ffb-22074e584891-openshift-service-ca\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.630572 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.630489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-metrics-certs\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.630654 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.630594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7ck\" (UniqueName: \"kubernetes.io/projected/4cc5486e-84cd-4507-9ffb-22074e584891-kube-api-access-mk7ck\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.731531 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.731490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.731717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.731537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc5486e-84cd-4507-9ffb-22074e584891-openshift-service-ca\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.731717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.731586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-metrics-certs\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.731717 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:55:29.731632    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-serving-cert: secret "maas-api-e2e-api-b-c7b650-serving-cert" not found
Sep 19 11:55:29.731717 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.731677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7ck\" (UniqueName: \"kubernetes.io/projected/4cc5486e-84cd-4507-9ffb-22074e584891-kube-api-access-mk7ck\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.731717 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:55:29.731719    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls podName:4cc5486e-84cd-4507-9ffb-22074e584891 nodeName:}" failed. No retries permitted until 2026-09-19 11:55:30.231696382 +0000 UTC m=+1301.248733088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls") pod "maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" (UID: "4cc5486e-84cd-4507-9ffb-22074e584891") : secret "maas-api-e2e-api-b-c7b650-serving-cert" not found
Sep 19 11:55:29.732280 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.732253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc5486e-84cd-4507-9ffb-22074e584891-openshift-service-ca\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.734071 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.734051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-metrics-certs\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:29.739989 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:29.739967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7ck\" (UniqueName: \"kubernetes.io/projected/4cc5486e-84cd-4507-9ffb-22074e584891-kube-api-access-mk7ck\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:30.237845 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:30.237810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:30.240337 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:30.240302    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls\") pod \"maas-api-e2e-api-b-c7b650-6674796cd4-j94xk\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:30.455836 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:30.455804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:30.728811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:30.728786    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"]
Sep 19 11:55:30.730795 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:55:30.730770    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc5486e_84cd_4507_9ffb_22074e584891.slice/crio-0adb0ed68c21602c79b2ed9e4b78b68cab87e64d0d9b32c6cb26728f294b0958 WatchSource:0}: Error finding container 0adb0ed68c21602c79b2ed9e4b78b68cab87e64d0d9b32c6cb26728f294b0958: Status 404 returned error can't find the container with id 0adb0ed68c21602c79b2ed9e4b78b68cab87e64d0d9b32c6cb26728f294b0958
Sep 19 11:55:31.012689 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:31.012650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" event={"ID":"4cc5486e-84cd-4507-9ffb-22074e584891","Type":"ContainerStarted","Data":"0adb0ed68c21602c79b2ed9e4b78b68cab87e64d0d9b32c6cb26728f294b0958"}
Sep 19 11:55:32.019982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:32.019946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" event={"ID":"4cc5486e-84cd-4507-9ffb-22074e584891","Type":"ContainerStarted","Data":"baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2"}
Sep 19 11:55:32.020363 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:32.020071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:32.035705 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:32.035657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" podStartSLOduration=2.661275569 podStartE2EDuration="3.035644455s" totalImagesPullingTime="374.368886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:55:32.034870931 +0000 UTC m=+1303.051907644" watchObservedRunningTime="2026-09-19 11:55:32.035644455 +0000 UTC m=+1303.052681166"
Sep 19 11:55:38.031205 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:38.031170    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:55:51.527492 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.527454    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"]
Sep 19 11:55:51.531106 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.531085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.533536 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.533520    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7eb15e\"/\"embedding-w0-7eb15e-kserve-self-signed-certs\""
Sep 19 11:55:51.546605 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.546581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"]
Sep 19 11:55:51.650811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.650773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-home\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.650811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.650813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tls-certs\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.651089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.650907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-model-cache\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.651089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.650979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tmp-dir\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.651089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.651062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-dshm\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.651089 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.651087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwtm\" (UniqueName: \"kubernetes.io/projected/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-kube-api-access-7mwtm\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.751997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.751963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-home\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.751997 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tls-certs\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752217 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-model-cache\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752217 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tmp-dir\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752217 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-dshm\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752217 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwtm\" (UniqueName: \"kubernetes.io/projected/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-kube-api-access-7mwtm\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-home\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752494 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-model-cache\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.752537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.752506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tmp-dir\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.754451 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.754425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-dshm\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.754688 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.754674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tls-certs\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.760021 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.759999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwtm\" (UniqueName: \"kubernetes.io/projected/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-kube-api-access-7mwtm\") pod \"embedding-w0-7eb15e-kserve-5f75464886-zmc6w\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") " pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:51.841512 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:51.841442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:52.115558 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:52.115525    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"]
Sep 19 11:55:52.118041 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:55:52.117999    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7ba578_5eb0_4d64_b740_ab88b25fcfad.slice/crio-1509ebe27204bff1b4fd8b923c664bda30bdd48cab138dc73fde2f8ceb19e82a WatchSource:0}: Error finding container 1509ebe27204bff1b4fd8b923c664bda30bdd48cab138dc73fde2f8ceb19e82a: Status 404 returned error can't find the container with id 1509ebe27204bff1b4fd8b923c664bda30bdd48cab138dc73fde2f8ceb19e82a
Sep 19 11:55:52.149338 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:52.149303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" event={"ID":"9f7ba578-5eb0-4d64-b740-ab88b25fcfad","Type":"ContainerStarted","Data":"1509ebe27204bff1b4fd8b923c664bda30bdd48cab138dc73fde2f8ceb19e82a"}
Sep 19 11:55:53.156598 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:53.156552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" event={"ID":"9f7ba578-5eb0-4d64-b740-ab88b25fcfad","Type":"ContainerStarted","Data":"95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8"}
Sep 19 11:55:53.191045 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:53.190990    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" podStartSLOduration=2.19097313 podStartE2EDuration="2.19097313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:55:53.188861436 +0000 UTC m=+1324.205898147" watchObservedRunningTime="2026-09-19 11:55:53.19097313 +0000 UTC m=+1324.208009840"
Sep 19 11:55:53.842310 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:53.842279    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:55:57.247405 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:55:57.247367    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:56:01.841851 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:01.841808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:56:01.854879 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:01.854850    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:56:02.220753 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:02.220659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:56:13.689199 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.689111    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"]
Sep 19 11:56:13.689718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.689355    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" podUID="2a314dcc-c41e-4640-b2b3-f904033a10f5" containerName="maas-api" containerID="cri-o://6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329" gracePeriod=30
Sep 19 11:56:13.946773 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.946710    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:56:13.975556 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.975527    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a314dcc-c41e-4640-b2b3-f904033a10f5-openshift-service-ca\") pod \"2a314dcc-c41e-4640-b2b3-f904033a10f5\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") "
Sep 19 11:56:13.975733 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.975576    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls\") pod \"2a314dcc-c41e-4640-b2b3-f904033a10f5\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") "
Sep 19 11:56:13.975814 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.975736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-metrics-certs\") pod \"2a314dcc-c41e-4640-b2b3-f904033a10f5\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") "
Sep 19 11:56:13.975979 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.975953    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f7xp\" (UniqueName: \"kubernetes.io/projected/2a314dcc-c41e-4640-b2b3-f904033a10f5-kube-api-access-2f7xp\") pod \"2a314dcc-c41e-4640-b2b3-f904033a10f5\" (UID: \"2a314dcc-c41e-4640-b2b3-f904033a10f5\") "
Sep 19 11:56:13.976159 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.976110    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a314dcc-c41e-4640-b2b3-f904033a10f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a314dcc-c41e-4640-b2b3-f904033a10f5" (UID: "2a314dcc-c41e-4640-b2b3-f904033a10f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:56:13.976466 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.976394    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a314dcc-c41e-4640-b2b3-f904033a10f5-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:13.978246 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.978216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a314dcc-c41e-4640-b2b3-f904033a10f5-kube-api-access-2f7xp" (OuterVolumeSpecName: "kube-api-access-2f7xp") pod "2a314dcc-c41e-4640-b2b3-f904033a10f5" (UID: "2a314dcc-c41e-4640-b2b3-f904033a10f5"). InnerVolumeSpecName "kube-api-access-2f7xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:56:13.978359 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.978228    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2a314dcc-c41e-4640-b2b3-f904033a10f5" (UID: "2a314dcc-c41e-4640-b2b3-f904033a10f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:56:13.978496 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:13.978474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a314dcc-c41e-4640-b2b3-f904033a10f5" (UID: "2a314dcc-c41e-4640-b2b3-f904033a10f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:56:14.078016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.077979    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:14.078016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.078011    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f7xp\" (UniqueName: \"kubernetes.io/projected/2a314dcc-c41e-4640-b2b3-f904033a10f5-kube-api-access-2f7xp\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:14.078016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.078021    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a314dcc-c41e-4640-b2b3-f904033a10f5-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:14.273082 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.273048    2582 generic.go:356] "Generic (PLEG): container finished" podID="2a314dcc-c41e-4640-b2b3-f904033a10f5" containerID="6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329" exitCode=0
Sep 19 11:56:14.273300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.273100    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"
Sep 19 11:56:14.273300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.273148    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" event={"ID":"2a314dcc-c41e-4640-b2b3-f904033a10f5","Type":"ContainerDied","Data":"6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329"}
Sep 19 11:56:14.273300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.273211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd" event={"ID":"2a314dcc-c41e-4640-b2b3-f904033a10f5","Type":"ContainerDied","Data":"ffdadc3c1d743c114e8cebf65a78ca06bfa1e5cc5d46734bad39f8d385fa1e61"}
Sep 19 11:56:14.273300 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.273243    2582 scope.go:117] "RemoveContainer" containerID="6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329"
Sep 19 11:56:14.284806 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.284786    2582 scope.go:117] "RemoveContainer" containerID="6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329"
Sep 19 11:56:14.285097 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:56:14.285076    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329\": container with ID starting with 6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329 not found: ID does not exist" containerID="6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329"
Sep 19 11:56:14.285191 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.285108    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329"} err="failed to get container status \"6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329\": rpc error: code = NotFound desc = could not find container \"6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329\": container with ID starting with 6df895243f19167d1bcb37947bc838aa7df4cd4b9d92e1159d316bf908882329 not found: ID does not exist"
Sep 19 11:56:14.295182 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.295159    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"]
Sep 19 11:56:14.298535 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:14.298513    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3c21ca-8557884949-6gtgd"]
Sep 19 11:56:15.545056 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:15.545021    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a314dcc-c41e-4640-b2b3-f904033a10f5" path="/var/lib/kubelet/pods/2a314dcc-c41e-4640-b2b3-f904033a10f5/volumes"
Sep 19 11:56:35.049001 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:35.048963    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:56:36.062018 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.061984    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"]
Sep 19 11:56:36.062446 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.062246    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" podUID="4cc5486e-84cd-4507-9ffb-22074e584891" containerName="maas-api" containerID="cri-o://baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2" gracePeriod=30
Sep 19 11:56:36.313399 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.313339    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:56:36.398334 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.398298    2582 generic.go:356] "Generic (PLEG): container finished" podID="4cc5486e-84cd-4507-9ffb-22074e584891" containerID="baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2" exitCode=0
Sep 19 11:56:36.398501 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.398356    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"
Sep 19 11:56:36.398501 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.398343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" event={"ID":"4cc5486e-84cd-4507-9ffb-22074e584891","Type":"ContainerDied","Data":"baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2"}
Sep 19 11:56:36.398647 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.398530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk" event={"ID":"4cc5486e-84cd-4507-9ffb-22074e584891","Type":"ContainerDied","Data":"0adb0ed68c21602c79b2ed9e4b78b68cab87e64d0d9b32c6cb26728f294b0958"}
Sep 19 11:56:36.398647 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.398566    2582 scope.go:117] "RemoveContainer" containerID="baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2"
Sep 19 11:56:36.407760 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.407743    2582 scope.go:117] "RemoveContainer" containerID="baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2"
Sep 19 11:56:36.408068 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:56:36.408048    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2\": container with ID starting with baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2 not found: ID does not exist" containerID="baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2"
Sep 19 11:56:36.408139 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.408080    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2"} err="failed to get container status \"baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2\": rpc error: code = NotFound desc = could not find container \"baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2\": container with ID starting with baf436e497c075c92c3675fee59b90b05b0682846c00d0e98080ed4cda1679d2 not found: ID does not exist"
Sep 19 11:56:36.505899 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.505868    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-metrics-certs\") pod \"4cc5486e-84cd-4507-9ffb-22074e584891\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") "
Sep 19 11:56:36.506095 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.505969    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc5486e-84cd-4507-9ffb-22074e584891-openshift-service-ca\") pod \"4cc5486e-84cd-4507-9ffb-22074e584891\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") "
Sep 19 11:56:36.506152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.506142    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls\") pod \"4cc5486e-84cd-4507-9ffb-22074e584891\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") "
Sep 19 11:56:36.506213 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.506160    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk7ck\" (UniqueName: \"kubernetes.io/projected/4cc5486e-84cd-4507-9ffb-22074e584891-kube-api-access-mk7ck\") pod \"4cc5486e-84cd-4507-9ffb-22074e584891\" (UID: \"4cc5486e-84cd-4507-9ffb-22074e584891\") "
Sep 19 11:56:36.506354 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.506323    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc5486e-84cd-4507-9ffb-22074e584891-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4cc5486e-84cd-4507-9ffb-22074e584891" (UID: "4cc5486e-84cd-4507-9ffb-22074e584891"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:56:36.506516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.506490    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc5486e-84cd-4507-9ffb-22074e584891-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:36.508113 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.508087    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4cc5486e-84cd-4507-9ffb-22074e584891" (UID: "4cc5486e-84cd-4507-9ffb-22074e584891"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:56:36.508261 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.508239    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4cc5486e-84cd-4507-9ffb-22074e584891" (UID: "4cc5486e-84cd-4507-9ffb-22074e584891"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:56:36.508370 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.508350    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc5486e-84cd-4507-9ffb-22074e584891-kube-api-access-mk7ck" (OuterVolumeSpecName: "kube-api-access-mk7ck") pod "4cc5486e-84cd-4507-9ffb-22074e584891" (UID: "4cc5486e-84cd-4507-9ffb-22074e584891"). InnerVolumeSpecName "kube-api-access-mk7ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:56:36.608118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.608018    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:36.608118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.608048    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk7ck\" (UniqueName: \"kubernetes.io/projected/4cc5486e-84cd-4507-9ffb-22074e584891-kube-api-access-mk7ck\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:36.608118 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.608058    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cc5486e-84cd-4507-9ffb-22074e584891-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:36.722016 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.721982    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"]
Sep 19 11:56:36.727710 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:36.727682    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c7b650-6674796cd4-j94xk"]
Sep 19 11:56:37.545397 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:37.545364    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cc5486e-84cd-4507-9ffb-22074e584891" path="/var/lib/kubelet/pods/4cc5486e-84cd-4507-9ffb-22074e584891/volumes"
Sep 19 11:56:53.607503 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.607470    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"]
Sep 19 11:56:53.608039 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.607740    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd" podUID="5da28c9d-5428-4d2c-b247-8b3b9b22de0a" containerName="payload-processing" containerID="cri-o://735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60" gracePeriod=30
Sep 19 11:56:53.883810 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.883775    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:56:53.980856 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.980824    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljl84\" (UniqueName: \"kubernetes.io/projected/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-kube-api-access-ljl84\") pod \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") "
Sep 19 11:56:53.981058 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.981035    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-plugins-config-volume\") pod \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\" (UID: \"5da28c9d-5428-4d2c-b247-8b3b9b22de0a\") "
Sep 19 11:56:53.981371 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.981347    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5da28c9d-5428-4d2c-b247-8b3b9b22de0a" (UID: "5da28c9d-5428-4d2c-b247-8b3b9b22de0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:56:53.983085 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:53.983043    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-kube-api-access-ljl84" (OuterVolumeSpecName: "kube-api-access-ljl84") pod "5da28c9d-5428-4d2c-b247-8b3b9b22de0a" (UID: "5da28c9d-5428-4d2c-b247-8b3b9b22de0a"). InnerVolumeSpecName "kube-api-access-ljl84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:56:54.082029 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.081998    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:54.082029 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.082026    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljl84\" (UniqueName: \"kubernetes.io/projected/5da28c9d-5428-4d2c-b247-8b3b9b22de0a-kube-api-access-ljl84\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:56:54.498987 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.498950    2582 generic.go:356] "Generic (PLEG): container finished" podID="5da28c9d-5428-4d2c-b247-8b3b9b22de0a" containerID="735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60" exitCode=0
Sep 19 11:56:54.499156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.498995    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"
Sep 19 11:56:54.499156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.499007    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd" event={"ID":"5da28c9d-5428-4d2c-b247-8b3b9b22de0a","Type":"ContainerDied","Data":"735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60"}
Sep 19 11:56:54.499156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.499047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd" event={"ID":"5da28c9d-5428-4d2c-b247-8b3b9b22de0a","Type":"ContainerDied","Data":"d363640f7dd7fcf02dab5b2114aecfccf27b8a49a3918d6e29f6a5ed373d1f68"}
Sep 19 11:56:54.499156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.499068    2582 scope.go:117] "RemoveContainer" containerID="735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60"
Sep 19 11:56:54.508580 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.508556    2582 scope.go:117] "RemoveContainer" containerID="735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60"
Sep 19 11:56:54.508799 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:56:54.508783    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60\": container with ID starting with 735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60 not found: ID does not exist" containerID="735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60"
Sep 19 11:56:54.508854 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.508807    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60"} err="failed to get container status \"735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60\": rpc error: code = NotFound desc = could not find container \"735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60\": container with ID starting with 735261d42a03d0d93a208839a2017545823276a2d758aec578fc6a6a5d9cbc60 not found: ID does not exist"
Sep 19 11:56:54.520906 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.520881    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"]
Sep 19 11:56:54.527379 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:54.527359    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4bb32d-ff48d9dc5-lkfmd"]
Sep 19 11:56:55.544114 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:56:55.544083    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da28c9d-5428-4d2c-b247-8b3b9b22de0a" path="/var/lib/kubelet/pods/5da28c9d-5428-4d2c-b247-8b3b9b22de0a/volumes"
Sep 19 11:57:00.132262 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:00.132223    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"]
Sep 19 11:57:00.132678 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:00.132477    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy" containerID="cri-o://e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea" gracePeriod=30
Sep 19 11:57:05.388855 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.388826    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:57:05.493868 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.493845    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw88k\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-kube-api-access-dw88k\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494060 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.493875    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-envoy\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494060 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.493943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-certs\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494152 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-podinfo\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494190 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:05.494244 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494230    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-token\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494305 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494291    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-credential-socket\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494369 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494328    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istiod-ca-cert\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494424 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494375    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-data\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494424 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-socket\") pod \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\" (UID: \"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d\") "
Sep 19 11:57:05.494563 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494537    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:05.494737 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494694    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:05.494826 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494771    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:05.494949 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494930    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-credential-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.495024 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494956    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-data\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.495024 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494971    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-socket\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.495024 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494984    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-workload-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.495024 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.494950    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:57:05.496211 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.496189    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-kube-api-access-dw88k" (OuterVolumeSpecName: "kube-api-access-dw88k") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "kube-api-access-dw88k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:57:05.496315 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.496237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 11:57:05.496471 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.496441    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:05.496471 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.496457    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" (UID: "bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:57:05.565728 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.565696    2582 generic.go:356] "Generic (PLEG): container finished" podID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerID="e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea" exitCode=0
Sep 19 11:57:05.565850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.565748    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"
Sep 19 11:57:05.565850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.565769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" event={"ID":"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d","Type":"ContainerDied","Data":"e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea"}
Sep 19 11:57:05.565850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.565825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc" event={"ID":"bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d","Type":"ContainerDied","Data":"7ce64dbc934c7f168f587a5ae724df23df7c756061b4025fc96a74f53b2a5d7b"}
Sep 19 11:57:05.565850 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.565849    2582 scope.go:117] "RemoveContainer" containerID="e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea"
Sep 19 11:57:05.575264 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.575249    2582 scope.go:117] "RemoveContainer" containerID="c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"
Sep 19 11:57:05.583025 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.582999    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"]
Sep 19 11:57:05.584470 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.584454    2582 scope.go:117] "RemoveContainer" containerID="e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea"
Sep 19 11:57:05.584732 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:05.584712    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea\": container with ID starting with e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea not found: ID does not exist" containerID="e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea"
Sep 19 11:57:05.584803 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.584740    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea"} err="failed to get container status \"e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea\": rpc error: code = NotFound desc = could not find container \"e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea\": container with ID starting with e6625a92e9aacaec0ed83c1303a3c42759dcfe3e03aa6a285d05b5ceb2cf8eea not found: ID does not exist"
Sep 19 11:57:05.584803 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.584759    2582 scope.go:117] "RemoveContainer" containerID="c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"
Sep 19 11:57:05.585055 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:05.585037    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05\": container with ID starting with c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05 not found: ID does not exist" containerID="c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"
Sep 19 11:57:05.585130 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.585058    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05"} err="failed to get container status \"c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05\": rpc error: code = NotFound desc = could not find container \"c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05\": container with ID starting with c5cfd0f74b5475ebdaaefe589fc87876f59e7263ddb78ee0a5635a5fe5a07f05 not found: ID does not exist"
Sep 19 11:57:05.585448 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.585427    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4bb32d-openshift-default-666767f85b-tz4rc"]
Sep 19 11:57:05.597286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.597258    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istiod-ca-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.597286 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.597281    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw88k\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-kube-api-access-dw88k\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.597441 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.597290    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-envoy\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.597441 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.597300    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-podinfo\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:05.597441 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:05.597308    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d-istio-token\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:07.543752 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:07.543718    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" path="/var/lib/kubelet/pods/bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d/volumes"
Sep 19 11:57:12.458357 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.458326    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"]
Sep 19 11:57:12.458838 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.458581    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" podUID="f0015577-5579-4c5b-b84d-83c2d4bd4b37" containerName="maas-api" containerID="cri-o://0048106356fdb4157c44a336c7ddd212eb80e4fc29e532459385e2f9b6fbfc0c" gracePeriod=30
Sep 19 11:57:12.606940 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.606873    2582 generic.go:356] "Generic (PLEG): container finished" podID="f0015577-5579-4c5b-b84d-83c2d4bd4b37" containerID="0048106356fdb4157c44a336c7ddd212eb80e4fc29e532459385e2f9b6fbfc0c" exitCode=0
Sep 19 11:57:12.607099 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.606945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" event={"ID":"f0015577-5579-4c5b-b84d-83c2d4bd4b37","Type":"ContainerDied","Data":"0048106356fdb4157c44a336c7ddd212eb80e4fc29e532459385e2f9b6fbfc0c"}
Sep 19 11:57:12.704985 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.704961    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:57:12.870581 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.870545    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9stl\" (UniqueName: \"kubernetes.io/projected/f0015577-5579-4c5b-b84d-83c2d4bd4b37-kube-api-access-p9stl\") pod \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") "
Sep 19 11:57:12.870779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.870600    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls\") pod \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") "
Sep 19 11:57:12.870779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.870670    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0015577-5579-4c5b-b84d-83c2d4bd4b37-openshift-service-ca\") pod \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") "
Sep 19 11:57:12.870779 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.870710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-metrics-certs\") pod \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\" (UID: \"f0015577-5579-4c5b-b84d-83c2d4bd4b37\") "
Sep 19 11:57:12.872757 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.871088    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0015577-5579-4c5b-b84d-83c2d4bd4b37-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0015577-5579-4c5b-b84d-83c2d4bd4b37" (UID: "f0015577-5579-4c5b-b84d-83c2d4bd4b37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 11:57:12.873023 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.872996    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0015577-5579-4c5b-b84d-83c2d4bd4b37" (UID: "f0015577-5579-4c5b-b84d-83c2d4bd4b37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:57:12.873270 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.873241    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0015577-5579-4c5b-b84d-83c2d4bd4b37" (UID: "f0015577-5579-4c5b-b84d-83c2d4bd4b37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:57:12.873408 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.873383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0015577-5579-4c5b-b84d-83c2d4bd4b37-kube-api-access-p9stl" (OuterVolumeSpecName: "kube-api-access-p9stl") pod "f0015577-5579-4c5b-b84d-83c2d4bd4b37" (UID: "f0015577-5579-4c5b-b84d-83c2d4bd4b37"). InnerVolumeSpecName "kube-api-access-p9stl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:57:12.896062 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.896034    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"]
Sep 19 11:57:12.899519 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.899496    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"]
Sep 19 11:57:12.971727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.971693    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0015577-5579-4c5b-b84d-83c2d4bd4b37-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:12.971727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.971721    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:12.971727 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.971733    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9stl\" (UniqueName: \"kubernetes.io/projected/f0015577-5579-4c5b-b84d-83c2d4bd4b37-kube-api-access-p9stl\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:12.972070 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:12.971742    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0015577-5579-4c5b-b84d-83c2d4bd4b37-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:13.614333 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:13.614301    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"
Sep 19 11:57:13.614781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:13.614334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj" event={"ID":"f0015577-5579-4c5b-b84d-83c2d4bd4b37","Type":"ContainerDied","Data":"cd80a38be1de97b68034f61cc699da7533eef88a25ddaed5f6189b81218b5e2d"}
Sep 19 11:57:13.614781 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:13.614406    2582 scope.go:117] "RemoveContainer" containerID="0048106356fdb4157c44a336c7ddd212eb80e4fc29e532459385e2f9b6fbfc0c"
Sep 19 11:57:13.634622 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:13.634597    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"]
Sep 19 11:57:13.638732 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:13.638708    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-176c86-7bdb7dc889-qlhxj"]
Sep 19 11:57:14.594692 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:14.594656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:57:15.545599 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:15.545562    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0015577-5579-4c5b-b84d-83c2d4bd4b37" path="/var/lib/kubelet/pods/f0015577-5579-4c5b-b84d-83c2d4bd4b37/volumes"
Sep 19 11:57:27.915768 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:27.915698    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" podUID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" containerName="main" containerID="cri-o://b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940" gracePeriod=45
Sep 19 11:57:27.917875 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:27.917843    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" podUID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" containerName="main" containerID="cri-o://95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8" gracePeriod=45
Sep 19 11:57:28.179175 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.179149    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:57:28.218253 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.218224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx2td\" (UniqueName: \"kubernetes.io/projected/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-kube-api-access-tx2td\") pod \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") "
Sep 19 11:57:28.218419 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.218274    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tmp-dir\") pod \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") "
Sep 19 11:57:28.218419 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.218367    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tls-certs\") pod \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") "
Sep 19 11:57:28.218419 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.218416    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-model-cache\") pod \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") "
Sep 19 11:57:28.218587 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.218468    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-dshm\") pod \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") "
Sep 19 11:57:28.218587 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.218508    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-home\") pod \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\" (UID: \"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d\") "
Sep 19 11:57:28.219096 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.219017    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-home" (OuterVolumeSpecName: "home") pod "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" (UID: "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.221794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.219215    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" (UID: "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.221794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.219290    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-model-cache" (OuterVolumeSpecName: "model-cache") pod "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" (UID: "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.221794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.219445    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:57:28.221794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.221321    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" (UID: "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:57:28.221794 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.221364    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-dshm" (OuterVolumeSpecName: "dshm") pod "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" (UID: "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.222878 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.222856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-kube-api-access-tx2td" (OuterVolumeSpecName: "kube-api-access-tx2td") pod "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" (UID: "89ab3d34-ec63-4fba-a15d-2c3c90d3a13d"). InnerVolumeSpecName "kube-api-access-tx2td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:57:28.319892 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.319864    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tls-certs\") pod \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") "
Sep 19 11:57:28.320096 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.319900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-model-cache\") pod \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") "
Sep 19 11:57:28.320096 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.319950    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mwtm\" (UniqueName: \"kubernetes.io/projected/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-kube-api-access-7mwtm\") pod \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") "
Sep 19 11:57:28.320096 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320063    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-home\") pod \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") "
Sep 19 11:57:28.320276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-dshm\") pod \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") "
Sep 19 11:57:28.320276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320161    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tmp-dir\") pod \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\" (UID: \"9f7ba578-5eb0-4d64-b740-ab88b25fcfad\") "
Sep 19 11:57:28.320276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320217    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f7ba578-5eb0-4d64-b740-ab88b25fcfad" (UID: "9f7ba578-5eb0-4d64-b740-ab88b25fcfad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.320446 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320364    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-home" (OuterVolumeSpecName: "home") pod "9f7ba578-5eb0-4d64-b740-ab88b25fcfad" (UID: "9f7ba578-5eb0-4d64-b740-ab88b25fcfad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.320537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320506    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320519    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f7ba578-5eb0-4d64-b740-ab88b25fcfad" (UID: "9f7ba578-5eb0-4d64-b740-ab88b25fcfad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.320537 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320535    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320549    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320562    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320574    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320585    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320598    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx2td\" (UniqueName: \"kubernetes.io/projected/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-kube-api-access-tx2td\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.320716 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.320617    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.322594 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.322569    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-dshm" (OuterVolumeSpecName: "dshm") pod "9f7ba578-5eb0-4d64-b740-ab88b25fcfad" (UID: "9f7ba578-5eb0-4d64-b740-ab88b25fcfad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 11:57:28.322710 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.322593    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-kube-api-access-7mwtm" (OuterVolumeSpecName: "kube-api-access-7mwtm") pod "9f7ba578-5eb0-4d64-b740-ab88b25fcfad" (UID: "9f7ba578-5eb0-4d64-b740-ab88b25fcfad"). InnerVolumeSpecName "kube-api-access-7mwtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:57:28.322710 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.322620    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f7ba578-5eb0-4d64-b740-ab88b25fcfad" (UID: "9f7ba578-5eb0-4d64-b740-ab88b25fcfad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 11:57:28.421665 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.421569    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.421665 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.421602    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.421665 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.421618    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mwtm\" (UniqueName: \"kubernetes.io/projected/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-kube-api-access-7mwtm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.421665 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.421629    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f7ba578-5eb0-4d64-b740-ab88b25fcfad-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:28.695168 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.695072    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" containerID="95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8" exitCode=0
Sep 19 11:57:28.695168 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.695114    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"
Sep 19 11:57:28.695168 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.695115    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" event={"ID":"9f7ba578-5eb0-4d64-b740-ab88b25fcfad","Type":"ContainerDied","Data":"95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8"}
Sep 19 11:57:28.695168 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.695158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" event={"ID":"9f7ba578-5eb0-4d64-b740-ab88b25fcfad","Type":"ContainerDied","Data":"1509ebe27204bff1b4fd8b923c664bda30bdd48cab138dc73fde2f8ceb19e82a"}
Sep 19 11:57:28.695545 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.695176    2582 scope.go:117] "RemoveContainer" containerID="95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8"
Sep 19 11:57:28.696820 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.696797    2582 generic.go:356] "Generic (PLEG): container finished" podID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" containerID="b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940" exitCode=0
Sep 19 11:57:28.696982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.696839    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"
Sep 19 11:57:28.696982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.696860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" event={"ID":"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d","Type":"ContainerDied","Data":"b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940"}
Sep 19 11:57:28.696982 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.696883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" event={"ID":"89ab3d34-ec63-4fba-a15d-2c3c90d3a13d","Type":"ContainerDied","Data":"bba8544a04514872af83470088d6483fe37297d4e3c6740112ee270de73bc6f3"}
Sep 19 11:57:28.705156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.704981    2582 scope.go:117] "RemoveContainer" containerID="95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8"
Sep 19 11:57:28.705301 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:28.705281    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8\": container with ID starting with 95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8 not found: ID does not exist" containerID="95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8"
Sep 19 11:57:28.705358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.705312    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8"} err="failed to get container status \"95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8\": rpc error: code = NotFound desc = could not find container \"95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8\": container with ID starting with 95fd4a935dd9be819f9ff3373de8ee4aae4556f2053c88b0984700a4b351edb8 not found: ID does not exist"
Sep 19 11:57:28.705358 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.705337    2582 scope.go:117] "RemoveContainer" containerID="b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940"
Sep 19 11:57:28.713076 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.713043    2582 scope.go:117] "RemoveContainer" containerID="b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940"
Sep 19 11:57:28.713338 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:28.713317    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940\": container with ID starting with b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940 not found: ID does not exist" containerID="b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940"
Sep 19 11:57:28.713397 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.713345    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940"} err="failed to get container status \"b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940\": rpc error: code = NotFound desc = could not find container \"b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940\": container with ID starting with b10616b0db51aee37a3008d2f934c0545179443f437683ba4dd0053c4f98e940 not found: ID does not exist"
Sep 19 11:57:28.733272 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.733252    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"]
Sep 19 11:57:28.743632 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.743613    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w"]
Sep 19 11:57:28.763156 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.763136    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"]
Sep 19 11:57:28.767105 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:28.767085    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn"]
Sep 19 11:57:29.106645 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:29.106598    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7eb15e/distinct-w0-7eb15e-kserve-548b78c597-r8rkn" podUID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Sep 19 11:57:29.209450 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:29.209412    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7eb15e/embedding-w0-7eb15e-kserve-5f75464886-zmc6w" podUID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 19 11:57:29.543562 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:29.543530    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" path="/var/lib/kubelet/pods/89ab3d34-ec63-4fba-a15d-2c3c90d3a13d/volumes"
Sep 19 11:57:29.543926 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:29.543902    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" path="/var/lib/kubelet/pods/9f7ba578-5eb0-4d64-b740-ab88b25fcfad/volumes"
Sep 19 11:57:45.958976 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:45.958886    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:57:47.968934 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.968875    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-6447-8468ec"]
Sep 19 11:57:47.969718 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969689    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" containerName="main"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969722    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" containerName="main"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969745    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc5486e-84cd-4507-9ffb-22074e584891" containerName="maas-api"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969755    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc5486e-84cd-4507-9ffb-22074e584891" containerName="maas-api"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969771    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da28c9d-5428-4d2c-b247-8b3b9b22de0a" containerName="payload-processing"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969780    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da28c9d-5428-4d2c-b247-8b3b9b22de0a" containerName="payload-processing"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969796    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969810    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy"
Sep 19 11:57:47.969822 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969824    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0015577-5579-4c5b-b84d-83c2d4bd4b37" containerName="maas-api"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969832    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0015577-5579-4c5b-b84d-83c2d4bd4b37" containerName="maas-api"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969851    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969860    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969883    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" containerName="main"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969891    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" containerName="main"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969948    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a314dcc-c41e-4640-b2b3-f904033a10f5" containerName="maas-api"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.969956    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a314dcc-c41e-4640-b2b3-f904033a10f5" containerName="maas-api"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970121    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc5486e-84cd-4507-9ffb-22074e584891" containerName="maas-api"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970133    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da28c9d-5428-4d2c-b247-8b3b9b22de0a" containerName="payload-processing"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970149    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0015577-5579-4c5b-b84d-83c2d4bd4b37" containerName="maas-api"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970157    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ab3d34-ec63-4fba-a15d-2c3c90d3a13d" containerName="main"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970173    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970182    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ba578-5eb0-4d64-b740-ab88b25fcfad" containerName="main"
Sep 19 11:57:47.970276 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.970192    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a314dcc-c41e-4640-b2b3-f904033a10f5" containerName="maas-api"
Sep 19 11:57:47.974516 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.974484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:47.976290 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.976251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6447-8468ec"]
Sep 19 11:57:47.977141 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:47.977117    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qhqqh\""
Sep 19 11:57:48.113310 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.113280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hwd6\" (UniqueName: \"kubernetes.io/projected/ef875171-7f77-4a12-b081-a38d52181697-kube-api-access-6hwd6\") pod \"test-curl-6447-8468ec\" (UID: \"ef875171-7f77-4a12-b081-a38d52181697\") " pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:48.214971 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.214928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hwd6\" (UniqueName: \"kubernetes.io/projected/ef875171-7f77-4a12-b081-a38d52181697-kube-api-access-6hwd6\") pod \"test-curl-6447-8468ec\" (UID: \"ef875171-7f77-4a12-b081-a38d52181697\") " pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:48.224546 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.224476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hwd6\" (UniqueName: \"kubernetes.io/projected/ef875171-7f77-4a12-b081-a38d52181697-kube-api-access-6hwd6\") pod \"test-curl-6447-8468ec\" (UID: \"ef875171-7f77-4a12-b081-a38d52181697\") " pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:48.285532 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.285504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:48.552137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.552111    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6447-8468ec"]
Sep 19 11:57:48.555296 ip-10-0-133-160 kubenswrapper[2582]: W0919 11:57:48.555271    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef875171_7f77_4a12_b081_a38d52181697.slice/crio-f809d5b2f1ef5769b79186637a5da18990a652a8465481181f19eee7fa926f2f WatchSource:0}: Error finding container f809d5b2f1ef5769b79186637a5da18990a652a8465481181f19eee7fa926f2f: Status 404 returned error can't find the container with id f809d5b2f1ef5769b79186637a5da18990a652a8465481181f19eee7fa926f2f
Sep 19 11:57:48.557097 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.557080    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 11:57:48.803668 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:48.803584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6447-8468ec" event={"ID":"ef875171-7f77-4a12-b081-a38d52181697","Type":"ContainerStarted","Data":"f809d5b2f1ef5769b79186637a5da18990a652a8465481181f19eee7fa926f2f"}
Sep 19 11:57:49.809608 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:49.809571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6447-8468ec" event={"ID":"ef875171-7f77-4a12-b081-a38d52181697","Type":"ContainerStarted","Data":"29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa"}
Sep 19 11:57:49.823424 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:49.823382    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-6447-8468ec" podStartSLOduration=2.211059444 podStartE2EDuration="2.823366484s" totalImagesPullingTime="612.30704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 11:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 11:57:49.822443722 +0000 UTC m=+1440.839480434" watchObservedRunningTime="2026-09-19 11:57:49.823366484 +0000 UTC m=+1440.840403230"
Sep 19 11:57:50.363726 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:50.363690    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-6447-8468ec"]
Sep 19 11:57:50.368296 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:50.368268    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-6447-8468ec"]
Sep 19 11:57:50.815076 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:50.815048    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-6447-8468ec" container="test-curl-6447-8468ec"
Sep 19 11:57:51.819137 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:51.819098    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-6447-8468ec" podUID="ef875171-7f77-4a12-b081-a38d52181697" containerName="test-curl-6447-8468ec" containerID="cri-o://29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa" gracePeriod=2
Sep 19 11:57:54.014407 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.014377    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:54.176393 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.176314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hwd6\" (UniqueName: \"kubernetes.io/projected/ef875171-7f77-4a12-b081-a38d52181697-kube-api-access-6hwd6\") pod \"ef875171-7f77-4a12-b081-a38d52181697\" (UID: \"ef875171-7f77-4a12-b081-a38d52181697\") "
Sep 19 11:57:54.178408 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.178389    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef875171-7f77-4a12-b081-a38d52181697-kube-api-access-6hwd6" (OuterVolumeSpecName: "kube-api-access-6hwd6") pod "ef875171-7f77-4a12-b081-a38d52181697" (UID: "ef875171-7f77-4a12-b081-a38d52181697"). InnerVolumeSpecName "kube-api-access-6hwd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 11:57:54.277176 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.277142    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hwd6\" (UniqueName: \"kubernetes.io/projected/ef875171-7f77-4a12-b081-a38d52181697-kube-api-access-6hwd6\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 11:57:54.835184 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.835145    2582 generic.go:356] "Generic (PLEG): container finished" podID="ef875171-7f77-4a12-b081-a38d52181697" containerID="29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa" exitCode=137
Sep 19 11:57:54.835347 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.835191    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:54.835347 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.835217    2582 scope.go:117] "RemoveContainer" containerID="29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa"
Sep 19 11:57:54.843095 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.843080    2582 scope.go:117] "RemoveContainer" containerID="29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa"
Sep 19 11:57:54.843405 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:54.843371    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa\": container with ID starting with 29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa not found: ID does not exist" containerID="29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa"
Sep 19 11:57:54.843493 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:54.843416    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa"} err="failed to get container status \"29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa\": rpc error: code = NotFound desc = could not find container \"29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa\": container with ID starting with 29d8001a0574237dc8350bdf628fbc0db041144a3b4dae600f5fb08dc13ecbfa not found: ID does not exist"
Sep 19 11:57:54.845382 ip-10-0-133-160 kubenswrapper[2582]: E0919 11:57:54.845358    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-6447-8468ec\" is forbidden: User \"system:node:ip-10-0-133-160.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-160.ec2.internal' and this object" podUID="ef875171-7f77-4a12-b081-a38d52181697" pod="opendatahub/test-curl-6447-8468ec"
Sep 19 11:57:55.543290 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:57:55.543248    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef875171-7f77-4a12-b081-a38d52181697" path="/var/lib/kubelet/pods/ef875171-7f77-4a12-b081-a38d52181697/volumes"
Sep 19 11:58:06.238960 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:58:06.238927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:58:22.143691 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:58:22.143659    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:58:42.140975 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:58:42.140937    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:59:02.547638 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:59:02.547602    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:59:25.340767 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:59:25.340688    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:59:41.649318 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:59:41.649278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 11:59:50.643811 ip-10-0-133-160 kubenswrapper[2582]: I0919 11:59:50.643775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:00:18.749709 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:00:18.749664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:00:39.440392 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:00:39.440357    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:00:54.047829 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:00:54.047793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:01:09.039064 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:09.039021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:01:26.939776 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:26.939727    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:01:37.146938 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.146891    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"]
Sep 19 12:01:37.147989 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.147951    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef875171-7f77-4a12-b081-a38d52181697" containerName="test-curl-6447-8468ec"
Sep 19 12:01:37.147989 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.147975    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef875171-7f77-4a12-b081-a38d52181697" containerName="test-curl-6447-8468ec"
Sep 19 12:01:37.148191 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.148087    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef875171-7f77-4a12-b081-a38d52181697" containerName="test-curl-6447-8468ec"
Sep 19 12:01:37.148191 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.148098    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae9eb5a-c0a8-451a-8cb7-2ccdf9d03b1d" containerName="istio-proxy"
Sep 19 12:01:37.152274 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.152250    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.154742 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.154672    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-df64a0-serving-cert\""
Sep 19 12:01:37.159662 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.159606    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"]
Sep 19 12:01:37.300888 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.300848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.301115 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.300982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66pgw\" (UniqueName: \"kubernetes.io/projected/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-kube-api-access-66pgw\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.301115 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.301019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-metrics-certs\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.301115 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.301091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.401675 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.401593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.401675 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.401670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66pgw\" (UniqueName: \"kubernetes.io/projected/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-kube-api-access-66pgw\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.401867 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.401701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-metrics-certs\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.401867 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.401738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.402324 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.402301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.404177 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.404151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-metrics-certs\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.404308 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.404276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.408713 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.408692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66pgw\" (UniqueName: \"kubernetes.io/projected/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-kube-api-access-66pgw\") pod \"maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.466565 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.466535    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:37.746632 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.746597    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"]
Sep 19 12:01:37.747097 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:01:37.747070    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e66c6f_5bca_4799_a5e0_8058d1ce0b3d.slice/crio-44e61e92f1267472397600ed4a17461c52d691a7775fc3e8792401c5b5cbf124 WatchSource:0}: Error finding container 44e61e92f1267472397600ed4a17461c52d691a7775fc3e8792401c5b5cbf124: Status 404 returned error can't find the container with id 44e61e92f1267472397600ed4a17461c52d691a7775fc3e8792401c5b5cbf124
Sep 19 12:01:37.973647 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:37.973616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n" event={"ID":"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d","Type":"ContainerStarted","Data":"44e61e92f1267472397600ed4a17461c52d691a7775fc3e8792401c5b5cbf124"}
Sep 19 12:01:38.986697 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:38.986660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n" event={"ID":"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d","Type":"ContainerStarted","Data":"9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825"}
Sep 19 12:01:38.987111 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:38.986762    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:01:39.004999 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:39.004952    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n" podStartSLOduration=1.667209908 podStartE2EDuration="2.004933139s" totalImagesPullingTime="337.723231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:01:39.00177131 +0000 UTC m=+1670.018808022" watchObservedRunningTime="2026-09-19 12:01:39.004933139 +0000 UTC m=+1670.021970244"
Sep 19 12:01:41.850871 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:41.850830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:01:44.997466 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:01:44.997435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:02:14.946244 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:14.946158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:02:41.547495 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:41.547464    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:02:55.826054 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.826019    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"]
Sep 19 12:02:55.830159 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.830134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:55.832510 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.832488    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-78dcba-serving-cert\""
Sep 19 12:02:55.842031 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.842008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"]
Sep 19 12:02:55.947378 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.947345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a94fe-ee6a-4889-93f4-32b093f96870-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:55.947561 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.947386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbbg\" (UniqueName: \"kubernetes.io/projected/0a6a94fe-ee6a-4889-93f4-32b093f96870-kube-api-access-zzbbg\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:55.947561 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.947457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:55.947561 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:55.947548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.048303 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.048264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.048498 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.048327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a94fe-ee6a-4889-93f4-32b093f96870-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.048498 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.048357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbbg\" (UniqueName: \"kubernetes.io/projected/0a6a94fe-ee6a-4889-93f4-32b093f96870-kube-api-access-zzbbg\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.048498 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.048410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.049123 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.049088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a94fe-ee6a-4889-93f4-32b093f96870-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.050786 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.050764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.050879 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.050815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.056638 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.056618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbbg\" (UniqueName: \"kubernetes.io/projected/0a6a94fe-ee6a-4889-93f4-32b093f96870-kube-api-access-zzbbg\") pod \"maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.144614 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.144543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:56.424846 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.424813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"]
Sep 19 12:02:56.425381 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:02:56.425356    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6a94fe_ee6a_4889_93f4_32b093f96870.slice/crio-100494c1d8399adbe4f1a93d000bfc0fe5ad620d0ae9472e3b5b987965f319a4 WatchSource:0}: Error finding container 100494c1d8399adbe4f1a93d000bfc0fe5ad620d0ae9472e3b5b987965f319a4: Status 404 returned error can't find the container with id 100494c1d8399adbe4f1a93d000bfc0fe5ad620d0ae9472e3b5b987965f319a4
Sep 19 12:02:56.427186 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.427164    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 12:02:56.437338 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.437316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"]
Sep 19 12:02:56.441878 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.441862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.444291 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.444268    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-78dcba\""
Sep 19 12:02:56.444435 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.444411    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-78dcba-dockercfg-5fxwd\""
Sep 19 12:02:56.450743 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.450719    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"]
Sep 19 12:02:56.554638 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.554596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.554826 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.554672    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97nfk\" (UniqueName: \"kubernetes.io/projected/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-kube-api-access-97nfk\") pod \"payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.656191 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.656158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97nfk\" (UniqueName: \"kubernetes.io/projected/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-kube-api-access-97nfk\") pod \"payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.656360 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.656265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.656985 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.656967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.663342 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.663324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97nfk\" (UniqueName: \"kubernetes.io/projected/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-kube-api-access-97nfk\") pod \"payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:56.753817 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:56.753784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:57.023189 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.023160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"]
Sep 19 12:02:57.025766 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:02:57.025734    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc1c651_0c7f_4d86_a1cb_8b6063440bd6.slice/crio-cab3af28e006b2be1b1bbf46bf958a84bdcfce96000afb415106f7a330f852db WatchSource:0}: Error finding container cab3af28e006b2be1b1bbf46bf958a84bdcfce96000afb415106f7a330f852db: Status 404 returned error can't find the container with id cab3af28e006b2be1b1bbf46bf958a84bdcfce96000afb415106f7a330f852db
Sep 19 12:02:57.397017 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.396908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz" event={"ID":"adc1c651-0c7f-4d86-a1cb-8b6063440bd6","Type":"ContainerStarted","Data":"509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d"}
Sep 19 12:02:57.397017 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.396976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz" event={"ID":"adc1c651-0c7f-4d86-a1cb-8b6063440bd6","Type":"ContainerStarted","Data":"cab3af28e006b2be1b1bbf46bf958a84bdcfce96000afb415106f7a330f852db"}
Sep 19 12:02:57.397017 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.397007    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:02:57.398934 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.398874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s" event={"ID":"0a6a94fe-ee6a-4889-93f4-32b093f96870","Type":"ContainerStarted","Data":"4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649"}
Sep 19 12:02:57.399064 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.398945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s" event={"ID":"0a6a94fe-ee6a-4889-93f4-32b093f96870","Type":"ContainerStarted","Data":"100494c1d8399adbe4f1a93d000bfc0fe5ad620d0ae9472e3b5b987965f319a4"}
Sep 19 12:02:57.399064 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.398977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:02:57.412054 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.412003    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz" podStartSLOduration=1.411987995 podStartE2EDuration="1.411987995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:02:57.411736275 +0000 UTC m=+1748.428772989" watchObservedRunningTime="2026-09-19 12:02:57.411987995 +0000 UTC m=+1748.429024710"
Sep 19 12:02:57.427832 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:02:57.427792    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s" podStartSLOduration=1.9971643879999998 podStartE2EDuration="2.427778273s" totalImagesPullingTime="430.613885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:02:57.425996173 +0000 UTC m=+1748.443032890" watchObservedRunningTime="2026-09-19 12:02:57.427778273 +0000 UTC m=+1748.444814984"
Sep 19 12:03:03.409411 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:03.409380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:03:08.406732 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:08.406700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:03:09.545404 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:09.545373    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:03:24.513173 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.513130    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"]
Sep 19 12:03:24.513575 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.513372    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s" podUID="0a6a94fe-ee6a-4889-93f4-32b093f96870" containerName="maas-api" containerID="cri-o://4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649" gracePeriod=30
Sep 19 12:03:24.556093 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.556061    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"]
Sep 19 12:03:24.556657 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.556334    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz" podUID="adc1c651-0c7f-4d86-a1cb-8b6063440bd6" containerName="payload-processing" containerID="cri-o://509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d" gracePeriod=30
Sep 19 12:03:24.806122 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.806091    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:03:24.845117 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.845089    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:03:24.933623 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.933590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97nfk\" (UniqueName: \"kubernetes.io/projected/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-kube-api-access-97nfk\") pod \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") "
Sep 19 12:03:24.933818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.933629    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-metrics-certs\") pod \"0a6a94fe-ee6a-4889-93f4-32b093f96870\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") "
Sep 19 12:03:24.933818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.933651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-maas-api-tls\") pod \"0a6a94fe-ee6a-4889-93f4-32b093f96870\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") "
Sep 19 12:03:24.933818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.933724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a94fe-ee6a-4889-93f4-32b093f96870-openshift-service-ca\") pod \"0a6a94fe-ee6a-4889-93f4-32b093f96870\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") "
Sep 19 12:03:24.933818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.933741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-plugins-config-volume\") pod \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\" (UID: \"adc1c651-0c7f-4d86-a1cb-8b6063440bd6\") "
Sep 19 12:03:24.933818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.933772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzbbg\" (UniqueName: \"kubernetes.io/projected/0a6a94fe-ee6a-4889-93f4-32b093f96870-kube-api-access-zzbbg\") pod \"0a6a94fe-ee6a-4889-93f4-32b093f96870\" (UID: \"0a6a94fe-ee6a-4889-93f4-32b093f96870\") "
Sep 19 12:03:24.934217 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.934152    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "adc1c651-0c7f-4d86-a1cb-8b6063440bd6" (UID: "adc1c651-0c7f-4d86-a1cb-8b6063440bd6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:03:24.934217 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.934173    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6a94fe-ee6a-4889-93f4-32b093f96870-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a6a94fe-ee6a-4889-93f4-32b093f96870" (UID: "0a6a94fe-ee6a-4889-93f4-32b093f96870"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:03:24.935944 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.935895    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-kube-api-access-97nfk" (OuterVolumeSpecName: "kube-api-access-97nfk") pod "adc1c651-0c7f-4d86-a1cb-8b6063440bd6" (UID: "adc1c651-0c7f-4d86-a1cb-8b6063440bd6"). InnerVolumeSpecName "kube-api-access-97nfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:03:24.935944 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.935903    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a6a94fe-ee6a-4889-93f4-32b093f96870" (UID: "0a6a94fe-ee6a-4889-93f4-32b093f96870"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:03:24.936093 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.935961    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0a6a94fe-ee6a-4889-93f4-32b093f96870" (UID: "0a6a94fe-ee6a-4889-93f4-32b093f96870"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:03:24.936093 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:24.935981    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6a94fe-ee6a-4889-93f4-32b093f96870-kube-api-access-zzbbg" (OuterVolumeSpecName: "kube-api-access-zzbbg") pod "0a6a94fe-ee6a-4889-93f4-32b093f96870" (UID: "0a6a94fe-ee6a-4889-93f4-32b093f96870"). InnerVolumeSpecName "kube-api-access-zzbbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:03:25.034683 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.034595    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97nfk\" (UniqueName: \"kubernetes.io/projected/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-kube-api-access-97nfk\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:03:25.034683 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.034627    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:03:25.034683 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.034636    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a6a94fe-ee6a-4889-93f4-32b093f96870-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:03:25.034683 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.034644    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a94fe-ee6a-4889-93f4-32b093f96870-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:03:25.034683 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.034654    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adc1c651-0c7f-4d86-a1cb-8b6063440bd6-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:03:25.034683 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.034662    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzbbg\" (UniqueName: \"kubernetes.io/projected/0a6a94fe-ee6a-4889-93f4-32b093f96870-kube-api-access-zzbbg\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:03:25.545231 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.545194    2582 generic.go:356] "Generic (PLEG): container finished" podID="adc1c651-0c7f-4d86-a1cb-8b6063440bd6" containerID="509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d" exitCode=0
Sep 19 12:03:25.545645 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.545231    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"
Sep 19 12:03:25.545645 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.545268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz" event={"ID":"adc1c651-0c7f-4d86-a1cb-8b6063440bd6","Type":"ContainerDied","Data":"509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d"}
Sep 19 12:03:25.545645 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.545325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz" event={"ID":"adc1c651-0c7f-4d86-a1cb-8b6063440bd6","Type":"ContainerDied","Data":"cab3af28e006b2be1b1bbf46bf958a84bdcfce96000afb415106f7a330f852db"}
Sep 19 12:03:25.545645 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.545358    2582 scope.go:117] "RemoveContainer" containerID="509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d"
Sep 19 12:03:25.547037 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.546868    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a6a94fe-ee6a-4889-93f4-32b093f96870" containerID="4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649" exitCode=0
Sep 19 12:03:25.547037 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.546976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s" event={"ID":"0a6a94fe-ee6a-4889-93f4-32b093f96870","Type":"ContainerDied","Data":"4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649"}
Sep 19 12:03:25.547037 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.547007    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"
Sep 19 12:03:25.547037 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.547021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s" event={"ID":"0a6a94fe-ee6a-4889-93f4-32b093f96870","Type":"ContainerDied","Data":"100494c1d8399adbe4f1a93d000bfc0fe5ad620d0ae9472e3b5b987965f319a4"}
Sep 19 12:03:25.557259 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.557230    2582 scope.go:117] "RemoveContainer" containerID="509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d"
Sep 19 12:03:25.557536 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:03:25.557516    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d\": container with ID starting with 509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d not found: ID does not exist" containerID="509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d"
Sep 19 12:03:25.557623 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.557545    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d"} err="failed to get container status \"509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d\": rpc error: code = NotFound desc = could not find container \"509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d\": container with ID starting with 509284a05ebfc5ab580210ff9645817d05da80b72ad71769a2dc7f055b4e520d not found: ID does not exist"
Sep 19 12:03:25.557623 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.557561    2582 scope.go:117] "RemoveContainer" containerID="4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649"
Sep 19 12:03:25.566612 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.566596    2582 scope.go:117] "RemoveContainer" containerID="4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649"
Sep 19 12:03:25.566897 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:03:25.566878    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649\": container with ID starting with 4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649 not found: ID does not exist" containerID="4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649"
Sep 19 12:03:25.566985 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.566904    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649"} err="failed to get container status \"4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649\": rpc error: code = NotFound desc = could not find container \"4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649\": container with ID starting with 4343d92d834d9014526cc2fc03c0140ac9b2d7e53dd0fd12c429bbd08a120649 not found: ID does not exist"
Sep 19 12:03:25.571806 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.571784    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"]
Sep 19 12:03:25.574899 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.574878    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78dcba-79bc99f7c-rxpwz"]
Sep 19 12:03:25.584747 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.584719    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"]
Sep 19 12:03:25.588056 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:25.588037    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-78dcba-656f4c56d9-rql7s"]
Sep 19 12:03:27.544289 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:27.544253    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6a94fe-ee6a-4889-93f4-32b093f96870" path="/var/lib/kubelet/pods/0a6a94fe-ee6a-4889-93f4-32b093f96870/volumes"
Sep 19 12:03:27.544663 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:27.544631    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc1c651-0c7f-4d86-a1cb-8b6063440bd6" path="/var/lib/kubelet/pods/adc1c651-0c7f-4d86-a1cb-8b6063440bd6/volumes"
Sep 19 12:03:30.746447 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:30.746414    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:03:50.638952 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:03:50.638895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:04:08.542741 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:08.542701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:04:49.343790 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.343752    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"]
Sep 19 12:04:49.344376 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.344005    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n" podUID="39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" containerName="maas-api" containerID="cri-o://9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825" gracePeriod=30
Sep 19 12:04:49.596795 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.596735    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:04:49.764146 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.764110    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-openshift-service-ca\") pod \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") "
Sep 19 12:04:49.764146 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.764153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66pgw\" (UniqueName: \"kubernetes.io/projected/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-kube-api-access-66pgw\") pod \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") "
Sep 19 12:04:49.764363 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.764244    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-metrics-certs\") pod \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") "
Sep 19 12:04:49.764363 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.764263    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-maas-api-tls\") pod \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\" (UID: \"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d\") "
Sep 19 12:04:49.764561 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.764535    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" (UID: "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:04:49.766400 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.766379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" (UID: "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:04:49.766492 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.766476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" (UID: "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:04:49.766534 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.766501    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-kube-api-access-66pgw" (OuterVolumeSpecName: "kube-api-access-66pgw") pod "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" (UID: "39e66c6f-5bca-4799-a5e0-8058d1ce0b3d"). InnerVolumeSpecName "kube-api-access-66pgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:04:49.865192 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.865112    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:04:49.865192 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.865137    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:04:49.865192 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.865146    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:04:49.865192 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.865156    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66pgw\" (UniqueName: \"kubernetes.io/projected/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d-kube-api-access-66pgw\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:04:49.993800 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.993763    2582 generic.go:356] "Generic (PLEG): container finished" podID="39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" containerID="9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825" exitCode=0
Sep 19 12:04:49.993993 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.993832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n" event={"ID":"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d","Type":"ContainerDied","Data":"9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825"}
Sep 19 12:04:49.993993 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.993903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n" event={"ID":"39e66c6f-5bca-4799-a5e0-8058d1ce0b3d","Type":"ContainerDied","Data":"44e61e92f1267472397600ed4a17461c52d691a7775fc3e8792401c5b5cbf124"}
Sep 19 12:04:49.993993 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.993837    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"
Sep 19 12:04:49.993993 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:49.993963    2582 scope.go:117] "RemoveContainer" containerID="9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825"
Sep 19 12:04:50.003867 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:50.003844    2582 scope.go:117] "RemoveContainer" containerID="9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825"
Sep 19 12:04:50.004144 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:04:50.004125    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825\": container with ID starting with 9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825 not found: ID does not exist" containerID="9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825"
Sep 19 12:04:50.004196 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:50.004152    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825"} err="failed to get container status \"9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825\": rpc error: code = NotFound desc = could not find container \"9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825\": container with ID starting with 9aaec2d0863f8aec1859854f37fc264cba5650c59e927f5d48ce1e322c58c825 not found: ID does not exist"
Sep 19 12:04:50.015619 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:50.015594    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"]
Sep 19 12:04:50.020936 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:50.020900    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df64a0-694c74b745-vpf8n"]
Sep 19 12:04:51.544245 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:51.544211    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" path="/var/lib/kubelet/pods/39e66c6f-5bca-4799-a5e0-8058d1ce0b3d/volumes"
Sep 19 12:04:54.137119 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:04:54.137083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:05:07.046215 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.046177    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"]
Sep 19 12:05:07.046798 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.046468    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" podUID="dc781bdf-c421-4ae8-add5-3d970e495caf" containerName="maas-api" containerID="cri-o://a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8" gracePeriod=30
Sep 19 12:05:07.096266 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.096227    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"]
Sep 19 12:05:07.096586 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.096555    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn" podUID="7611d9a8-19e0-403d-b05f-a56e11d4bcb3" containerName="payload-processing" containerID="cri-o://6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd" gracePeriod=30
Sep 19 12:05:07.365377 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.365351    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 12:05:07.390987 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.390961    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 12:05:07.426406 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.426379    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-metrics-certs\") pod \"dc781bdf-c421-4ae8-add5-3d970e495caf\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") "
Sep 19 12:05:07.426575 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.426437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hwss\" (UniqueName: \"kubernetes.io/projected/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-kube-api-access-2hwss\") pod \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") "
Sep 19 12:05:07.426575 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.426470    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls\") pod \"dc781bdf-c421-4ae8-add5-3d970e495caf\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") "
Sep 19 12:05:07.426575 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.426495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqpzq\" (UniqueName: \"kubernetes.io/projected/dc781bdf-c421-4ae8-add5-3d970e495caf-kube-api-access-wqpzq\") pod \"dc781bdf-c421-4ae8-add5-3d970e495caf\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") "
Sep 19 12:05:07.426776 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.426749    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc781bdf-c421-4ae8-add5-3d970e495caf-openshift-service-ca\") pod \"dc781bdf-c421-4ae8-add5-3d970e495caf\" (UID: \"dc781bdf-c421-4ae8-add5-3d970e495caf\") "
Sep 19 12:05:07.426865 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.426808    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-plugins-config-volume\") pod \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\" (UID: \"7611d9a8-19e0-403d-b05f-a56e11d4bcb3\") "
Sep 19 12:05:07.427236 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.427185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc781bdf-c421-4ae8-add5-3d970e495caf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc781bdf-c421-4ae8-add5-3d970e495caf" (UID: "dc781bdf-c421-4ae8-add5-3d970e495caf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:05:07.427481 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.427452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7611d9a8-19e0-403d-b05f-a56e11d4bcb3" (UID: "7611d9a8-19e0-403d-b05f-a56e11d4bcb3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:05:07.428756 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.428726    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc781bdf-c421-4ae8-add5-3d970e495caf-kube-api-access-wqpzq" (OuterVolumeSpecName: "kube-api-access-wqpzq") pod "dc781bdf-c421-4ae8-add5-3d970e495caf" (UID: "dc781bdf-c421-4ae8-add5-3d970e495caf"). InnerVolumeSpecName "kube-api-access-wqpzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:05:07.428857 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.428761    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc781bdf-c421-4ae8-add5-3d970e495caf" (UID: "dc781bdf-c421-4ae8-add5-3d970e495caf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:05:07.429040 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.429017    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc781bdf-c421-4ae8-add5-3d970e495caf" (UID: "dc781bdf-c421-4ae8-add5-3d970e495caf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:05:07.429121 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.429060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-kube-api-access-2hwss" (OuterVolumeSpecName: "kube-api-access-2hwss") pod "7611d9a8-19e0-403d-b05f-a56e11d4bcb3" (UID: "7611d9a8-19e0-403d-b05f-a56e11d4bcb3"). InnerVolumeSpecName "kube-api-access-2hwss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:05:07.527966 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.527935    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc781bdf-c421-4ae8-add5-3d970e495caf-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:07.527966 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.527963    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:07.528185 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.527975    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:07.528185 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.527984    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hwss\" (UniqueName: \"kubernetes.io/projected/7611d9a8-19e0-403d-b05f-a56e11d4bcb3-kube-api-access-2hwss\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:07.528185 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.527993    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc781bdf-c421-4ae8-add5-3d970e495caf-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:07.528185 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:07.528001    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqpzq\" (UniqueName: \"kubernetes.io/projected/dc781bdf-c421-4ae8-add5-3d970e495caf-kube-api-access-wqpzq\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:08.089962 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.089908    2582 generic.go:356] "Generic (PLEG): container finished" podID="7611d9a8-19e0-403d-b05f-a56e11d4bcb3" containerID="6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd" exitCode=0
Sep 19 12:05:08.090364 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.089977    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"
Sep 19 12:05:08.090364 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.090045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn" event={"ID":"7611d9a8-19e0-403d-b05f-a56e11d4bcb3","Type":"ContainerDied","Data":"6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd"}
Sep 19 12:05:08.090364 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.090094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn" event={"ID":"7611d9a8-19e0-403d-b05f-a56e11d4bcb3","Type":"ContainerDied","Data":"ca4a74dbb60431aed48aba05f3cdadf3da2b4c8ee845f0be98debb3ab7b97857"}
Sep 19 12:05:08.090364 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.090122    2582 scope.go:117] "RemoveContainer" containerID="6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd"
Sep 19 12:05:08.091746 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.091618    2582 generic.go:356] "Generic (PLEG): container finished" podID="dc781bdf-c421-4ae8-add5-3d970e495caf" containerID="a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8" exitCode=0
Sep 19 12:05:08.091746 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.091685    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"
Sep 19 12:05:08.091746 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.091693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" event={"ID":"dc781bdf-c421-4ae8-add5-3d970e495caf","Type":"ContainerDied","Data":"a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8"}
Sep 19 12:05:08.091746 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.091733    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw" event={"ID":"dc781bdf-c421-4ae8-add5-3d970e495caf","Type":"ContainerDied","Data":"b70022e6393019b954609e62bbd76cc0801e1690199f8aa841f325ee7b3e8cab"}
Sep 19 12:05:08.099835 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.099818    2582 scope.go:117] "RemoveContainer" containerID="6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd"
Sep 19 12:05:08.100116 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:05:08.100095    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd\": container with ID starting with 6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd not found: ID does not exist" containerID="6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd"
Sep 19 12:05:08.100202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.100125    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd"} err="failed to get container status \"6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd\": rpc error: code = NotFound desc = could not find container \"6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd\": container with ID starting with 6bfac78db7f309064eb60696703c5aa043083cb78fb33b22014e413dfd74befd not found: ID does not exist"
Sep 19 12:05:08.100202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.100143    2582 scope.go:117] "RemoveContainer" containerID="a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8"
Sep 19 12:05:08.108560 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.108538    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"]
Sep 19 12:05:08.108730 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.108688    2582 scope.go:117] "RemoveContainer" containerID="a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8"
Sep 19 12:05:08.108988 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:05:08.108966    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8\": container with ID starting with a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8 not found: ID does not exist" containerID="a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8"
Sep 19 12:05:08.109039 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.108995    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8"} err="failed to get container status \"a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8\": rpc error: code = NotFound desc = could not find container \"a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8\": container with ID starting with a9902a81b8348fcf343134ae7f37f79ce4f0ac4858d553a1d4255d6e011c2fb8 not found: ID does not exist"
Sep 19 12:05:08.112174 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.112154    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4937ff-7cf7d44f4f-skwhw"]
Sep 19 12:05:08.121240 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.121217    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"]
Sep 19 12:05:08.124962 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:08.124939    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-4937ff-85996d9fdf-2kxtn"]
Sep 19 12:05:09.543647 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:09.543614    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7611d9a8-19e0-403d-b05f-a56e11d4bcb3" path="/var/lib/kubelet/pods/7611d9a8-19e0-403d-b05f-a56e11d4bcb3/volumes"
Sep 19 12:05:09.544022 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:09.544004    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc781bdf-c421-4ae8-add5-3d970e495caf" path="/var/lib/kubelet/pods/dc781bdf-c421-4ae8-add5-3d970e495caf/volumes"
Sep 19 12:05:12.342097 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:12.342017    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:05:24.568361 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:24.568323    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"]
Sep 19 12:05:24.570817 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:24.568610    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc" podUID="5b54b50e-29fc-4b4f-904e-158f524acb56" containerName="payload-processing" containerID="cri-o://f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318" gracePeriod=30
Sep 19 12:05:24.837521 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:24.837462    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 12:05:25.005715 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.005684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b54b50e-29fc-4b4f-904e-158f524acb56-plugins-config-volume\") pod \"5b54b50e-29fc-4b4f-904e-158f524acb56\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") "
Sep 19 12:05:25.005892 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.005803    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzr9m\" (UniqueName: \"kubernetes.io/projected/5b54b50e-29fc-4b4f-904e-158f524acb56-kube-api-access-qzr9m\") pod \"5b54b50e-29fc-4b4f-904e-158f524acb56\" (UID: \"5b54b50e-29fc-4b4f-904e-158f524acb56\") "
Sep 19 12:05:25.006117 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.006092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b54b50e-29fc-4b4f-904e-158f524acb56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b54b50e-29fc-4b4f-904e-158f524acb56" (UID: "5b54b50e-29fc-4b4f-904e-158f524acb56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:05:25.008266 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.008238    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b54b50e-29fc-4b4f-904e-158f524acb56-kube-api-access-qzr9m" (OuterVolumeSpecName: "kube-api-access-qzr9m") pod "5b54b50e-29fc-4b4f-904e-158f524acb56" (UID: "5b54b50e-29fc-4b4f-904e-158f524acb56"). InnerVolumeSpecName "kube-api-access-qzr9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:05:25.107621 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.107543    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzr9m\" (UniqueName: \"kubernetes.io/projected/5b54b50e-29fc-4b4f-904e-158f524acb56-kube-api-access-qzr9m\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:25.107621 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.107573    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b54b50e-29fc-4b4f-904e-158f524acb56-plugins-config-volume\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:25.179345 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.179311    2582 generic.go:356] "Generic (PLEG): container finished" podID="5b54b50e-29fc-4b4f-904e-158f524acb56" containerID="f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318" exitCode=0
Sep 19 12:05:25.179523 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.179369    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"
Sep 19 12:05:25.179523 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.179402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc" event={"ID":"5b54b50e-29fc-4b4f-904e-158f524acb56","Type":"ContainerDied","Data":"f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318"}
Sep 19 12:05:25.179523 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.179458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc" event={"ID":"5b54b50e-29fc-4b4f-904e-158f524acb56","Type":"ContainerDied","Data":"74f7b076ae059031585f7aced7b0989ffa74fe04ca6bbac90a48f34799df92dc"}
Sep 19 12:05:25.179523 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.179482    2582 scope.go:117] "RemoveContainer" containerID="f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318"
Sep 19 12:05:25.188861 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.188842    2582 scope.go:117] "RemoveContainer" containerID="f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318"
Sep 19 12:05:25.189157 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:05:25.189139    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318\": container with ID starting with f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318 not found: ID does not exist" containerID="f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318"
Sep 19 12:05:25.189217 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.189169    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318"} err="failed to get container status \"f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318\": rpc error: code = NotFound desc = could not find container \"f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318\": container with ID starting with f103b86fb2047cd9debb5350d094913561e26c8a7ebb9e16916f4bdc19b76318 not found: ID does not exist"
Sep 19 12:05:25.202484 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.202461    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"]
Sep 19 12:05:25.205940 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.205896    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4a8a59-79688c4bdf-t6clc"]
Sep 19 12:05:25.543186 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:25.543157    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b54b50e-29fc-4b4f-904e-158f524acb56" path="/var/lib/kubelet/pods/5b54b50e-29fc-4b4f-904e-158f524acb56/volumes"
Sep 19 12:05:28.842927 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:28.842868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:05:35.557604 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.557570    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-tddnf"]
Sep 19 12:05:35.558096 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.557800    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b54d84f7b-tddnf" podUID="51fa9b95-30a7-4bd3-9518-f7afd19c318e" containerName="manager" containerID="cri-o://ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0" gracePeriod=30
Sep 19 12:05:35.809581 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.809527    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 12:05:35.902710 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.902683    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert\") pod \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") "
Sep 19 12:05:35.902876 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.902720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-metrics-certs\") pod \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") "
Sep 19 12:05:35.902876 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.902746    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjf46\" (UniqueName: \"kubernetes.io/projected/51fa9b95-30a7-4bd3-9518-f7afd19c318e-kube-api-access-cjf46\") pod \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\" (UID: \"51fa9b95-30a7-4bd3-9518-f7afd19c318e\") "
Sep 19 12:05:35.904684 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.904654    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "51fa9b95-30a7-4bd3-9518-f7afd19c318e" (UID: "51fa9b95-30a7-4bd3-9518-f7afd19c318e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:05:35.904828 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.904804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "51fa9b95-30a7-4bd3-9518-f7afd19c318e" (UID: "51fa9b95-30a7-4bd3-9518-f7afd19c318e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:05:35.904886 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:35.904827    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fa9b95-30a7-4bd3-9518-f7afd19c318e-kube-api-access-cjf46" (OuterVolumeSpecName: "kube-api-access-cjf46") pod "51fa9b95-30a7-4bd3-9518-f7afd19c318e" (UID: "51fa9b95-30a7-4bd3-9518-f7afd19c318e"). InnerVolumeSpecName "kube-api-access-cjf46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:05:36.004124 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.004092    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:36.004124 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.004116    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjf46\" (UniqueName: \"kubernetes.io/projected/51fa9b95-30a7-4bd3-9518-f7afd19c318e-kube-api-access-cjf46\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:36.004124 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.004125    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51fa9b95-30a7-4bd3-9518-f7afd19c318e-webhook-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:05:36.242440 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.242404    2582 generic.go:356] "Generic (PLEG): container finished" podID="51fa9b95-30a7-4bd3-9518-f7afd19c318e" containerID="ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0" exitCode=0
Sep 19 12:05:36.242634 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.242451    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-tddnf"
Sep 19 12:05:36.242634 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.242489    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-tddnf" event={"ID":"51fa9b95-30a7-4bd3-9518-f7afd19c318e","Type":"ContainerDied","Data":"ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0"}
Sep 19 12:05:36.242634 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.242541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-tddnf" event={"ID":"51fa9b95-30a7-4bd3-9518-f7afd19c318e","Type":"ContainerDied","Data":"dd2916ae071c51d9e23809061dc4c2d0764ad0a879fe6608c789fa6a6057565c"}
Sep 19 12:05:36.242634 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.242565    2582 scope.go:117] "RemoveContainer" containerID="ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0"
Sep 19 12:05:36.253102 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.253086    2582 scope.go:117] "RemoveContainer" containerID="ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0"
Sep 19 12:05:36.253359 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:05:36.253338    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0\": container with ID starting with ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0 not found: ID does not exist" containerID="ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0"
Sep 19 12:05:36.253414 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.253368    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0"} err="failed to get container status \"ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0\": rpc error: code = NotFound desc = could not find container \"ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0\": container with ID starting with ee7071514eadd456d3a8e59c4bb30a3fcca2906993710cc9dabaa8765e3aa3f0 not found: ID does not exist"
Sep 19 12:05:36.263546 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.263526    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-tddnf"]
Sep 19 12:05:36.266627 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:36.266608    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-tddnf"]
Sep 19 12:05:37.544331 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:37.544300    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51fa9b95-30a7-4bd3-9518-f7afd19c318e" path="/var/lib/kubelet/pods/51fa9b95-30a7-4bd3-9518-f7afd19c318e/volumes"
Sep 19 12:05:42.238258 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:05:42.238225    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:06:37.075325 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075284    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-m5ksx"]
Sep 19 12:06:37.075851 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075791    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7611d9a8-19e0-403d-b05f-a56e11d4bcb3" containerName="payload-processing"
Sep 19 12:06:37.075851 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075810    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7611d9a8-19e0-403d-b05f-a56e11d4bcb3" containerName="payload-processing"
Sep 19 12:06:37.075851 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075825    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc781bdf-c421-4ae8-add5-3d970e495caf" containerName="maas-api"
Sep 19 12:06:37.075851 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075834    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc781bdf-c421-4ae8-add5-3d970e495caf" containerName="maas-api"
Sep 19 12:06:37.075851 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075844    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b54b50e-29fc-4b4f-904e-158f524acb56" containerName="payload-processing"
Sep 19 12:06:37.075851 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075853    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b54b50e-29fc-4b4f-904e-158f524acb56" containerName="payload-processing"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075878    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51fa9b95-30a7-4bd3-9518-f7afd19c318e" containerName="manager"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075886    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="51fa9b95-30a7-4bd3-9518-f7afd19c318e" containerName="manager"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075902    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a6a94fe-ee6a-4889-93f4-32b093f96870" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075910    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6a94fe-ee6a-4889-93f4-32b093f96870" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075946    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075954    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075969    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc1c651-0c7f-4d86-a1cb-8b6063440bd6" containerName="payload-processing"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.075977    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc1c651-0c7f-4d86-a1cb-8b6063440bd6" containerName="payload-processing"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076070    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7611d9a8-19e0-403d-b05f-a56e11d4bcb3" containerName="payload-processing"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076083    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a6a94fe-ee6a-4889-93f4-32b093f96870" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076092    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc781bdf-c421-4ae8-add5-3d970e495caf" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076101    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e66c6f-5bca-4799-a5e0-8058d1ce0b3d" containerName="maas-api"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076110    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b54b50e-29fc-4b4f-904e-158f524acb56" containerName="payload-processing"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076121    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="51fa9b95-30a7-4bd3-9518-f7afd19c318e" containerName="manager"
Sep 19 12:06:37.076202 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.076130    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc1c651-0c7f-4d86-a1cb-8b6063440bd6" containerName="payload-processing"
Sep 19 12:06:37.079421 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.079399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.082770 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.082745    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d96l2\""
Sep 19 12:06:37.082900 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.082883    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 12:06:37.082989 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.082884    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 12:06:37.083047 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.082883    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 12:06:37.088724 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.088700    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-m5ksx"]
Sep 19 12:06:37.173566 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.173539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-metrics-certs\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.173566 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.173569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blkpp\" (UniqueName: \"kubernetes.io/projected/74324792-c582-4aa3-9bcd-ea66a3e0032f-kube-api-access-blkpp\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.173746 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.173621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-webhook-cert\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.274126 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.274092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-metrics-certs\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.274280 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.274132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blkpp\" (UniqueName: \"kubernetes.io/projected/74324792-c582-4aa3-9bcd-ea66a3e0032f-kube-api-access-blkpp\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.274280 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.274195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-webhook-cert\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.276717 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.276681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-metrics-certs\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.276874 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.276691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-webhook-cert\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.281219 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.281194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blkpp\" (UniqueName: \"kubernetes.io/projected/74324792-c582-4aa3-9bcd-ea66a3e0032f-kube-api-access-blkpp\") pod \"maas-controller-6b54d84f7b-m5ksx\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") " pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.390122 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.390036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:37.657106 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:37.657080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-m5ksx"]
Sep 19 12:06:37.659077 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:06:37.659045    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74324792_c582_4aa3_9bcd_ea66a3e0032f.slice/crio-876f6c4e6ae3c606371a2bfd5ddbd5b050785c4237e2b3d019e87f88a9eff3b3 WatchSource:0}: Error finding container 876f6c4e6ae3c606371a2bfd5ddbd5b050785c4237e2b3d019e87f88a9eff3b3: Status 404 returned error can't find the container with id 876f6c4e6ae3c606371a2bfd5ddbd5b050785c4237e2b3d019e87f88a9eff3b3
Sep 19 12:06:38.566510 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:38.566415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx" event={"ID":"74324792-c582-4aa3-9bcd-ea66a3e0032f","Type":"ContainerStarted","Data":"9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912"}
Sep 19 12:06:38.566510 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:38.566466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx" event={"ID":"74324792-c582-4aa3-9bcd-ea66a3e0032f","Type":"ContainerStarted","Data":"876f6c4e6ae3c606371a2bfd5ddbd5b050785c4237e2b3d019e87f88a9eff3b3"}
Sep 19 12:06:38.566510 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:38.566494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:38.584152 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:38.584102    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx" podStartSLOduration=0.945422695 podStartE2EDuration="1.584087692s" totalImagesPullingTime="638.664997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:06:38.581555899 +0000 UTC m=+1969.598592612" watchObservedRunningTime="2026-09-19 12:06:38.584087692 +0000 UTC m=+1969.601124404"
Sep 19 12:06:49.572529 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:49.572454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:58.886057 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:58.886013    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-m5ksx"]
Sep 19 12:06:58.886617 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:58.886278    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx" podUID="74324792-c582-4aa3-9bcd-ea66a3e0032f" containerName="manager" containerID="cri-o://9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912" gracePeriod=30
Sep 19 12:06:58.940959 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:58.940927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:06:59.133241 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.133214    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:59.167038 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.166967    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-metrics-certs\") pod \"74324792-c582-4aa3-9bcd-ea66a3e0032f\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") "
Sep 19 12:06:59.167038 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.167023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blkpp\" (UniqueName: \"kubernetes.io/projected/74324792-c582-4aa3-9bcd-ea66a3e0032f-kube-api-access-blkpp\") pod \"74324792-c582-4aa3-9bcd-ea66a3e0032f\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") "
Sep 19 12:06:59.167248 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.167118    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-webhook-cert\") pod \"74324792-c582-4aa3-9bcd-ea66a3e0032f\" (UID: \"74324792-c582-4aa3-9bcd-ea66a3e0032f\") "
Sep 19 12:06:59.169563 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.169531    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74324792-c582-4aa3-9bcd-ea66a3e0032f-kube-api-access-blkpp" (OuterVolumeSpecName: "kube-api-access-blkpp") pod "74324792-c582-4aa3-9bcd-ea66a3e0032f" (UID: "74324792-c582-4aa3-9bcd-ea66a3e0032f"). InnerVolumeSpecName "kube-api-access-blkpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:06:59.169674 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.169583    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "74324792-c582-4aa3-9bcd-ea66a3e0032f" (UID: "74324792-c582-4aa3-9bcd-ea66a3e0032f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:06:59.169674 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.169620    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "74324792-c582-4aa3-9bcd-ea66a3e0032f" (UID: "74324792-c582-4aa3-9bcd-ea66a3e0032f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:06:59.268804 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.268773    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-webhook-cert\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:06:59.268804 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.268797    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74324792-c582-4aa3-9bcd-ea66a3e0032f-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:06:59.268804 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.268807    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blkpp\" (UniqueName: \"kubernetes.io/projected/74324792-c582-4aa3-9bcd-ea66a3e0032f-kube-api-access-blkpp\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:06:59.667318 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.667278    2582 generic.go:356] "Generic (PLEG): container finished" podID="74324792-c582-4aa3-9bcd-ea66a3e0032f" containerID="9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912" exitCode=0
Sep 19 12:06:59.667497 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.667323    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx"
Sep 19 12:06:59.667497 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.667343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx" event={"ID":"74324792-c582-4aa3-9bcd-ea66a3e0032f","Type":"ContainerDied","Data":"9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912"}
Sep 19 12:06:59.667497 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.667395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-m5ksx" event={"ID":"74324792-c582-4aa3-9bcd-ea66a3e0032f","Type":"ContainerDied","Data":"876f6c4e6ae3c606371a2bfd5ddbd5b050785c4237e2b3d019e87f88a9eff3b3"}
Sep 19 12:06:59.667497 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.667426    2582 scope.go:117] "RemoveContainer" containerID="9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912"
Sep 19 12:06:59.678070 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.678042    2582 scope.go:117] "RemoveContainer" containerID="9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912"
Sep 19 12:06:59.678357 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:06:59.678337    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912\": container with ID starting with 9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912 not found: ID does not exist" containerID="9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912"
Sep 19 12:06:59.678442 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.678368    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912"} err="failed to get container status \"9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912\": rpc error: code = NotFound desc = could not find container \"9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912\": container with ID starting with 9bd043c2bc656e9cabff8190ef2c9e8d1e420cce3b60c2e4ed6031b8143a2912 not found: ID does not exist"
Sep 19 12:06:59.685376 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.685345    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-m5ksx"]
Sep 19 12:06:59.688682 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:06:59.688654    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-m5ksx"]
Sep 19 12:07:00.678609 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.678577    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-nr947"]
Sep 19 12:07:00.679114 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.679098    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74324792-c582-4aa3-9bcd-ea66a3e0032f" containerName="manager"
Sep 19 12:07:00.679166 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.679118    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74324792-c582-4aa3-9bcd-ea66a3e0032f" containerName="manager"
Sep 19 12:07:00.679233 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.679221    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74324792-c582-4aa3-9bcd-ea66a3e0032f" containerName="manager"
Sep 19 12:07:00.683718 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.683694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.686030 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.686010    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 12:07:00.687334 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.687312    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d96l2\""
Sep 19 12:07:00.687491 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.687361    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 12:07:00.687491 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.687361    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 12:07:00.690451 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.690431    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-nr947"]
Sep 19 12:07:00.782080 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.782040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpn98\" (UniqueName: \"kubernetes.io/projected/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-kube-api-access-jpn98\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.782080 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.782085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-metrics-certs\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.782252 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.782197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-webhook-cert\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.883278 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.883251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-webhook-cert\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.883418 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.883313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpn98\" (UniqueName: \"kubernetes.io/projected/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-kube-api-access-jpn98\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.883418 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.883335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-metrics-certs\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.885793 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.885764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-webhook-cert\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.885793 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.885784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-metrics-certs\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.891316 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.891299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpn98\" (UniqueName: \"kubernetes.io/projected/ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d-kube-api-access-jpn98\") pod \"maas-controller-6b54d84f7b-nr947\" (UID: \"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d\") " pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:00.996512 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:00.996467    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:01.266205 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:01.266179    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b54d84f7b-nr947"]
Sep 19 12:07:01.268293 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:07:01.268265    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4ec0a3_59bc_48c3_a66d_bb0e8c17368d.slice/crio-a19568415a5dfde17d5032c3a324cbb5e7eccd972cd47d03ca4e81b6885ca9a6 WatchSource:0}: Error finding container a19568415a5dfde17d5032c3a324cbb5e7eccd972cd47d03ca4e81b6885ca9a6: Status 404 returned error can't find the container with id a19568415a5dfde17d5032c3a324cbb5e7eccd972cd47d03ca4e81b6885ca9a6
Sep 19 12:07:01.543303 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:01.543219    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74324792-c582-4aa3-9bcd-ea66a3e0032f" path="/var/lib/kubelet/pods/74324792-c582-4aa3-9bcd-ea66a3e0032f/volumes"
Sep 19 12:07:01.681644 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:01.681611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-nr947" event={"ID":"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d","Type":"ContainerStarted","Data":"64b59663682f66140524a32f803ff4ba44a4d3183250b16592d050ecec429a6a"}
Sep 19 12:07:01.681998 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:01.681678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b54d84f7b-nr947" event={"ID":"ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d","Type":"ContainerStarted","Data":"a19568415a5dfde17d5032c3a324cbb5e7eccd972cd47d03ca4e81b6885ca9a6"}
Sep 19 12:07:01.681998 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:01.681710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:01.698230 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:01.698187    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b54d84f7b-nr947" podStartSLOduration=1.353249646 podStartE2EDuration="1.698172057s" totalImagesPullingTime="344.922411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:07:01.696044802 +0000 UTC m=+1992.713081528" watchObservedRunningTime="2026-09-19 12:07:01.698172057 +0000 UTC m=+1992.715208768"
Sep 19 12:07:12.688550 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:12.688516    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b54d84f7b-nr947"
Sep 19 12:07:49.749133 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:07:49.749094    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:08:02.639537 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:08:02.639498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:08:14.542655 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:08:14.542563    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:08:24.550984 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:08:24.550944    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:08:50.641440 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:08:50.641402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:09:03.551736 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:09:03.551702    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:10:29.436440 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:10:29.436404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:10:42.652426 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:10:42.652382    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:10:55.338623 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:10:55.338589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:11:08.840758 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:08.840714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:11:16.039005 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.038902    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"]
Sep 19 12:11:16.042805 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.042784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.045117 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.045096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-3f116f14-kserve-self-signed-certs\""
Sep 19 12:11:16.052114 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.052083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"]
Sep 19 12:11:16.158598 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.158562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdbmb\" (UniqueName: \"kubernetes.io/projected/a091d7b0-7e01-435a-b44d-34c103fffd26-kube-api-access-vdbmb\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.158790 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.158624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-dshm\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.158790 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.158650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a091d7b0-7e01-435a-b44d-34c103fffd26-tls-certs\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.158790 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.158681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-model-cache\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.158790 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.158751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-tmp-dir\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.159020 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.158884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-home\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.259658 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.259626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-dshm\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.259658 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.259662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a091d7b0-7e01-435a-b44d-34c103fffd26-tls-certs\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.259879 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.259693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-model-cache\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.259879 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.259726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-tmp-dir\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.259879 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.259834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-home\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.259879 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.259870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdbmb\" (UniqueName: \"kubernetes.io/projected/a091d7b0-7e01-435a-b44d-34c103fffd26-kube-api-access-vdbmb\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.260164 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.260140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-model-cache\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.260225 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.260205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-tmp-dir\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.260280 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.260232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-home\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.262011 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.261985    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-dshm\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.262264 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.262248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a091d7b0-7e01-435a-b44d-34c103fffd26-tls-certs\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.266898 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.266878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdbmb\" (UniqueName: \"kubernetes.io/projected/a091d7b0-7e01-435a-b44d-34c103fffd26-kube-api-access-vdbmb\") pod \"e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") " pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.352978 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.352884    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:16.637059 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.633360    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"]
Sep 19 12:11:16.965537 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.965448    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x" event={"ID":"a091d7b0-7e01-435a-b44d-34c103fffd26","Type":"ContainerStarted","Data":"213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e"}
Sep 19 12:11:16.965537 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.965503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x" event={"ID":"a091d7b0-7e01-435a-b44d-34c103fffd26","Type":"ContainerStarted","Data":"14c6674a98b66db23f9d0c3d10f60da2ee890af79b07f45163dc0df9fe8165ac"}
Sep 19 12:11:16.982500 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:16.982456    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x" podStartSLOduration=0.982442049 podStartE2EDuration="982.442049ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:11:16.981211404 +0000 UTC m=+2247.998248115" watchObservedRunningTime="2026-09-19 12:11:16.982442049 +0000 UTC m=+2247.999478760"
Sep 19 12:11:17.353841 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:17.353801    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:22.143624 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:22.143587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:11:26.353878 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:26.353841    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:26.366400 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:26.366379    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:27.027225 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:27.027196    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:31.067930 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:31.067875    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"]
Sep 19 12:11:35.234963 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:35.234904    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:11:46.096056 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.096006    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x" podUID="a091d7b0-7e01-435a-b44d-34c103fffd26" containerName="main" containerID="cri-o://213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e" gracePeriod=45
Sep 19 12:11:46.338026 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.338002    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:46.445809 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.445720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdbmb\" (UniqueName: \"kubernetes.io/projected/a091d7b0-7e01-435a-b44d-34c103fffd26-kube-api-access-vdbmb\") pod \"a091d7b0-7e01-435a-b44d-34c103fffd26\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") "
Sep 19 12:11:46.445809 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.445767    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-tmp-dir\") pod \"a091d7b0-7e01-435a-b44d-34c103fffd26\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") "
Sep 19 12:11:46.445809 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.445788    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a091d7b0-7e01-435a-b44d-34c103fffd26-tls-certs\") pod \"a091d7b0-7e01-435a-b44d-34c103fffd26\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") "
Sep 19 12:11:46.445809 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.445802    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-home\") pod \"a091d7b0-7e01-435a-b44d-34c103fffd26\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") "
Sep 19 12:11:46.446171 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.445881    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-model-cache\") pod \"a091d7b0-7e01-435a-b44d-34c103fffd26\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") "
Sep 19 12:11:46.446171 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.445960    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-dshm\") pod \"a091d7b0-7e01-435a-b44d-34c103fffd26\" (UID: \"a091d7b0-7e01-435a-b44d-34c103fffd26\") "
Sep 19 12:11:46.446171 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.446084    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a091d7b0-7e01-435a-b44d-34c103fffd26" (UID: "a091d7b0-7e01-435a-b44d-34c103fffd26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 12:11:46.446171 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.446099    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-home" (OuterVolumeSpecName: "home") pod "a091d7b0-7e01-435a-b44d-34c103fffd26" (UID: "a091d7b0-7e01-435a-b44d-34c103fffd26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 12:11:46.446371 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.446193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-model-cache" (OuterVolumeSpecName: "model-cache") pod "a091d7b0-7e01-435a-b44d-34c103fffd26" (UID: "a091d7b0-7e01-435a-b44d-34c103fffd26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 12:11:46.446371 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.446329    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-model-cache\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:11:46.446371 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.446350    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-tmp-dir\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:11:46.446371 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.446362    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-home\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:11:46.454988 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.454959    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-dshm" (OuterVolumeSpecName: "dshm") pod "a091d7b0-7e01-435a-b44d-34c103fffd26" (UID: "a091d7b0-7e01-435a-b44d-34c103fffd26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 12:11:46.455120 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.454987    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a091d7b0-7e01-435a-b44d-34c103fffd26-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a091d7b0-7e01-435a-b44d-34c103fffd26" (UID: "a091d7b0-7e01-435a-b44d-34c103fffd26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:11:46.455120 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.455027    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a091d7b0-7e01-435a-b44d-34c103fffd26-kube-api-access-vdbmb" (OuterVolumeSpecName: "kube-api-access-vdbmb") pod "a091d7b0-7e01-435a-b44d-34c103fffd26" (UID: "a091d7b0-7e01-435a-b44d-34c103fffd26"). InnerVolumeSpecName "kube-api-access-vdbmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:11:46.546823 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.546793    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a091d7b0-7e01-435a-b44d-34c103fffd26-dshm\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:11:46.546823 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.546820    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdbmb\" (UniqueName: \"kubernetes.io/projected/a091d7b0-7e01-435a-b44d-34c103fffd26-kube-api-access-vdbmb\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:11:46.547030 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:46.546833    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a091d7b0-7e01-435a-b44d-34c103fffd26-tls-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:11:47.116500 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.116465    2582 generic.go:356] "Generic (PLEG): container finished" podID="a091d7b0-7e01-435a-b44d-34c103fffd26" containerID="213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e" exitCode=0
Sep 19 12:11:47.116500 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.116501    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"
Sep 19 12:11:47.117040 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.116537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x" event={"ID":"a091d7b0-7e01-435a-b44d-34c103fffd26","Type":"ContainerDied","Data":"213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e"}
Sep 19 12:11:47.117040 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.116574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x" event={"ID":"a091d7b0-7e01-435a-b44d-34c103fffd26","Type":"ContainerDied","Data":"14c6674a98b66db23f9d0c3d10f60da2ee890af79b07f45163dc0df9fe8165ac"}
Sep 19 12:11:47.117040 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.116591    2582 scope.go:117] "RemoveContainer" containerID="213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e"
Sep 19 12:11:47.126047 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.126030    2582 scope.go:117] "RemoveContainer" containerID="213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e"
Sep 19 12:11:47.126298 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:11:47.126282    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e\": container with ID starting with 213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e not found: ID does not exist" containerID="213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e"
Sep 19 12:11:47.126358 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.126305    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e"} err="failed to get container status \"213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e\": rpc error: code = NotFound desc = could not find container \"213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e\": container with ID starting with 213ecde0f6593c6b3a32449e479bf52919d924e20605cec6b425bcde204f0a7e not found: ID does not exist"
Sep 19 12:11:47.137393 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.137373    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"]
Sep 19 12:11:47.140865 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.140843    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-3f116f14-kserve-5bdcbd65cb-tjh9x"]
Sep 19 12:11:47.544248 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:47.544214    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a091d7b0-7e01-435a-b44d-34c103fffd26" path="/var/lib/kubelet/pods/a091d7b0-7e01-435a-b44d-34c103fffd26/volumes"
Sep 19 12:11:49.740333 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:49.740292    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:11:59.845038 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:11:59.845005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:12:06.646199 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.646146    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"]
Sep 19 12:12:06.646722 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.646703    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a091d7b0-7e01-435a-b44d-34c103fffd26" containerName="main"
Sep 19 12:12:06.646775 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.646727    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a091d7b0-7e01-435a-b44d-34c103fffd26" containerName="main"
Sep 19 12:12:06.646862 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.646850    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a091d7b0-7e01-435a-b44d-34c103fffd26" containerName="main"
Sep 19 12:12:06.650362 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.650345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.658391 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.658371    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"]
Sep 19 12:12:06.738164 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.738130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f482684d-f02e-4f23-b77c-e6df29d7ec78-metrics-certs\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.738323 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.738187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f482684d-f02e-4f23-b77c-e6df29d7ec78-maas-api-tls\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.738323 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.738210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfjg\" (UniqueName: \"kubernetes.io/projected/f482684d-f02e-4f23-b77c-e6df29d7ec78-kube-api-access-4kfjg\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.738323 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.738264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f482684d-f02e-4f23-b77c-e6df29d7ec78-openshift-service-ca\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.839473 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.839442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f482684d-f02e-4f23-b77c-e6df29d7ec78-metrics-certs\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.839625 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.839531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f482684d-f02e-4f23-b77c-e6df29d7ec78-maas-api-tls\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.839625 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.839557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfjg\" (UniqueName: \"kubernetes.io/projected/f482684d-f02e-4f23-b77c-e6df29d7ec78-kube-api-access-4kfjg\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.839625 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.839587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f482684d-f02e-4f23-b77c-e6df29d7ec78-openshift-service-ca\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.840373 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.840350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f482684d-f02e-4f23-b77c-e6df29d7ec78-openshift-service-ca\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.841818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.841790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f482684d-f02e-4f23-b77c-e6df29d7ec78-metrics-certs\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.841818 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.841807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f482684d-f02e-4f23-b77c-e6df29d7ec78-maas-api-tls\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.847367 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.847342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfjg\" (UniqueName: \"kubernetes.io/projected/f482684d-f02e-4f23-b77c-e6df29d7ec78-kube-api-access-4kfjg\") pod \"maas-api-7bd8599656-bw7t4\" (UID: \"f482684d-f02e-4f23-b77c-e6df29d7ec78\") " pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:06.961474 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:06.961376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:07.229835 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:07.229813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"]
Sep 19 12:12:07.232157 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:12:07.232118    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf482684d_f02e_4f23_b77c_e6df29d7ec78.slice/crio-379741c532de7c67a0c30f4b9b91f568803577eda56731b87a52bad82ddb178c WatchSource:0}: Error finding container 379741c532de7c67a0c30f4b9b91f568803577eda56731b87a52bad82ddb178c: Status 404 returned error can't find the container with id 379741c532de7c67a0c30f4b9b91f568803577eda56731b87a52bad82ddb178c
Sep 19 12:12:07.233485 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:07.233463    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 12:12:07.894503 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:07.894429    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:12:08.224338 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:08.224253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4" event={"ID":"f482684d-f02e-4f23-b77c-e6df29d7ec78","Type":"ContainerStarted","Data":"900f4c0f3de701a054f6107361883346b8d8d84877b1d3267ab9f0cd387c9646"}
Sep 19 12:12:08.224338 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:08.224309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4" event={"ID":"f482684d-f02e-4f23-b77c-e6df29d7ec78","Type":"ContainerStarted","Data":"379741c532de7c67a0c30f4b9b91f568803577eda56731b87a52bad82ddb178c"}
Sep 19 12:12:08.224338 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:08.224337    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:08.242786 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:08.242739    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4" podStartSLOduration=1.834159603 podStartE2EDuration="2.242724534s" totalImagesPullingTime="408.564931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:12:08.239976175 +0000 UTC m=+2299.257012883" watchObservedRunningTime="2026-09-19 12:12:08.242724534 +0000 UTC m=+2299.259761245"
Sep 19 12:12:14.235693 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:14.235662    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7bd8599656-bw7t4"
Sep 19 12:12:14.280086 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:14.280055    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6649958464-bn9m5"]
Sep 19 12:12:14.280285 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:14.280259    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5" podUID="41e6c4b1-c7d3-4869-a7e5-012004cd047d" containerName="maas-api" containerID="cri-o://36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520" gracePeriod=30
Sep 19 12:12:15.530082 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.530056    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 12:12:15.725069 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.724987    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-maas-api-tls\") pod \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") "
Sep 19 12:12:15.725069 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.725048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41e6c4b1-c7d3-4869-a7e5-012004cd047d-openshift-service-ca\") pod \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") "
Sep 19 12:12:15.725293 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.725081    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-metrics-certs\") pod \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") "
Sep 19 12:12:15.725293 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.725120    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksn54\" (UniqueName: \"kubernetes.io/projected/41e6c4b1-c7d3-4869-a7e5-012004cd047d-kube-api-access-ksn54\") pod \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\" (UID: \"41e6c4b1-c7d3-4869-a7e5-012004cd047d\") "
Sep 19 12:12:15.725462 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.725419    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e6c4b1-c7d3-4869-a7e5-012004cd047d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41e6c4b1-c7d3-4869-a7e5-012004cd047d" (UID: "41e6c4b1-c7d3-4869-a7e5-012004cd047d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 12:12:15.725588 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.725567    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41e6c4b1-c7d3-4869-a7e5-012004cd047d-openshift-service-ca\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:12:15.727275 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.727243    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e6c4b1-c7d3-4869-a7e5-012004cd047d-kube-api-access-ksn54" (OuterVolumeSpecName: "kube-api-access-ksn54") pod "41e6c4b1-c7d3-4869-a7e5-012004cd047d" (UID: "41e6c4b1-c7d3-4869-a7e5-012004cd047d"). InnerVolumeSpecName "kube-api-access-ksn54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 12:12:15.727379 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.727358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41e6c4b1-c7d3-4869-a7e5-012004cd047d" (UID: "41e6c4b1-c7d3-4869-a7e5-012004cd047d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:12:15.727424 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.727398    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "41e6c4b1-c7d3-4869-a7e5-012004cd047d" (UID: "41e6c4b1-c7d3-4869-a7e5-012004cd047d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 12:12:15.826494 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.826461    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-metrics-certs\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:12:15.826494 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.826490    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksn54\" (UniqueName: \"kubernetes.io/projected/41e6c4b1-c7d3-4869-a7e5-012004cd047d-kube-api-access-ksn54\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:12:15.826494 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:15.826499    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41e6c4b1-c7d3-4869-a7e5-012004cd047d-maas-api-tls\") on node \"ip-10-0-133-160.ec2.internal\" DevicePath \"\""
Sep 19 12:12:16.270021 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.269982    2582 generic.go:356] "Generic (PLEG): container finished" podID="41e6c4b1-c7d3-4869-a7e5-012004cd047d" containerID="36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520" exitCode=0
Sep 19 12:12:16.270212 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.270028    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5"
Sep 19 12:12:16.270212 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.270069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5" event={"ID":"41e6c4b1-c7d3-4869-a7e5-012004cd047d","Type":"ContainerDied","Data":"36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520"}
Sep 19 12:12:16.270212 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.270128    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6649958464-bn9m5" event={"ID":"41e6c4b1-c7d3-4869-a7e5-012004cd047d","Type":"ContainerDied","Data":"b1efb732985758e2959daa8542e41770572c26ab72def4cff8603380c7c501fa"}
Sep 19 12:12:16.270212 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.270154    2582 scope.go:117] "RemoveContainer" containerID="36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520"
Sep 19 12:12:16.279603 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.279585    2582 scope.go:117] "RemoveContainer" containerID="36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520"
Sep 19 12:12:16.279895 ip-10-0-133-160 kubenswrapper[2582]: E0919 12:12:16.279877    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520\": container with ID starting with 36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520 not found: ID does not exist" containerID="36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520"
Sep 19 12:12:16.279983 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.279904    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520"} err="failed to get container status \"36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520\": rpc error: code = NotFound desc = could not find container \"36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520\": container with ID starting with 36c032cf1e87a52a92560a9ae0f669f73b03efb7f0f02a91b0b886186d940520 not found: ID does not exist"
Sep 19 12:12:16.290828 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.290803    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6649958464-bn9m5"]
Sep 19 12:12:16.294585 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:16.294563    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6649958464-bn9m5"]
Sep 19 12:12:17.543553 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:17.543516    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41e6c4b1-c7d3-4869-a7e5-012004cd047d" path="/var/lib/kubelet/pods/41e6c4b1-c7d3-4869-a7e5-012004cd047d/volumes"
Sep 19 12:12:19.048190 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:19.048152    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:12:30.741375 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:30.741338    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:12:41.147565 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:41.147525    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-k4jdg"]
Sep 19 12:12:42.914806 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:42.914711    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-694b4547c-rljvc_c374c840-4955-4650-9df9-ede24d121ae8/authorino/0.log"
Sep 19 12:12:48.452767 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:48.452736    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b54d84f7b-nr947_ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d/manager/0.log"
Sep 19 12:12:48.676463 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:48.676434    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-25hvd_cc9fd22c-721e-438a-9fe4-a0bf23de72db/manager/0.log"
Sep 19 12:12:49.016255 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:49.016222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7bd8599656-bw7t4_f482684d-f02e-4f23-b77c-e6df29d7ec78/maas-api/0.log"
Sep 19 12:12:50.221425 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:50.221346    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-694b4547c-rljvc_c374c840-4955-4650-9df9-ede24d121ae8/authorino/0.log"
Sep 19 12:12:50.328397 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:50.328367    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-pqfwr_b08968df-a4e6-4af3-82ba-63e3b0872f62/manager/0.log"
Sep 19 12:12:50.786116 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:50.786088    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-k4jdg_9023baaf-18f7-49ac-85d3-e5be4ac26e06/limitador/0.log"
Sep 19 12:12:51.261629 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:51.261578    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9_01a643c1-e9d2-421b-8643-4fbb929de704/istio-proxy/0.log"
Sep 19 12:12:51.496824 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:51.496791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864788f75f-l7bzp_85deca22-dc4b-471d-92c1-61750fca07ac/kube-auth-proxy/0.log"
Sep 19 12:12:51.727991 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:51.727864    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/1.log"
Sep 19 12:12:51.841799 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:51.841769    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h_a847a4ee-b18e-4756-a13f-68a562d26842/istio-proxy/0.log"
Sep 19 12:12:52.560819 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:52.560781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-5fc5ddd44f-hk5f4_c248ef2d-da7a-4774-aa44-2a485355832b/main/0.log"
Sep 19 12:12:53.133467 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:53.133433    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-6dtxd_9e3bb4da-6dde-498f-9647-c2def272b6ef/main/0.log"
Sep 19 12:12:53.246110 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:53.246080    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-lzb4q_f25ac8c7-2946-4403-930e-46bd81317799/main/0.log"
Sep 19 12:12:58.461718 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.461677    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fgjdw/must-gather-xrmts"]
Sep 19 12:12:58.462255 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.462236    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e6c4b1-c7d3-4869-a7e5-012004cd047d" containerName="maas-api"
Sep 19 12:12:58.462338 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.462261    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e6c4b1-c7d3-4869-a7e5-012004cd047d" containerName="maas-api"
Sep 19 12:12:58.462397 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.462346    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41e6c4b1-c7d3-4869-a7e5-012004cd047d" containerName="maas-api"
Sep 19 12:12:58.465326 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.465304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.467587 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.467565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fgjdw\"/\"default-dockercfg-6b6xz\""
Sep 19 12:12:58.467788 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.467774    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fgjdw\"/\"openshift-service-ca.crt\""
Sep 19 12:12:58.468084 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.468068    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fgjdw\"/\"kube-root-ca.crt\""
Sep 19 12:12:58.477475 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.477450    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgjdw/must-gather-xrmts"]
Sep 19 12:12:58.618430 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.618394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dbcfc72-75c6-48b7-811f-8f48b69e8432-must-gather-output\") pod \"must-gather-xrmts\" (UID: \"2dbcfc72-75c6-48b7-811f-8f48b69e8432\") " pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.618595 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.618462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6khf\" (UniqueName: \"kubernetes.io/projected/2dbcfc72-75c6-48b7-811f-8f48b69e8432-kube-api-access-l6khf\") pod \"must-gather-xrmts\" (UID: \"2dbcfc72-75c6-48b7-811f-8f48b69e8432\") " pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.719830 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.719757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dbcfc72-75c6-48b7-811f-8f48b69e8432-must-gather-output\") pod \"must-gather-xrmts\" (UID: \"2dbcfc72-75c6-48b7-811f-8f48b69e8432\") " pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.719830 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.719811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6khf\" (UniqueName: \"kubernetes.io/projected/2dbcfc72-75c6-48b7-811f-8f48b69e8432-kube-api-access-l6khf\") pod \"must-gather-xrmts\" (UID: \"2dbcfc72-75c6-48b7-811f-8f48b69e8432\") " pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.720169 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.720150    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dbcfc72-75c6-48b7-811f-8f48b69e8432-must-gather-output\") pod \"must-gather-xrmts\" (UID: \"2dbcfc72-75c6-48b7-811f-8f48b69e8432\") " pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.728047 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.728030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6khf\" (UniqueName: \"kubernetes.io/projected/2dbcfc72-75c6-48b7-811f-8f48b69e8432-kube-api-access-l6khf\") pod \"must-gather-xrmts\" (UID: \"2dbcfc72-75c6-48b7-811f-8f48b69e8432\") " pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:58.774020 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:58.773987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgjdw/must-gather-xrmts"
Sep 19 12:12:59.041448 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:59.041424    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgjdw/must-gather-xrmts"]
Sep 19 12:12:59.043106 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:12:59.043075    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dbcfc72_75c6_48b7_811f_8f48b69e8432.slice/crio-94dc85bf18201ca28a323c9480dd1cb6ae2870e9c5480958a2b923a0af3e03c9 WatchSource:0}: Error finding container 94dc85bf18201ca28a323c9480dd1cb6ae2870e9c5480958a2b923a0af3e03c9: Status 404 returned error can't find the container with id 94dc85bf18201ca28a323c9480dd1cb6ae2870e9c5480958a2b923a0af3e03c9
Sep 19 12:12:59.495017 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:12:59.494987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgjdw/must-gather-xrmts" event={"ID":"2dbcfc72-75c6-48b7-811f-8f48b69e8432","Type":"ContainerStarted","Data":"94dc85bf18201ca28a323c9480dd1cb6ae2870e9c5480958a2b923a0af3e03c9"}
Sep 19 12:13:00.507231 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:00.507189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgjdw/must-gather-xrmts" event={"ID":"2dbcfc72-75c6-48b7-811f-8f48b69e8432","Type":"ContainerStarted","Data":"b927589826c8ba20adb907cd1c21b7e784e313622c1f72d23049cc6935e728c3"}
Sep 19 12:13:00.507726 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:00.507267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgjdw/must-gather-xrmts" event={"ID":"2dbcfc72-75c6-48b7-811f-8f48b69e8432","Type":"ContainerStarted","Data":"0caec938bd76bd5291d2e3ec64cf496e7c6f1f83c46068b54fc9583e2c7edf4d"}
Sep 19 12:13:00.524895 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:00.524829    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fgjdw/must-gather-xrmts" podStartSLOduration=1.790749795 podStartE2EDuration="2.524807793s" totalImagesPullingTime="734.057998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 12:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:13:00.522619396 +0000 UTC m=+2351.539656108" watchObservedRunningTime="2026-09-19 12:13:00.524807793 +0000 UTC m=+2351.541844504"
Sep 19 12:13:01.295850 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:01.295811    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9j4hc_3fd294aa-feef-4364-9715-5127ec92db9f/global-pull-secret-syncer/0.log"
Sep 19 12:13:01.497819 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:01.497778    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xncc9_3ab69a4a-d1e7-4bbd-9916-3ad4351aa6a3/konnectivity-agent/0.log"
Sep 19 12:13:01.520738 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:01.520678    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-160.ec2.internal_c7b7a7384449df783f830280a3100b44/haproxy/0.log"
Sep 19 12:13:06.797955 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:06.797063    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-694b4547c-rljvc_c374c840-4955-4650-9df9-ede24d121ae8/authorino/0.log"
Sep 19 12:13:06.823660 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:06.823088    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-pqfwr_b08968df-a4e6-4af3-82ba-63e3b0872f62/manager/0.log"
Sep 19 12:13:06.979184 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:06.979146    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-k4jdg_9023baaf-18f7-49ac-85d3-e5be4ac26e06/limitador/0.log"
Sep 19 12:13:08.624589 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:08.624565    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-2j9v2_e81463f6-cfc7-4a8b-ac19-da3840fe3353/monitoring-plugin/0.log"
Sep 19 12:13:08.747547 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:08.747510    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cvsl8_c3a8e519-a4f9-4cc6-bd7f-61c600f8be53/node-exporter/0.log"
Sep 19 12:13:08.774324 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:08.774296    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cvsl8_c3a8e519-a4f9-4cc6-bd7f-61c600f8be53/kube-rbac-proxy/0.log"
Sep 19 12:13:08.793392 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:08.793357    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cvsl8_c3a8e519-a4f9-4cc6-bd7f-61c600f8be53/init-textfile/0.log"
Sep 19 12:13:09.007669 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.007591    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/prometheus/0.log"
Sep 19 12:13:09.032227 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.032201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/config-reloader/0.log"
Sep 19 12:13:09.059954 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.059907    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/thanos-sidecar/0.log"
Sep 19 12:13:09.086462 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.086435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/kube-rbac-proxy-web/0.log"
Sep 19 12:13:09.115682 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.115653    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/kube-rbac-proxy/0.log"
Sep 19 12:13:09.141048 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.141016    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/kube-rbac-proxy-thanos/0.log"
Sep 19 12:13:09.179816 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:09.179789    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e90e50c8-4307-486d-a2c8-335f2306c45b/init-config-reloader/0.log"
Sep 19 12:13:11.260433 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.260384    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"]
Sep 19 12:13:11.265962 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.265937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.274715 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.274687    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"]
Sep 19 12:13:11.375319 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.375275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-lib-modules\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.375522 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.375330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv4nt\" (UniqueName: \"kubernetes.io/projected/a6314ca5-4081-47d3-9adc-e6ebc8331253-kube-api-access-xv4nt\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.375522 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.375431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-sys\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.375653 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.375543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-proc\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.375653 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.375598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-podres\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477057 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-proc\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477057 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-podres\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477316 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-lib-modules\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477316 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv4nt\" (UniqueName: \"kubernetes.io/projected/a6314ca5-4081-47d3-9adc-e6ebc8331253-kube-api-access-xv4nt\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477316 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-sys\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477316 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-sys\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477316 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-proc\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477591 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-podres\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.477591 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.477443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6314ca5-4081-47d3-9adc-e6ebc8331253-lib-modules\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.485545 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.485505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv4nt\" (UniqueName: \"kubernetes.io/projected/a6314ca5-4081-47d3-9adc-e6ebc8331253-kube-api-access-xv4nt\") pod \"perf-node-gather-daemonset-stshc\" (UID: \"a6314ca5-4081-47d3-9adc-e6ebc8331253\") " pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.580001 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.579902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:11.875803 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:11.875623    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"]
Sep 19 12:13:11.879260 ip-10-0-133-160 kubenswrapper[2582]: W0919 12:13:11.879227    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6314ca5_4081_47d3_9adc_e6ebc8331253.slice/crio-ee5c346ea7d4c35e98b3dae091a118e8b730a2907b6233b81710b9b12f9646d7 WatchSource:0}: Error finding container ee5c346ea7d4c35e98b3dae091a118e8b730a2907b6233b81710b9b12f9646d7: Status 404 returned error can't find the container with id ee5c346ea7d4c35e98b3dae091a118e8b730a2907b6233b81710b9b12f9646d7
Sep 19 12:13:12.001509 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:12.001486    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d5f8f5b78-wll2k_e61e8ec5-b7c7-4918-bf49-e6091c7b2e0d/console/0.log"
Sep 19 12:13:12.033599 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:12.033566    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-l6c6n_70d7bb7e-0291-4006-9dde-65deaef5fb18/download-server/0.log"
Sep 19 12:13:12.608128 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:12.608090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc" event={"ID":"a6314ca5-4081-47d3-9adc-e6ebc8331253","Type":"ContainerStarted","Data":"d5bbf497ae67ebe7fa8a37b9e174a05d4accdd6dd5cec9d4a8529d2366ace243"}
Sep 19 12:13:12.608492 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:12.608149    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc" event={"ID":"a6314ca5-4081-47d3-9adc-e6ebc8331253","Type":"ContainerStarted","Data":"ee5c346ea7d4c35e98b3dae091a118e8b730a2907b6233b81710b9b12f9646d7"}
Sep 19 12:13:12.608492 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:12.608171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:12.624629 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:12.624581    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc" podStartSLOduration=1.624566492 podStartE2EDuration="1.624566492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 12:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 12:13:12.622018394 +0000 UTC m=+2363.639055108" watchObservedRunningTime="2026-09-19 12:13:12.624566492 +0000 UTC m=+2363.641603203"
Sep 19 12:13:13.617864 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:13.617829    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvrq2_c14c5be0-3da7-460b-903c-5e5ce5583e72/dns/0.log"
Sep 19 12:13:13.636635 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:13.636608    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvrq2_c14c5be0-3da7-460b-903c-5e5ce5583e72/kube-rbac-proxy/0.log"
Sep 19 12:13:13.768753 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:13.768725    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gf2qm_794c3f80-270d-4390-95ac-064346466631/dns-node-resolver/0.log"
Sep 19 12:13:14.276729 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:14.276701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d9b799f7d-54l8q_2a6fcf53-6194-419b-80ab-79322650d3df/registry/0.log"
Sep 19 12:13:14.315558 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:14.315529    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bf9j6_98b60b02-8436-4c3e-a488-96c4b0b17583/node-ca/0.log"
Sep 19 12:13:15.211599 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:15.211568    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9_01a643c1-e9d2-421b-8643-4fbb929de704/istio-proxy/0.log"
Sep 19 12:13:16.139144 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:16.139119    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864788f75f-l7bzp_85deca22-dc4b-471d-92c1-61750fca07ac/kube-auth-proxy/0.log"
Sep 19 12:13:16.186173 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:16.186140    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/0.log"
Sep 19 12:13:16.190392 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:16.190324    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/1.log"
Sep 19 12:13:16.212710 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:16.212641    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h_a847a4ee-b18e-4756-a13f-68a562d26842/istio-proxy/0.log"
Sep 19 12:13:17.197079 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:17.197047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm742_b431d345-caad-4147-9cba-91d0759b5330/serve-healthcheck-canary/0.log"
Sep 19 12:13:17.735420 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:17.735360    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l6vd_3c9b8058-f4d5-428b-a07a-1562a8048dfd/kube-rbac-proxy/0.log"
Sep 19 12:13:17.752932 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:17.752899    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l6vd_3c9b8058-f4d5-428b-a07a-1562a8048dfd/exporter/0.log"
Sep 19 12:13:17.771225 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:17.771193    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l6vd_3c9b8058-f4d5-428b-a07a-1562a8048dfd/extractor/0.log"
Sep 19 12:13:18.624108 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:18.624079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fgjdw/perf-node-gather-daemonset-stshc"
Sep 19 12:13:20.171758 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:20.171679    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-9f59f68b4-29rp5_1d883b81-dff5-4f64-a7bb-f067e268fce6/manager/0.log"
Sep 19 12:13:20.190404 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:20.190372    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-9f59f68b4-29rp5_1d883b81-dff5-4f64-a7bb-f067e268fce6/copy-manifests/0.log"
Sep 19 12:13:20.530726 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:20.530697    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9_01a643c1-e9d2-421b-8643-4fbb929de704/istio-proxy/0.log"
Sep 19 12:13:21.443984 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:21.443954    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864788f75f-l7bzp_85deca22-dc4b-471d-92c1-61750fca07ac/kube-auth-proxy/0.log"
Sep 19 12:13:21.476738 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:21.476712    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/0.log"
Sep 19 12:13:21.480791 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:21.480765    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/1.log"
Sep 19 12:13:21.493796 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:21.493771    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h_a847a4ee-b18e-4756-a13f-68a562d26842/istio-proxy/0.log"
Sep 19 12:13:21.576972 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:21.576936    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-spfwq_f727bffb-7557-449b-add2-7e7b053a7cc0/jobset-operator/0.log"
Sep 19 12:13:22.641467 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:22.641432    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b54d84f7b-nr947_ab4ec0a3-59bc-48c3-a66d-bb0e8c17368d/manager/0.log"
Sep 19 12:13:22.765964 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:22.765903    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-25hvd_cc9fd22c-721e-438a-9fe4-a0bf23de72db/manager/0.log"
Sep 19 12:13:23.150427 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:23.150353    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mbbr9_01a643c1-e9d2-421b-8643-4fbb929de704/istio-proxy/0.log"
Sep 19 12:13:24.085537 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:24.085488    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-864788f75f-l7bzp_85deca22-dc4b-471d-92c1-61750fca07ac/kube-auth-proxy/0.log"
Sep 19 12:13:24.122738 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:24.122710    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/0.log"
Sep 19 12:13:24.127963 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:24.127935    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fww29_2c535113-61e5-4185-9cbe-d9c7aaa6ccd7/istio-proxy/1.log"
Sep 19 12:13:24.141893 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:24.141861    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-lkr4h_a847a4ee-b18e-4756-a13f-68a562d26842/istio-proxy/0.log"
Sep 19 12:13:27.345147 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:27.345122    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-sm7g2_6f9d35d4-19ef-4077-8848-3e0e09bb1527/migrator/0.log"
Sep 19 12:13:27.363384 ip-10-0-133-160 kubenswrapper[2582]: I0919 12:13:27.363362    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-sm7g2_6f9d35d4-19ef-4077-8848-3e0e09bb1527/graceful-termination/0.log"