Sep 07 11:45:13.844877 ip-10-0-138-55 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 11:45:13.844889 ip-10-0-138-55 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 11:45:13.844898 ip-10-0-138-55 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 11:45:13.845199 ip-10-0-138-55 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 11:45:23.556931 ip-10-0-138-55 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Sep 07 11:45:23.556944 ip-10-0-138-55 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7de3cc0f34664b02a62b21fc8a6ee011 --
Sep 07 11:47:04.733648 ip-10-0-138-55 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 11:47:05.192383 ip-10-0-138-55 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 11:47:05.192383 ip-10-0-138-55 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 11:47:05.192383 ip-10-0-138-55 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 11:47:05.192383 ip-10-0-138-55 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 11:47:05.192383 ip-10-0-138-55 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 11:47:05.195146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.195053    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 11:47:05.199049 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199033    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 11:47:05.199049 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199048    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199052    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199056    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199059    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199063    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199066    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199069    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199071    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199074    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199077    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199080    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199084    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199088    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199093    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199096    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199100    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199102    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199105    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199107    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 11:47:05.199115 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199110    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199113    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199116    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199119    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199122    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199125    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199128    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199131    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199134    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199137    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199140    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199142    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199145    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199147    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199150    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199153    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199158    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199161    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199165    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199168    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 11:47:05.199582 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199171    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199173    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199176    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199179    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199181    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199184    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199186    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199189    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199193    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199196    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199199    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199202    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199205    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199208    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199211    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199214    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199217    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199220    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199224    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 11:47:05.200061 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199227    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199229    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199232    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199235    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199237    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199240    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199243    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199245    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199248    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199250    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199253    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199256    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199259    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199261    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199264    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199266    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199269    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199272    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199274    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 11:47:05.200533 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199278    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199280    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199283    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199285    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199288    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199291    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199293    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199296    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199300    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199303    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199305    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199308    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199311    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199313    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199316    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199319    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199321    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199324    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199327    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 11:47:05.201006 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199330    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.199332    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200044    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200051    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200054    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200057    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200060    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200065    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200068    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200071    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200074    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200076    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200079    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200082    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200085    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200088    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200091    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200093    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200097    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 11:47:05.201545 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200100    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200103    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200106    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200109    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200111    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200114    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200117    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200120    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200122    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200126    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200129    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200131    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200134    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200136    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200139    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200141    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200144    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200146    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200149    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200152    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 11:47:05.202017 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200154    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200160    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200164    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200167    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200170    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200173    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200176    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200178    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200181    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200183    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200186    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200189    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200191    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200194    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200197    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200200    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200203    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200205    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200208    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200210    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 11:47:05.202520 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200213    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200215    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200218    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200220    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200223    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200225    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200228    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200232    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200235    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200238    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200241    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200244    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200246    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200249    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200252    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200254    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200258    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200261    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200263    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200266    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 11:47:05.203000 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200268    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200271    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200273    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200276    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200278    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200282    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200286    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200288    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200291    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200294    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200297    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200299    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200302    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200305    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200308    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200310    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200312    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200315    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200318    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 11:47:05.203516 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200320    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200322    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200325    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200771    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200777    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200781    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200784    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200789    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200793    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200796    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200798    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200801    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200804    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200807    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200810    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200813    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200815    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200818    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200821    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 11:47:05.203980 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200824    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200826    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200829    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200832    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200834    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200837    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200840    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200842    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200845    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200847    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200850    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200853    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200855    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200858    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200861    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200863    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200867    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200870    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200873    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200875    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 11:47:05.204459 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200878    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200881    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200884    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200887    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200891    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200894    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200897    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200899    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200903    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200906    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200908    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200911    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200914    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200917    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200919    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200922    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200924    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200927    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200930    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 11:47:05.204943 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200933    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200936    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200938    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200941    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200944    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200946    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200949    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200951    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200954    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200958    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200961    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200965    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200968    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200971    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200973    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200976    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200979    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200982    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200984    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200987    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 11:47:05.205418 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200990    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200993    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200995    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.200998    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201000    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201003    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201005    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201009    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201012    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201016    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201019    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201022    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201024    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201027    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201030    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201033    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201036    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201039    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201041    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 11:47:05.205903 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201044    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201047    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201050    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201053    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201057    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201131    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201162    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201172    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201177    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201181    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201185    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201189    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201193    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201196    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201199    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201203    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201206    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201209    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201212    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201215    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201218    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201221    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201224    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201229    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 07 11:47:05.206408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201232    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201235    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201238    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201241    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201245    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201248    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201251    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201254    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201257    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201261    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201264    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201267    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201272    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201276    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201279    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201282    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201285    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201288    2560 flags.go:64] FLAG: --enable-server="true"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201292    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201296    2560 flags.go:64] FLAG: --event-burst="100"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201299    2560 flags.go:64] FLAG: --event-qps="50"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201302    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201305    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201308    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 07 11:47:05.206996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201312    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201315    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201318    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201321    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201324    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201327    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201330    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201333    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201349    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201352    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201355    2560 flags.go:64] FLAG: --feature-gates=""
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201359    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201362    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201365    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201368    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201372    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201375    2560 flags.go:64] FLAG: --help="false"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201378    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201381    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201385    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201389    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201393    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201397    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201400    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 11:47:05.207581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201402    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201405    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201408    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201412    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201415    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201418    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201421    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201424    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201427    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201430    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201432    2560 flags.go:64] FLAG: --lock-file=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201435    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201438    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201441    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201447    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201450    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201453    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201456    2560 flags.go:64] FLAG: --logging-format="text"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201458    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201462    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201464    2560 flags.go:64] FLAG: --manifest-url=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201467    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201472    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201474    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201478    2560 flags.go:64] FLAG: --max-pods="110"
Sep 07 11:47:05.208222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201481    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201485    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201488    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201492    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201495    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201498    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201502    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201508    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201511    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201514    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201517    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201521    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201527    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201530    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201533    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201536    2560 flags.go:64] FLAG: --port="10250"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201539    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201542    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058ad15e15d37fbb6"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201546    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201549    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201552    2560 flags.go:64] FLAG: --register-node="true"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201556    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201559    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201562    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 07 11:47:05.208842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201565    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201568    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201572    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201575    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201578    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201581    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201583    2560 flags.go:64] FLAG: --runonce="false"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201586    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201589    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201594    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201596    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201599    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201604    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201607    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201610    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201613    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201616    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201619    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201622    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201625    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201628    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201632    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201637    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201640    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201643    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 11:47:05.209531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201647    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201650    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201653    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201656    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201658    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201661    2560 flags.go:64] FLAG: --v="2"
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201665    2560 flags.go:64] FLAG: --version="false"
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201669    2560 flags.go:64] FLAG: --vmodule=""
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201673    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.201676    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201787    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201791    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201794    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201797    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201800    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201803    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201807    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201810    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201812    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201818    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201820    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201823    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 11:47:05.210171 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201825    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201828    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201830    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201833    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201835    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201838    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201844    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201847    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201849    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201852    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201854    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201857    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201860    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201862    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201865    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201867    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201870    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201873    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201875    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201878    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 11:47:05.210720 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201880    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201883    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201885    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201888    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201891    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201893    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201897    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201899    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201902    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201907    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201909    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201914    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201917    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201920    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201923    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201926    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201929    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201931    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201934    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201937    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 11:47:05.211200 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201941    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201945    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201947    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201950    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201953    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201956    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201959    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201961    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201964    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201966    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201969    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201971    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201974    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201976    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201980    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201983    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201987    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201991    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201996    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.201999    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 11:47:05.211728 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202001    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202005    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202008    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202010    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202013    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202015    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202018    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202021    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202024    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202027    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202030    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202032    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202036    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202038    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202041    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202043    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202046    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202049    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202051    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202054    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 11:47:05.212216 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202056    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202059    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202061    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202064    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202068    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202072    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.202075    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.202083    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.209502    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.209517    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.209537    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.209543    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209599    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209605    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 11:47:05.212729 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209609    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209612    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209615    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209618    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209620    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209623    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209626    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209628    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209631    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209634    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209637    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209639    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209642    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209645    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209647    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209650    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209652    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209655    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209658    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209660    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 11:47:05.213125 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209663    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209666    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209668    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209671    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209674    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209676    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209679    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209683    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209686    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209688    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209691    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209695    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209699    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209702    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209705    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209708    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209711    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209713    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209718    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 11:47:05.213659 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209721    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209724    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209727    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209730    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209733    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209736    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209739    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209742    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209744    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209747    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209750    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209753    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209755    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209758    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209760    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209763    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209765    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209768    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209770    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209773    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 11:47:05.214151 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209777    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209780    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209782    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209785    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209788    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209790    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209793    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209795    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209798    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209801    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209803    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209806    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209808    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209811    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209814    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209816    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209819    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209822    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209824    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209827    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 11:47:05.214638 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209829    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209832    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209834    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209837    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209839    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209842    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209845    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209847    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209849    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209853    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209857    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209860    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209863    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209865    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209868    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209871    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209873    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 11:47:05.215114 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209876    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.209881    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209994    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.209999    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210002    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210005    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210008    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210011    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210014    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210016    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210019    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210021    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210024    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210026    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210029    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 11:47:05.215546 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210031    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210034    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210036    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210039    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210042    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210044    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210046    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210049    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210051    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210054    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210056    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210059    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210062    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210064    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210067    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210070    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210073    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210075    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210078    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210080    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 11:47:05.215909 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210083    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210085    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210088    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210090    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210093    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210096    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210098    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210101    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210103    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210107    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210111    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210114    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210117    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210119    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210123    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210126    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210129    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210132    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210134    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 11:47:05.216398 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210137    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210140    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210142    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210145    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210147    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210150    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210153    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210155    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210157    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210161    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210164    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210166    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210169    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210171    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210174    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210177    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210179    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210182    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210185    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210188    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 11:47:05.216882 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210191    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210196    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210198    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210201    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210205    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210209    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210211    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210214    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210216    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210219    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210221    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210224    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210227    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210229    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210232    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210234    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210237    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210240    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 11:47:05.217462 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210242    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210245    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210248    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210251    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210253    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210256    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210258    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:05.210261    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.210265    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.210390    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.212700    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.213771    2560 server.go:1019] "Starting client certificate rotation"
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.213871    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 11:47:05.218065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.213910    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 11:47:05.218542 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.216574    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 11:47:05.219591 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.219554    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 11:47:05.229532 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.229515    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 07 11:47:05.232761 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.232743    2560 log.go:25] "Validated CRI v1 image API"
Sep 07 11:47:05.233604 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.233588    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 11:47:05.237061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.237041    2560 fs.go:135] Filesystem UUIDs: map[49b23b84-827c-49f0-824f-b35b292894a6:/dev/nvme0n1p4 64b0fcaa-a309-4768-b408-ee22f686a6ab:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 07 11:47:05.237130 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.237060    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 11:47:05.242497 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.242383    2560 manager.go:216] Machine: {Timestamp:2026-09-07 11:47:05.241025638 +0000 UTC m=+0.378776941 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3134522 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279252ff1fa81df9082bcf740d8d40 SystemUUID:ec279252-ff1f-a81d-f908-2bcf740d8d40 BootID:7de3cc0f-3466-4b02-a62b-21fc8a6ee011 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:50:0a:a0:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:50:0a:a0:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:7a:f2:e6:1c:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 11:47:05.242497 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.242488    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 11:47:05.242626 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.242571    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 11:47:05.246080 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.246052    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 11:47:05.246259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.246084    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 11:47:05.246515 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.246499    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 11:47:05.246991 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.246979    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 11:47:05.247051 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.246999    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 11:47:05.247051 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.247010    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 11:47:05.247911 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.247898    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 11:47:05.249757 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.249742    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 11:47:05.254148 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254137    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 11:47:05.254265 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254255    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 11:47:05.254295 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254284    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 11:47:05.254387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254295    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 11:47:05.254387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254306    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 11:47:05.254387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254316    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 07 11:47:05.254387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254325    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 11:47:05.254714 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254700    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 11:47:05.254767 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.254719    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 11:47:05.257112 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.257094    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 11:47:05.260205 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.260191    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 11:47:05.260257 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.260221    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 11:47:05.261066 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261054    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 11:47:05.261108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261074    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 11:47:05.261108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261081    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 11:47:05.261108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261087    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 11:47:05.261108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261096    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 11:47:05.261108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261101    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 11:47:05.261251 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261115    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 11:47:05.261251 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261121    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 11:47:05.261251 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261129    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 11:47:05.261251 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261134    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 11:47:05.261251 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261143    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 11:47:05.261251 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261149    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 11:47:05.261996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261987    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 11:47:05.262028 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.261996    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 11:47:05.265913 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.265897    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-55.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 11:47:05.266369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.266357    2560 server.go:1268] "Started kubelet"
Sep 07 11:47:05.266507 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.266444    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 11:47:05.266550 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.266541    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 11:47:05.266905 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.266762    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 11:47:05.266905 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.266764    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 11:47:05.266905 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.266813    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 11:47:05.267261 ip-10-0-138-55 systemd[1]: Started Kubernetes Kubelet.
Sep 07 11:47:05.271211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.271190    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 11:47:05.272613 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.272591    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 11:47:05.273818 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.273297    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 11:47:05.277429 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.276325    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692abea1e4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.266315748 +0000 UTC m=+0.404067050,LastTimestamp:2026-09-07 11:47:05.266315748 +0000 UTC m=+0.404067050,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.280275 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.280258    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 11:47:05.280946 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.280929    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 11:47:05.281070 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.281050    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:05.281658 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281638    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 11:47:05.281658 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281657    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 11:47:05.281803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281638    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 11:47:05.281803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281645    2560 factory.go:55] Registering systemd factory
Sep 07 11:47:05.281803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281696    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 07 11:47:05.281803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281751    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 11:47:05.281803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281760    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 11:47:05.281974 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281924    2560 factory.go:153] Registering CRI-O factory
Sep 07 11:47:05.281974 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281935    2560 factory.go:223] Registration of the crio container factory successfully
Sep 07 11:47:05.282036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.281982    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 11:47:05.282036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.282000    2560 factory.go:103] Registering Raw factory
Sep 07 11:47:05.282036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.282014    2560 manager.go:1196] Started watching for new ooms in manager
Sep 07 11:47:05.282455 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.282438    2560 manager.go:349] Starting recovery of all containers
Sep 07 11:47:05.284680 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.284651    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 11:47:05.284762 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.284745    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 11:47:05.293444 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.293428    2560 manager.go:354] Recovery completed
Sep 07 11:47:05.298089 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.298074    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.300010 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.299992    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.300071 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.300026    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.300071 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.300040    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.300623 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.300609    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 11:47:05.300623 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.300622    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 11:47:05.300755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.300626    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.300755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.300638    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 11:47:05.301450 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.301426    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.301527 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.301461    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.301527 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.301471    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.302745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.302732    2560 policy_none.go:49] "None policy: Start"
Sep 07 11:47:05.302840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.302748    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 11:47:05.302840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.302758    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 11:47:05.302980 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.302840    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc0c626  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300010534 +0000 UTC m=+0.437761836,LastTimestamp:2026-09-07 11:47:05.300010534 +0000 UTC m=+0.437761836,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.304752 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.304737    2560 policy_none.go:47] "Start"
Sep 07 11:47:05.310198 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.309968    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc11f7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300033405 +0000 UTC m=+0.437784708,LastTimestamp:2026-09-07 11:47:05.300033405 +0000 UTC m=+0.437784708,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.314326 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.314264    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc14954  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300044116 +0000 UTC m=+0.437795417,LastTimestamp:2026-09-07 11:47:05.300044116 +0000 UTC m=+0.437795417,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.321496 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.321398    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-55.ec2.internal.18d307692cc0c626\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc0c626  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300010534 +0000 UTC m=+0.437761836,LastTimestamp:2026-09-07 11:47:05.301445468 +0000 UTC m=+0.439196775,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.323284 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.323194    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-55.ec2.internal.18d307692cc11f7d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc11f7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300033405 +0000 UTC m=+0.437784708,LastTimestamp:2026-09-07 11:47:05.301466341 +0000 UTC m=+0.439217643,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.332585 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.332526    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-55.ec2.internal.18d307692cc14954\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc14954  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300044116 +0000 UTC m=+0.437795417,LastTimestamp:2026-09-07 11:47:05.301475801 +0000 UTC m=+0.439227103,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.341948 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.341933    2560 manager.go:337] "Starting Device Plugin manager"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.341966    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.341976    2560 server.go:87] "Starting device plugin registration server"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.342277    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.342298    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.342494    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.342580    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.342589    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.343261    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.343309    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.351154    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.352510    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.352560    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.352582    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.352653    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.355573    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 07 11:47:05.360025 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.355577    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692f6492f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.344299767 +0000 UTC m=+0.482051071,LastTimestamp:2026-09-07 11:47:05.344299767 +0000 UTC m=+0.482051071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.394684 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.394654    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g6pts"
Sep 07 11:47:05.402121 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.402100    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g6pts"
Sep 07 11:47:05.442707 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.442602    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.443737 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.443711    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.443849 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.443753    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.443849 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.443768    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.443849 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.443798    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.446681 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.446614    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-55.ec2.internal.18d307692cc0c626\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-55.ec2.internal.18d307692cc0c626  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-55.ec2.internal,UID:ip-10-0-138-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-55.ec2.internal,},FirstTimestamp:2026-09-07 11:47:05.300010534 +0000 UTC m=+0.437761836,LastTimestamp:2026-09-07 11:47:05.443735013 +0000 UTC m=+0.581486321,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-55.ec2.internal,}"
Sep 07 11:47:05.453377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.453354    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"]
Sep 07 11:47:05.453479 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.453422    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.453753 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.453738    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-55.ec2.internal\" not found" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.454319 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.454302    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.454392 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.454357    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.454392 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.454371    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.456485 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.456473    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.456621 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.456607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.456660 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.456637    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.457260 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.457243    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.457260 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.457255    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.457401 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.457273    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.457401 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.457279    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.457401 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.457285    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.457401 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.457293    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.459477 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.459459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.459617 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.459494    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.460216 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.460198    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.460216 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.460229    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.460365 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.460243    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.481944 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.481923    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-55.ec2.internal\" not found" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.482843 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.482825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbd12f66d7d12b4ca1e2be1649c6f472-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"bbd12f66d7d12b4ca1e2be1649c6f472\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.482922 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.482850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd12f66d7d12b4ca1e2be1649c6f472-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"bbd12f66d7d12b4ca1e2be1649c6f472\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.482922 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.482908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd0fc6289a29b5498b2afc90aad27f10-config\") pod \"kube-apiserver-proxy-ip-10-0-138-55.ec2.internal\" (UID: \"dd0fc6289a29b5498b2afc90aad27f10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.486643 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.486626    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-55.ec2.internal\" not found" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.491289 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.491254    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-55.ec2.internal\" not found" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.583981 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.583931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbd12f66d7d12b4ca1e2be1649c6f472-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"bbd12f66d7d12b4ca1e2be1649c6f472\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.583981 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.583984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd12f66d7d12b4ca1e2be1649c6f472-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"bbd12f66d7d12b4ca1e2be1649c6f472\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.584176 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.584051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbd12f66d7d12b4ca1e2be1649c6f472-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"bbd12f66d7d12b4ca1e2be1649c6f472\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.584176 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.584071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd12f66d7d12b4ca1e2be1649c6f472-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"bbd12f66d7d12b4ca1e2be1649c6f472\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.584176 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.584087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd0fc6289a29b5498b2afc90aad27f10-config\") pod \"kube-apiserver-proxy-ip-10-0-138-55.ec2.internal\" (UID: \"dd0fc6289a29b5498b2afc90aad27f10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.584176 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.584126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd0fc6289a29b5498b2afc90aad27f10-config\") pod \"kube-apiserver-proxy-ip-10-0-138-55.ec2.internal\" (UID: \"dd0fc6289a29b5498b2afc90aad27f10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.654116 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.654072    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:05.655062 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.655044    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:05.655133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.655075    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:05.655133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.655085    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:05.655133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.655114    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.664706 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.664681    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.664706 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.664708    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-55.ec2.internal\": node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:05.724938 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.724837    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:05.785281 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.785238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.790902 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:05.790737    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:05.825906 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.825873    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:05.926407 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:05.926365    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.028171 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.028134    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.096872 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.096849    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 11:47:06.120490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.120466    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 11:47:06.128220 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.128195    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.213956 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.213921    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 11:47:06.214568 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.214073    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 11:47:06.214568 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.214118    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 11:47:06.228821 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.228781    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.330427 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.330302    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.405502 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.405461    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 11:42:06 +0000 UTC" deadline="2028-02-06 17:35:14.814041764 +0000 UTC"
Sep 07 11:47:06.405502 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.405497    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12413h48m8.408549742s"
Sep 07 11:47:06.430781 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.430752    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.498682 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.498648    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 11:47:06.500711 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.500682    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 11:47:06.500865 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.500726    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 11:47:06.500865 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.500741    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID"
Sep 07 11:47:06.531266 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.531235    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.605406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.605385    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 11:47:06.606032 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:06.606005    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0fc6289a29b5498b2afc90aad27f10.slice/crio-45e652e22a060d040a9672c7c73d03619cd9fa20fa4640702fc9feed41983d19 WatchSource:0}: Error finding container 45e652e22a060d040a9672c7c73d03619cd9fa20fa4640702fc9feed41983d19: Status 404 returned error can't find the container with id 45e652e22a060d040a9672c7c73d03619cd9fa20fa4640702fc9feed41983d19
Sep 07 11:47:06.632348 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.632309    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.632690 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.632676    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 11:47:06.732965 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.732917    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.836379 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:06.836312    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found"
Sep 07 11:47:06.857804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.857782    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 11:47:06.882745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.882710    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:06.896130 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.896104    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 11:47:06.897263 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.897246    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"
Sep 07 11:47:06.906326 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:06.906306    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 11:47:07.257001 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.256973    2560 apiserver.go:52] "Watching apiserver"
Sep 07 11:47:07.266118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.266071    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 11:47:07.266854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.266650    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-r5258","openshift-multus/multus-rdr2z","openshift-ovn-kubernetes/ovnkube-node-kc59l","kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal","openshift-multus/multus-additional-cni-plugins-wpnfg","openshift-multus/network-metrics-daemon-2pg2r","openshift-network-diagnostics/network-check-target-cn97r","openshift-network-operator/iptables-alerter-n5p4z","kube-system/global-pull-secret-syncer-gzsd2","kube-system/konnectivity-agent-vmzt4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd","openshift-cluster-node-tuning-operator/tuned-fpzgr","openshift-dns/node-resolver-w5x8s"]
Sep 07 11:47:07.269478 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.269412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.269593 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.269501    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:07.271767 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.271746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.275445 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.275405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.276882 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.276676    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 11:47:07.276882 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.276686    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 11:47:07.276882 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.276855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bp2z6\""
Sep 07 11:47:07.277108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.276999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.278762 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.277840    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 11:47:07.278762 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.278265    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.278762 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.278464    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.279781    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.280024    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xc82c\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.280299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.280516    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.280730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.280789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.280900    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.280957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.281047    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.281248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.281055    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lc7bd\""
Sep 07 11:47:07.283166 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.283148    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.285493 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.285472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.286387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.286368    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.286701 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.286677    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 11:47:07.286945 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.286925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hxmwm\""
Sep 07 11:47:07.287139 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.287115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 11:47:07.287352 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.287339    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.287549 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.287533    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 11:47:07.287900 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.287883    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.288273 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.288251    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.288488 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.288471    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 11:47:07.288766 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.288748    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xmjvk\""
Sep 07 11:47:07.289080 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.289065    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.296640 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-cni-netd\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.296755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrm9p\" (UniqueName: \"kubernetes.io/projected/73337008-191e-4f5b-af2d-78d7a15904d3-kube-api-access-wrm9p\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.296755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-systemd-units\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.296755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-slash\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.296916 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.296916 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-hosts-file\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.296916 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.296916 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.296916 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovnkube-config\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.296965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovn-node-metrics-cert\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovnkube-script-lib\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c055eba-e3d2-4351-85f5-ce751ca99cd9-konnectivity-ca\") pod \"konnectivity-agent-vmzt4\" (UID: \"3c055eba-e3d2-4351-85f5-ce751ca99cd9\") " pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.297189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-var-lib-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-etc-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-log-socket\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlzb7\" (UniqueName: \"kubernetes.io/projected/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-kube-api-access-vlzb7\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.297308 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.297308 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.297308 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/143741c1-926c-4aa7-bc16-798a7755855e-dbus\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.297396 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-systemd\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297396 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-ovn\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297396 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-node-log\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-cni-bin\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-env-overrides\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c055eba-e3d2-4351-85f5-ce751ca99cd9-agent-certs\") pod \"konnectivity-agent-vmzt4\" (UID: \"3c055eba-e3d2-4351-85f5-ce751ca99cd9\") " pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.297600 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-run-netns\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297600 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297600 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k544m\" (UniqueName: \"kubernetes.io/projected/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-kube-api-access-k544m\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.297738 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:07.297849 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-system-cni-dir\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.297907 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-cnibin\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.297979 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/143741c1-926c-4aa7-bc16-798a7755855e-kubelet-config\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.298040 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.297994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-tmp-dir\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.298093 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.298042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.298093 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.298077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-kubelet\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.298817 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.298305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.299345 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.298973    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.299345 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.298979    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6dphq\""
Sep 07 11:47:07.300301 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.300276    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.300695 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.300675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-trqvc\""
Sep 07 11:47:07.300780 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.300690    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 11:47:07.300895 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.300866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.303466 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.303063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:07.303466 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.303165    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:07.303771 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.303633    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sq6dx\""
Sep 07 11:47:07.303771 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.303654    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 11:47:07.304210 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.303896    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.304210 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.303912    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.304210 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.304136    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 11:47:07.305651 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.305628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.308688 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.308574    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 11:47:07.308688 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.308584    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lwnfq\""
Sep 07 11:47:07.308688 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.308614    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 11:47:07.308954 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.308935    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 11:47:07.322129 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.322105    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8ldc"
Sep 07 11:47:07.330474 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.330084    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8ldc"
Sep 07 11:47:07.360932 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.360877    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" event={"ID":"dd0fc6289a29b5498b2afc90aad27f10","Type":"ContainerStarted","Data":"45e652e22a060d040a9672c7c73d03619cd9fa20fa4640702fc9feed41983d19"}
Sep 07 11:47:07.362878 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.362853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"bbd12f66d7d12b4ca1e2be1649c6f472","Type":"ContainerStarted","Data":"52bfee60463e6a6147b2fae656ced063b5debe484bf9b4ca22ed4e5109937df5"}
Sep 07 11:47:07.383437 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.383403    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 11:47:07.398311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c055eba-e3d2-4351-85f5-ce751ca99cd9-agent-certs\") pod \"konnectivity-agent-vmzt4\" (UID: \"3c055eba-e3d2-4351-85f5-ce751ca99cd9\") " pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.398449 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-run-netns\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.398449 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysconfig\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.398449 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-sys\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.398449 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f066fa72-a6fa-4e23-8ef7-7b31494a2556-tmp\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.398449 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-system-cni-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-cni-bin\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-tmp-dir\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9a433b1-a66c-40bd-a086-d4910afe958d-host\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-kubernetes\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysctl-conf\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-systemd\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.398774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-cnibin\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.399118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0232e709-d8fb-4854-a213-bdcf33d05175-cni-binary-copy\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.399118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q82n\" (UniqueName: \"kubernetes.io/projected/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-kube-api-access-9q82n\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:07.399118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.398976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-cni-netd\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.406727 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-run-netns\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.406858 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm9p\" (UniqueName: \"kubernetes.io/projected/73337008-191e-4f5b-af2d-78d7a15904d3-kube-api-access-wrm9p\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.406858 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr64h\" (UniqueName: \"kubernetes.io/projected/b9a433b1-a66c-40bd-a086-d4910afe958d-kube-api-access-xr64h\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.406858 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crg5h\" (UniqueName: \"kubernetes.io/projected/f066fa72-a6fa-4e23-8ef7-7b31494a2556-kube-api-access-crg5h\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.406858 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-socket-dir-parent\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.407072 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-k8s-cni-cncf-io\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.407072 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-conf-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.407072 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.406992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0232e709-d8fb-4854-a213-bdcf33d05175-multus-daemon-config\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.407072 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-systemd-units\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.407072 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-systemd-units\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-tmp-dir\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-hosts-file\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-run\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-hosts-file\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-cni-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-netns\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.407321 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.407748 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-iptables-alerter-script\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.407748 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.407748 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-host-slash\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.407914 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.407914 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9a433b1-a66c-40bd-a086-d4910afe958d-serviceca\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.408029 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.407976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-cni-netd\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.408029 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-lib-modules\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.408170 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-socket-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.408213 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c055eba-e3d2-4351-85f5-ce751ca99cd9-konnectivity-ca\") pod \"konnectivity-agent-vmzt4\" (UID: \"3c055eba-e3d2-4351-85f5-ce751ca99cd9\") " pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.408256 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-var-lib-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.408301 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-tuned\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.408352 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-node-log\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.408445 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-var-lib-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.408523 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:07.408585 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-node-log\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.408682 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-cnibin\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.408753 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.408753 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.408742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-modprobe-d\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-multus-certs\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k544m\" (UniqueName: \"kubernetes.io/projected/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-kube-api-access-k544m\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-system-cni-dir\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-hostroot\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c055eba-e3d2-4351-85f5-ce751ca99cd9-konnectivity-ca\") pod \"konnectivity-agent-vmzt4\" (UID: \"3c055eba-e3d2-4351-85f5-ce751ca99cd9\") " pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/143741c1-926c-4aa7-bc16-798a7755855e-kubelet-config\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-registration-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-sys-fs\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.409481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-kubelet\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-device-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-kubelet\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-system-cni-dir\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-cnibin\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysctl-d\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409662    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-etc-kubernetes\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-slash\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkb7\" (UniqueName: \"kubernetes.io/projected/cf3eab6e-bbfc-4678-a76a-112af2e02a38-kube-api-access-wvkb7\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovnkube-config\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovn-node-metrics-cert\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-kubelet\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovnkube-script-lib\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-cni-multus\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.409984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nblx\" (UniqueName: \"kubernetes.io/projected/0232e709-d8fb-4854-a213-bdcf33d05175-kube-api-access-9nblx\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-etc-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-log-socket\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410156    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/143741c1-926c-4aa7-bc16-798a7755855e-kubelet-config\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlzb7\" (UniqueName: \"kubernetes.io/projected/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-kube-api-access-vlzb7\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-slash\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73337008-191e-4f5b-af2d-78d7a15904d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.410316    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-etc-openvswitch\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.410413    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:47:07.910372523 +0000 UTC m=+3.048123822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:07.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcktt\" (UniqueName: \"kubernetes.io/projected/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-kube-api-access-zcktt\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-var-lib-kubelet\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.410864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovnkube-config\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-log-socket\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/143741c1-926c-4aa7-bc16-798a7755855e-dbus\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-systemd\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-systemd\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-ovn\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-cni-bin\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/143741c1-926c-4aa7-bc16-798a7755855e-dbus\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-env-overrides\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-host\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-run-ovn\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-host-cni-bin\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73337008-191e-4f5b-af2d-78d7a15904d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.411885 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-env-overrides\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.412728 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.411936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovnkube-script-lib\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.414401 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.414375    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:07.414401 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.414404    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:07.414580 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.414440    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:07.414580 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.414512    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:07.914493049 +0000 UTC m=+3.052244346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:07.415142 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.415108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-ovn-node-metrics-cert\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.415581 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.415559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c055eba-e3d2-4351-85f5-ce751ca99cd9-agent-certs\") pod \"konnectivity-agent-vmzt4\" (UID: \"3c055eba-e3d2-4351-85f5-ce751ca99cd9\") " pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.417707 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.417655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrm9p\" (UniqueName: \"kubernetes.io/projected/73337008-191e-4f5b-af2d-78d7a15904d3-kube-api-access-wrm9p\") pod \"multus-additional-cni-plugins-wpnfg\" (UID: \"73337008-191e-4f5b-af2d-78d7a15904d3\") " pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.420986 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.420960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k544m\" (UniqueName: \"kubernetes.io/projected/3a6e1ea1-cbd3-41e0-8a5d-025230016a9d-kube-api-access-k544m\") pod \"ovnkube-node-kc59l\" (UID: \"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.425105 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.425064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlzb7\" (UniqueName: \"kubernetes.io/projected/5bcbbe64-545e-4ab3-bf23-fc83244bfde3-kube-api-access-vlzb7\") pod \"node-resolver-w5x8s\" (UID: \"5bcbbe64-545e-4ab3-bf23-fc83244bfde3\") " pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.511669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-cni-multus\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.511669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nblx\" (UniqueName: \"kubernetes.io/projected/0232e709-d8fb-4854-a213-bdcf33d05175-kube-api-access-9nblx\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.511669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.511669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcktt\" (UniqueName: \"kubernetes.io/projected/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-kube-api-access-zcktt\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-var-lib-kubelet\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-host\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysconfig\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-sys\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f066fa72-a6fa-4e23-8ef7-7b31494a2556-tmp\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-system-cni-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-cni-bin\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9a433b1-a66c-40bd-a086-d4910afe958d-host\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-kubernetes\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysctl-conf\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-systemd\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-cnibin\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0232e709-d8fb-4854-a213-bdcf33d05175-cni-binary-copy\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q82n\" (UniqueName: \"kubernetes.io/projected/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-kube-api-access-9q82n\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr64h\" (UniqueName: \"kubernetes.io/projected/b9a433b1-a66c-40bd-a086-d4910afe958d-kube-api-access-xr64h\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.511990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crg5h\" (UniqueName: \"kubernetes.io/projected/f066fa72-a6fa-4e23-8ef7-7b31494a2556-kube-api-access-crg5h\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-socket-dir-parent\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-k8s-cni-cncf-io\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-conf-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0232e709-d8fb-4854-a213-bdcf33d05175-multus-daemon-config\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-run\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-cni-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-netns\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-iptables-alerter-script\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-host-slash\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9a433b1-a66c-40bd-a086-d4910afe958d-serviceca\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-lib-modules\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-socket-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-tuned\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-modprobe-d\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-multus-certs\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-hostroot\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-registration-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.512983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-sys-fs\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-device-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-kubelet\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysctl-d\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-etc-kubernetes\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.512675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkb7\" (UniqueName: \"kubernetes.io/projected/cf3eab6e-bbfc-4678-a76a-112af2e02a38-kube-api-access-wvkb7\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-cni-multus\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-var-lib-kubelet\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-host\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysconfig\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.513854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-sys\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.513993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-netns\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9a433b1-a66c-40bd-a086-d4910afe958d-host\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-k8s-cni-cncf-io\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-system-cni-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-kubernetes\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-conf-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-socket-dir-parent\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysctl-conf\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-systemd\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-cnibin\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-multus-cni-dir\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.514468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-run\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-run-multus-certs\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-cni-bin\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-device-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0232e709-d8fb-4854-a213-bdcf33d05175-multus-daemon-config\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-hostroot\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-registration-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0232e709-d8fb-4854-a213-bdcf33d05175-cni-binary-copy\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.514911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-sys-fs\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-iptables-alerter-script\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.515076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf3eab6e-bbfc-4678-a76a-112af2e02a38-socket-dir\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-modprobe-d\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-lib-modules\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-host-slash\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.515229    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.515296    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:47:08.015279631 +0000 UTC m=+3.153030924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-sysctl-d\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9a433b1-a66c-40bd-a086-d4910afe958d-serviceca\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-etc-kubernetes\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.515677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.515402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0232e709-d8fb-4854-a213-bdcf33d05175-host-var-lib-kubelet\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.517782 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.517755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f066fa72-a6fa-4e23-8ef7-7b31494a2556-etc-tuned\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.518527 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.518501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f066fa72-a6fa-4e23-8ef7-7b31494a2556-tmp\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.528921 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.528895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkb7\" (UniqueName: \"kubernetes.io/projected/cf3eab6e-bbfc-4678-a76a-112af2e02a38-kube-api-access-wvkb7\") pod \"aws-ebs-csi-driver-node-g7hkd\" (UID: \"cf3eab6e-bbfc-4678-a76a-112af2e02a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.529371 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.529340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crg5h\" (UniqueName: \"kubernetes.io/projected/f066fa72-a6fa-4e23-8ef7-7b31494a2556-kube-api-access-crg5h\") pod \"tuned-fpzgr\" (UID: \"f066fa72-a6fa-4e23-8ef7-7b31494a2556\") " pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.529929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.529810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q82n\" (UniqueName: \"kubernetes.io/projected/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-kube-api-access-9q82n\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:07.529929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.529886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcktt\" (UniqueName: \"kubernetes.io/projected/c357edc3-2a7f-41c4-8692-e3afe0b6eb16-kube-api-access-zcktt\") pod \"iptables-alerter-n5p4z\" (UID: \"c357edc3-2a7f-41c4-8692-e3afe0b6eb16\") " pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.531833 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.531807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nblx\" (UniqueName: \"kubernetes.io/projected/0232e709-d8fb-4854-a213-bdcf33d05175-kube-api-access-9nblx\") pod \"multus-rdr2z\" (UID: \"0232e709-d8fb-4854-a213-bdcf33d05175\") " pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.531935 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.531910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr64h\" (UniqueName: \"kubernetes.io/projected/b9a433b1-a66c-40bd-a086-d4910afe958d-kube-api-access-xr64h\") pod \"node-ca-r5258\" (UID: \"b9a433b1-a66c-40bd-a086-d4910afe958d\") " pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.598054 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.598019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:07.607056 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.607024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:07.611617 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.611584    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c055eba_e3d2_4351_85f5_ce751ca99cd9.slice/crio-4c64b4a984e52540c122b829000975f2af4d8f4ad64f73e7575ddb54afd94c92 WatchSource:0}: Error finding container 4c64b4a984e52540c122b829000975f2af4d8f4ad64f73e7575ddb54afd94c92: Status 404 returned error can't find the container with id 4c64b4a984e52540c122b829000975f2af4d8f4ad64f73e7575ddb54afd94c92
Sep 07 11:47:07.617271 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.617245    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6e1ea1_cbd3_41e0_8a5d_025230016a9d.slice/crio-f72b85fa4fd720f5157b8e762e8ff6cfae420b3104d2d3aeaff50b2967cee2fe WatchSource:0}: Error finding container f72b85fa4fd720f5157b8e762e8ff6cfae420b3104d2d3aeaff50b2967cee2fe: Status 404 returned error can't find the container with id f72b85fa4fd720f5157b8e762e8ff6cfae420b3104d2d3aeaff50b2967cee2fe
Sep 07 11:47:07.618126 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.618042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w5x8s"
Sep 07 11:47:07.625943 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.625774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wpnfg"
Sep 07 11:47:07.629941 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.629855    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcbbe64_545e_4ab3_bf23_fc83244bfde3.slice/crio-1ad5e239703e8be965af81b731ff47b4642d9d0480e2887cd897d517501c4da9 WatchSource:0}: Error finding container 1ad5e239703e8be965af81b731ff47b4642d9d0480e2887cd897d517501c4da9: Status 404 returned error can't find the container with id 1ad5e239703e8be965af81b731ff47b4642d9d0480e2887cd897d517501c4da9
Sep 07 11:47:07.634175 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.634035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5p4z"
Sep 07 11:47:07.637798 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.637772    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73337008_191e_4f5b_af2d_78d7a15904d3.slice/crio-45d7ff0d4f5a20e0b063748b73e1ab8176d9dfef9a0891bcf961addd202d9a0c WatchSource:0}: Error finding container 45d7ff0d4f5a20e0b063748b73e1ab8176d9dfef9a0891bcf961addd202d9a0c: Status 404 returned error can't find the container with id 45d7ff0d4f5a20e0b063748b73e1ab8176d9dfef9a0891bcf961addd202d9a0c
Sep 07 11:47:07.644955 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.644928    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fpzgr"
Sep 07 11:47:07.645208 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.645185    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc357edc3_2a7f_41c4_8692_e3afe0b6eb16.slice/crio-429ada7f06659461a147b5782473cb3e45fa0df3a4592cbc9fe78e7de8f21894 WatchSource:0}: Error finding container 429ada7f06659461a147b5782473cb3e45fa0df3a4592cbc9fe78e7de8f21894: Status 404 returned error can't find the container with id 429ada7f06659461a147b5782473cb3e45fa0df3a4592cbc9fe78e7de8f21894
Sep 07 11:47:07.652186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.652165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rdr2z"
Sep 07 11:47:07.655952 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.655930    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf066fa72_a6fa_4e23_8ef7_7b31494a2556.slice/crio-13ad8fa281cdc95fdb10682ac0252c4c32240ec6528c5e659dc3e3d6112c48f7 WatchSource:0}: Error finding container 13ad8fa281cdc95fdb10682ac0252c4c32240ec6528c5e659dc3e3d6112c48f7: Status 404 returned error can't find the container with id 13ad8fa281cdc95fdb10682ac0252c4c32240ec6528c5e659dc3e3d6112c48f7
Sep 07 11:47:07.661309 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.661280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r5258"
Sep 07 11:47:07.662525 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.662502    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0232e709_d8fb_4854_a213_bdcf33d05175.slice/crio-9df26d0daa2a733366f284b1c5c32cdfb3594ab1b39e62ae27e473fad91fa576 WatchSource:0}: Error finding container 9df26d0daa2a733366f284b1c5c32cdfb3594ab1b39e62ae27e473fad91fa576: Status 404 returned error can't find the container with id 9df26d0daa2a733366f284b1c5c32cdfb3594ab1b39e62ae27e473fad91fa576
Sep 07 11:47:07.668556 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.668533    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd"
Sep 07 11:47:07.672620 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.672518    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a433b1_a66c_40bd_a086_d4910afe958d.slice/crio-eae0caf3001b51766116353dcddca9717b7b9e7526fbdf83279b647000b8d9c3 WatchSource:0}: Error finding container eae0caf3001b51766116353dcddca9717b7b9e7526fbdf83279b647000b8d9c3: Status 404 returned error can't find the container with id eae0caf3001b51766116353dcddca9717b7b9e7526fbdf83279b647000b8d9c3
Sep 07 11:47:07.682082 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:07.682062    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3eab6e_bbfc_4678_a76a_112af2e02a38.slice/crio-ed28fe3d9204c91e5f5fb0a9f69a4be86f06155a69786412e3af8e256740093e WatchSource:0}: Error finding container ed28fe3d9204c91e5f5fb0a9f69a4be86f06155a69786412e3af8e256740093e: Status 404 returned error can't find the container with id ed28fe3d9204c91e5f5fb0a9f69a4be86f06155a69786412e3af8e256740093e
Sep 07 11:47:07.915079 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.915035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:07.915246 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:07.915107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:07.915246 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.915230    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:07.915358 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.915261    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:07.915358 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.915276    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:07.915358 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.915343    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:08.915320703 +0000 UTC m=+4.053072008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:07.915508 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.915234    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:07.915508 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:07.915502    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:47:08.915481047 +0000 UTC m=+4.053232347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:08.015499 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.015464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:08.015679 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.015608    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:08.015767 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.015684    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:47:09.015664971 +0000 UTC m=+4.153416261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:08.333776 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.333651    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 11:42:07 +0000 UTC" deadline="2028-05-02 16:23:16.462867315 +0000 UTC"
Sep 07 11:47:08.333776 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.333724    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14476h36m8.129148452s"
Sep 07 11:47:08.366127 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.366088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd" event={"ID":"cf3eab6e-bbfc-4678-a76a-112af2e02a38","Type":"ContainerStarted","Data":"ed28fe3d9204c91e5f5fb0a9f69a4be86f06155a69786412e3af8e256740093e"}
Sep 07 11:47:08.367556 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.367517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r5258" event={"ID":"b9a433b1-a66c-40bd-a086-d4910afe958d","Type":"ContainerStarted","Data":"eae0caf3001b51766116353dcddca9717b7b9e7526fbdf83279b647000b8d9c3"}
Sep 07 11:47:08.368891 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.368844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w5x8s" event={"ID":"5bcbbe64-545e-4ab3-bf23-fc83244bfde3","Type":"ContainerStarted","Data":"1ad5e239703e8be965af81b731ff47b4642d9d0480e2887cd897d517501c4da9"}
Sep 07 11:47:08.370498 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.370470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"f72b85fa4fd720f5157b8e762e8ff6cfae420b3104d2d3aeaff50b2967cee2fe"}
Sep 07 11:47:08.372155 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.372131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vmzt4" event={"ID":"3c055eba-e3d2-4351-85f5-ce751ca99cd9","Type":"ContainerStarted","Data":"4c64b4a984e52540c122b829000975f2af4d8f4ad64f73e7575ddb54afd94c92"}
Sep 07 11:47:08.373653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.373625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rdr2z" event={"ID":"0232e709-d8fb-4854-a213-bdcf33d05175","Type":"ContainerStarted","Data":"9df26d0daa2a733366f284b1c5c32cdfb3594ab1b39e62ae27e473fad91fa576"}
Sep 07 11:47:08.375096 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.375038    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fpzgr" event={"ID":"f066fa72-a6fa-4e23-8ef7-7b31494a2556","Type":"ContainerStarted","Data":"13ad8fa281cdc95fdb10682ac0252c4c32240ec6528c5e659dc3e3d6112c48f7"}
Sep 07 11:47:08.376483 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.376456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5p4z" event={"ID":"c357edc3-2a7f-41c4-8692-e3afe0b6eb16","Type":"ContainerStarted","Data":"429ada7f06659461a147b5782473cb3e45fa0df3a4592cbc9fe78e7de8f21894"}
Sep 07 11:47:08.377968 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.377942    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerStarted","Data":"45d7ff0d4f5a20e0b063748b73e1ab8176d9dfef9a0891bcf961addd202d9a0c"}
Sep 07 11:47:08.673865 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.673649    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 11:47:08.873679 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.873642    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.925040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:08.925150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.925367    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.925400    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.925414    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.925466    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:10.925450476 +0000 UTC m=+6.063201767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.925568    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:08.926010 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:08.925605    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:47:10.925592865 +0000 UTC m=+6.063344167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:09.025662 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.025623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:09.025853 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:09.025799    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:09.025916 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:09.025863    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:47:11.025844378 +0000 UTC m=+6.163595677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:09.335127 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.334855    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 11:42:07 +0000 UTC" deadline="2028-05-26 09:24:11.83159205 +0000 UTC"
Sep 07 11:47:09.335127 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.335125    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15045h37m2.496474168s"
Sep 07 11:47:09.357809 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.356381    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:09.357809 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:09.356525    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:09.357809 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.357007    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:09.357809 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:09.357116    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:09.357809 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.357185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:09.357809 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:09.357264    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:09.395606 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.394940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" event={"ID":"dd0fc6289a29b5498b2afc90aad27f10","Type":"ContainerStarted","Data":"8db1b058b1bd6171b06ed14356677f3679e3c978f45674f87d0b6fe95a1332d1"}
Sep 07 11:47:09.419019 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:09.418165    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" podStartSLOduration=2.41814557 podStartE2EDuration="2.41814557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:09.417672986 +0000 UTC m=+4.555424314" watchObservedRunningTime="2026-09-07 11:47:09.41814557 +0000 UTC m=+4.555896885"
Sep 07 11:47:10.416530 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:10.416492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"bbd12f66d7d12b4ca1e2be1649c6f472","Type":"ContainerStarted","Data":"92f630007350647661355b41945f8ff3cab5391230b21bd8499a31cdf5f4ecfd"}
Sep 07 11:47:10.943020 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:10.942972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:10.943222 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:10.943087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:10.943293 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:10.943277    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:10.943353 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:10.943301    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:10.943353 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:10.943317    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:10.943495 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:10.943416    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:14.943377773 +0000 UTC m=+10.081129071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:10.943883 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:10.943862    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:10.943959 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:10.943933    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:47:14.943909673 +0000 UTC m=+10.081660970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:11.044480 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:11.044438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:11.044677 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:11.044658    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:11.044749 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:11.044734    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:47:15.044713798 +0000 UTC m=+10.182465106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:11.354586 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:11.354556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:11.354778 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:11.354706    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:11.355130 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:11.355109    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:11.355237 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:11.355216    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:11.355398 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:11.355381    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:11.355494 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:11.355468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:13.353083 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:13.353048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:13.353602 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:13.353091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:13.353602 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:13.353204    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:13.353602 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:13.353219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:13.353602 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:13.353374    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:13.353602 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:13.353476    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:13.429117 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:13.429080    2560 generic.go:356] "Generic (PLEG): container finished" podID="bbd12f66d7d12b4ca1e2be1649c6f472" containerID="92f630007350647661355b41945f8ff3cab5391230b21bd8499a31cdf5f4ecfd" exitCode=0
Sep 07 11:47:13.429288 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:13.429137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"bbd12f66d7d12b4ca1e2be1649c6f472","Type":"ContainerDied","Data":"92f630007350647661355b41945f8ff3cab5391230b21bd8499a31cdf5f4ecfd"}
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:14.980791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:14.980881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:14.980955    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:14.981038    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:14.981056    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:14.981070    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:14.981042    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:47:22.981017355 +0000 UTC m=+18.118768660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:14.981131 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:14.981140    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:22.981114294 +0000 UTC m=+18.118865602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:15.082097 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:15.082064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:15.082311 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:15.082189    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:15.082311 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:15.082258    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:47:23.082229659 +0000 UTC m=+18.219980971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:15.356060 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:15.355529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:15.356060 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:15.355651    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:15.356060 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:15.356027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:15.356418 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:15.356392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:15.357394 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:15.357235    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:15.357394 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:15.357233    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:17.353495 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:17.353461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:17.353495 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:17.353490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:17.354125 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:17.353566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:17.354125 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:17.353579    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:17.354125 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:17.353676    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:17.354125 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:17.353758    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:19.352954 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:19.352924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:19.353431 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:19.352924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:19.353431 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:19.353050    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:19.353431 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:19.352924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:19.353431 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:19.353131    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:19.353431 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:19.353237    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:21.353719 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:21.353686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:21.354203 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:21.353686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:21.354203 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:21.353813    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:21.354203 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:21.353687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:21.354203 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:21.353889    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:21.354203 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:21.353990    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:23.037076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:23.037042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:23.037116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.037230    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.037259    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.037235    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.037272    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.037327    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:47:39.037307589 +0000 UTC m=+34.175058895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:23.037601 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.037362    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:39.037352467 +0000 UTC m=+34.175103759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:23.137594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:23.137564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:23.137768 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.137709    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:23.137811 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.137771    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:47:39.137754562 +0000 UTC m=+34.275505856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:23.353632 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:23.353604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:23.353783 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:23.353639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:23.353783 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:23.353607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:23.353783 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.353738    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:23.353934 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.353799    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:23.353934 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:23.353872    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:25.354300 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:25.354234    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:25.354742 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:25.354316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:25.354742 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:25.354351    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:25.354742 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:25.354417    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:25.354742 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:25.354433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:25.354742 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:25.354534    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:26.456160 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.455813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"bbd12f66d7d12b4ca1e2be1649c6f472","Type":"ContainerStarted","Data":"f539acfa69681dad3646ba00878cb8c5ad55b61043f9d8e3f5f68168e1e574f3"}
Sep 07 11:47:26.457407 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.457382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd" event={"ID":"cf3eab6e-bbfc-4678-a76a-112af2e02a38","Type":"ContainerStarted","Data":"b78599ad949bcba054d811076834719d4be52820dd72c5ddb22663441e7caf97"}
Sep 07 11:47:26.458883 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.458859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r5258" event={"ID":"b9a433b1-a66c-40bd-a086-d4910afe958d","Type":"ContainerStarted","Data":"0e7ab22bbc31e488b8dfb8a6bdfe39be03a98dc70caa664fe8e148813a325723"}
Sep 07 11:47:26.460423 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.460319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w5x8s" event={"ID":"5bcbbe64-545e-4ab3-bf23-fc83244bfde3","Type":"ContainerStarted","Data":"9962a1a7e25da39840509047de446f0b5c8745450de7af54423b7e5a99bb870c"}
Sep 07 11:47:26.462149 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.462131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"9524eacc23842ee7149768e6effa48b775bec16856dd7bec329ec6d7fd1d7ec3"}
Sep 07 11:47:26.462218 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.462188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"db3948f4528fb18cbc4dbf9479b0baf45dd0c2b8458119115f2b16ab88074efa"}
Sep 07 11:47:26.463547 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.463522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vmzt4" event={"ID":"3c055eba-e3d2-4351-85f5-ce751ca99cd9","Type":"ContainerStarted","Data":"d9bc5f9b9e2324983abf1649de50e26c24652ba550e86015c184bed3f9669b2b"}
Sep 07 11:47:26.464986 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.464967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rdr2z" event={"ID":"0232e709-d8fb-4854-a213-bdcf33d05175","Type":"ContainerStarted","Data":"fd3057b12452ad3eb752d469ff2a302c1fc8af5000ef36277acdabf1ae50634e"}
Sep 07 11:47:26.466330 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.466305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fpzgr" event={"ID":"f066fa72-a6fa-4e23-8ef7-7b31494a2556","Type":"ContainerStarted","Data":"ad5dd81e6e956459038ee4c8387628673717be17cb1d83c50407d25f78b58319"}
Sep 07 11:47:26.467917 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.467887    2560 generic.go:356] "Generic (PLEG): container finished" podID="73337008-191e-4f5b-af2d-78d7a15904d3" containerID="3a69f08679703ce857982c5bad0b392391d971ee4d22afdb218eb3d114eada50" exitCode=0
Sep 07 11:47:26.467991 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.467931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerDied","Data":"3a69f08679703ce857982c5bad0b392391d971ee4d22afdb218eb3d114eada50"}
Sep 07 11:47:26.472695 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.472658    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" podStartSLOduration=19.472631267 podStartE2EDuration="19.472631267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:26.472595071 +0000 UTC m=+21.610346385" watchObservedRunningTime="2026-09-07 11:47:26.472631267 +0000 UTC m=+21.610382572"
Sep 07 11:47:26.490163 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.490116    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fpzgr" podStartSLOduration=2.117345029 podStartE2EDuration="20.490096491s" totalImagesPullingTime="18.372751462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:26.489703607 +0000 UTC m=+21.627454918" watchObservedRunningTime="2026-09-07 11:47:26.490096491 +0000 UTC m=+21.627847807"
Sep 07 11:47:26.508477 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.508435    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rdr2z" podStartSLOduration=2.098686704 podStartE2EDuration="20.508419058s" totalImagesPullingTime="18.409732354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:26.508074767 +0000 UTC m=+21.645826082" watchObservedRunningTime="2026-09-07 11:47:26.508419058 +0000 UTC m=+21.646170369"
Sep 07 11:47:26.529267 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.529210    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r5258" podStartSLOduration=2.1754977699999998 podStartE2EDuration="20.529189657s" totalImagesPullingTime="18.353691887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:26.528722853 +0000 UTC m=+21.666474168" watchObservedRunningTime="2026-09-07 11:47:26.529189657 +0000 UTC m=+21.666940970"
Sep 07 11:47:26.557703 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.557630    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vmzt4" podStartSLOduration=2.417747744 podStartE2EDuration="20.557615378s" totalImagesPullingTime="18.139867634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:26.557381734 +0000 UTC m=+21.695133045" watchObservedRunningTime="2026-09-07 11:47:26.557615378 +0000 UTC m=+21.695366690"
Sep 07 11:47:26.602181 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:26.602138    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w5x8s" podStartSLOduration=2.4803833109999998 podStartE2EDuration="20.602123407s" totalImagesPullingTime="18.121740096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:26.601755017 +0000 UTC m=+21.739506328" watchObservedRunningTime="2026-09-07 11:47:26.602123407 +0000 UTC m=+21.739874718"
Sep 07 11:47:27.353812 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.353625    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:27.353812 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.353637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:27.353812 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.353748    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:27.353812 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:27.353746    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:27.353812 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:27.353803    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:27.354162 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:27.353904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:27.471661 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.471619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5p4z" event={"ID":"c357edc3-2a7f-41c4-8692-e3afe0b6eb16","Type":"ContainerStarted","Data":"214648486a2b83bc7182e6dd9850549484ef7ca264ccea6ab9135c7f506ff6d7"}
Sep 07 11:47:27.475507 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.475391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"370d9ce17dce9c50372df160a65de17a84dd82b6973c44c0c073d0a00bcf0c8c"}
Sep 07 11:47:27.475507 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.475470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"4d1c1bc0d46cba297d3add485b602bc7149897288f9eabedb10621f9b8ea3ece"}
Sep 07 11:47:27.475686 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.475522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"29e14382b03f40dee33f537606cbf10988134be72ca1acb790cf19c5d34037af"}
Sep 07 11:47:27.475686 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.475571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"40a00381827f91938770b1f6dec4dbd5f045077f5adeaaea2a2657967b7b6446"}
Sep 07 11:47:27.486578 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.486466    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n5p4z" podStartSLOduration=3.379021115 podStartE2EDuration="21.486445764s" totalImagesPullingTime="18.107424649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:27.485798162 +0000 UTC m=+22.623549474" watchObservedRunningTime="2026-09-07 11:47:27.486445764 +0000 UTC m=+22.624197075"
Sep 07 11:47:27.488174 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:27.488154    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 11:47:28.354403 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:28.354225    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T11:47:27.488170121Z","UUID":"9a4a1359-0ca0-43bb-a280-8b56183b3ab9","Handler":null,"Name":"","Endpoint":""}
Sep 07 11:47:28.356221 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:28.356194    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 11:47:28.356366 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:28.356233    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 11:47:28.479912 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:28.479878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd" event={"ID":"cf3eab6e-bbfc-4678-a76a-112af2e02a38","Type":"ContainerStarted","Data":"843456960b0afe0638e77cb3362d3b1224c1d15b271df8ca344726eeefc5e544"}
Sep 07 11:47:29.353333 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:29.353302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:29.353518 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:29.353357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:29.353518 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:29.353302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:29.353518 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:29.353440    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:29.353518 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:29.353504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:29.353735 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:29.353582    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:29.484747 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:29.484708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd" event={"ID":"cf3eab6e-bbfc-4678-a76a-112af2e02a38","Type":"ContainerStarted","Data":"bcb395c47e2ec4b7befca90b2571d525d42aa3a91cb4fe90480fcbecd81825e6"}
Sep 07 11:47:29.488708 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:29.488683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"752f4ab190a24c913b300dd343f530d20edd76bb59f5944f02f8fadc234fe9f9"}
Sep 07 11:47:29.507358 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:29.507302    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7hkd" podStartSLOduration=3.154720733 podStartE2EDuration="23.507290019s" totalImagesPullingTime="20.352569286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:29.507150366 +0000 UTC m=+24.644901676" watchObservedRunningTime="2026-09-07 11:47:29.507290019 +0000 UTC m=+24.645041331"
Sep 07 11:47:31.027574 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.027380    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:31.028450 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.028431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:31.353200 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.353096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:31.353200 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.353103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:31.353533 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.353213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:31.353533 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:31.353218    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:31.353533 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:31.353291    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:31.353533 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:31.353371    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:31.501888 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.501822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" event={"ID":"3a6e1ea1-cbd3-41e0-8a5d-025230016a9d","Type":"ContainerStarted","Data":"9bc853967b441d324375aa91102afdcdb1edba15d41dedceab583868e5974bd6"}
Sep 07 11:47:31.501988 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.501907    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:31.502402 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.502385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vmzt4"
Sep 07 11:47:31.528240 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:31.528202    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l" podStartSLOduration=6.8734788 podStartE2EDuration="25.528187918s" totalImagesPullingTime="18.654709118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:31.526439669 +0000 UTC m=+26.664190981" watchObservedRunningTime="2026-09-07 11:47:31.528187918 +0000 UTC m=+26.665939229"
Sep 07 11:47:32.506712 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.506510    2560 generic.go:356] "Generic (PLEG): container finished" podID="73337008-191e-4f5b-af2d-78d7a15904d3" containerID="eca28f0b0b22fa2a84e6dc71bef5df4b2d5993c0823a0f91268b4d7b302c4517" exitCode=0
Sep 07 11:47:32.507278 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.506609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerDied","Data":"eca28f0b0b22fa2a84e6dc71bef5df4b2d5993c0823a0f91268b4d7b302c4517"}
Sep 07 11:47:32.508049 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.507539    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:32.509330 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.509206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:32.509420 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.509389    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:32.531483 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.531450    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:32.531802 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:32.531785    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:47:33.183207 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:33.183178    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2pg2r"]
Sep 07 11:47:33.183440 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:33.183307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:33.183492 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:33.183432    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:33.185780 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:33.185751    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cn97r"]
Sep 07 11:47:33.185933 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:33.185859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:33.186002 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:33.185971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:33.186322 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:33.186301    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzsd2"]
Sep 07 11:47:33.186429 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:33.186395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:33.186498 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:33.186459    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:34.353455 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:34.353425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:34.354049 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:34.353524    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:34.354049 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:34.353577    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:34.354049 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:34.353657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:34.513108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:34.513074    2560 generic.go:356] "Generic (PLEG): container finished" podID="73337008-191e-4f5b-af2d-78d7a15904d3" containerID="0c7c45d14bb567d8b8cf81eb720b074ca8d9ab8517901d6f20987338bfcf4bcb" exitCode=0
Sep 07 11:47:34.513275 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:34.513148    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerDied","Data":"0c7c45d14bb567d8b8cf81eb720b074ca8d9ab8517901d6f20987338bfcf4bcb"}
Sep 07 11:47:35.354295 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:35.354269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:35.354794 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:35.354390    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:35.517912 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:35.517877    2560 generic.go:356] "Generic (PLEG): container finished" podID="73337008-191e-4f5b-af2d-78d7a15904d3" containerID="15bf514adc90409229a461802f2578a4541d304fd60df1cc1fcb5552967cadb0" exitCode=0
Sep 07 11:47:35.518068 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:35.517946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerDied","Data":"15bf514adc90409229a461802f2578a4541d304fd60df1cc1fcb5552967cadb0"}
Sep 07 11:47:36.352965 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:36.352945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:36.353090 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:36.353029    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:36.353140 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:36.353088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:36.353196 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:36.353179    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:37.353324 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:37.353294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:37.353760 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:37.353455    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzsd2" podUID="143741c1-926c-4aa7-bc16-798a7755855e"
Sep 07 11:47:38.352981 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:38.352946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:38.352981 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:38.352965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:38.353312 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:38.353087    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:47:38.353312 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:38.353192    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cn97r" podUID="6cbf1aed-8067-4d5a-9df0-c7601d3410a8"
Sep 07 11:47:39.048629 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.048537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:39.048629 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.048605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:39.048877 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.048703    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:39.048877 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.048712    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 11:47:39.048877 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.048741    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 11:47:39.048877 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.048754    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jnlwn for pod openshift-network-diagnostics/network-check-target-cn97r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:39.048877 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.048766    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret podName:143741c1-926c-4aa7-bc16-798a7755855e nodeName:}" failed. No retries permitted until 2026-09-07 11:48:11.048747069 +0000 UTC m=+66.186498358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret") pod "global-pull-secret-syncer-gzsd2" (UID: "143741c1-926c-4aa7-bc16-798a7755855e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 11:47:39.048877 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.048798    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn podName:6cbf1aed-8067-4d5a-9df0-c7601d3410a8 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:11.048784304 +0000 UTC m=+66.186535609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnlwn" (UniqueName: "kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn") pod "network-check-target-cn97r" (UID: "6cbf1aed-8067-4d5a-9df0-c7601d3410a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 11:47:39.149827 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.149792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:39.150014 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.149971    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:39.150082 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.150054    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:48:11.150031689 +0000 UTC m=+66.287782999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 11:47:39.169355 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.169313    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeReady"
Sep 07 11:47:39.169508 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.169484    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 11:47:39.202080 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.202052    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-768565d46-5bngs"]
Sep 07 11:47:39.217665 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.217624    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-74krb"]
Sep 07 11:47:39.217948 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.217926    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.221560 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.221531    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 11:47:39.222186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.221840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 11:47:39.222186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.221851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 11:47:39.222186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.222081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6v9dx\""
Sep 07 11:47:39.227721 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.227694    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 11:47:39.237571 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.236536    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-74krb"]
Sep 07 11:47:39.237571 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.236593    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768565d46-5bngs"]
Sep 07 11:47:39.237571 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.236619    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvqpd"]
Sep 07 11:47:39.237571 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.237047    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.240441 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.240406    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 07 11:47:39.240557 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.240524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 07 11:47:39.240614 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.240579    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dqvkp\""
Sep 07 11:47:39.252637 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.252611    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qglkr"]
Sep 07 11:47:39.252762 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.252730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.256121 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.256104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kd29r\""
Sep 07 11:47:39.256121 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.256104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 11:47:39.256620 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.256572    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 11:47:39.272747 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.272712    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qglkr"]
Sep 07 11:47:39.272840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.272761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvqpd"]
Sep 07 11:47:39.272840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.272834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.275980 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.275961    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 11:47:39.276375 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.276327    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7tkzl\""
Sep 07 11:47:39.276491 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.276361    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 11:47:39.276583 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.276386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 11:47:39.351694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-trusted-ca\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-certificates\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-config-volume\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-bound-sa-token\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68n9c\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-kube-api-access-68n9c\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fa5a7e1-e148-4ec9-9da2-9549e4100826-cert\") pod \"ingress-canary-qglkr\" (UID: \"6fa5a7e1-e148-4ec9-9da2-9549e4100826\") " pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e198839-97a7-48df-b13e-3f2f216bff60-nginx-conf\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-image-registry-private-configuration\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faca0ff3-97d4-4c25-854e-6e5690bcae41-ca-trust-extracted\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75q9h\" (UniqueName: \"kubernetes.io/projected/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-kube-api-access-75q9h\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.351977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-tmp-dir\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.352540 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.351992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8n89\" (UniqueName: \"kubernetes.io/projected/6fa5a7e1-e148-4ec9-9da2-9549e4100826-kube-api-access-v8n89\") pod \"ingress-canary-qglkr\" (UID: \"6fa5a7e1-e148-4ec9-9da2-9549e4100826\") " pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.352540 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.352008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-installation-pull-secrets\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.353797 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.353763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:47:39.356538 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.356519    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 11:47:39.453061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-trusted-ca\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-certificates\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-config-volume\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.453259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-bound-sa-token\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68n9c\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-kube-api-access-68n9c\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fa5a7e1-e148-4ec9-9da2-9549e4100826-cert\") pod \"ingress-canary-qglkr\" (UID: \"6fa5a7e1-e148-4ec9-9da2-9549e4100826\") " pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.453259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e198839-97a7-48df-b13e-3f2f216bff60-nginx-conf\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-image-registry-private-configuration\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faca0ff3-97d4-4c25-854e-6e5690bcae41-ca-trust-extracted\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75q9h\" (UniqueName: \"kubernetes.io/projected/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-kube-api-access-75q9h\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-tmp-dir\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453499    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8n89\" (UniqueName: \"kubernetes.io/projected/6fa5a7e1-e148-4ec9-9da2-9549e4100826-kube-api-access-v8n89\") pod \"ingress-canary-qglkr\" (UID: \"6fa5a7e1-e148-4ec9-9da2-9549e4100826\") " pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.453594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-installation-pull-secrets\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.454040 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.453730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-certificates\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.454040 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.453823    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:47:39.454040 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.453871    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:39.95385727 +0000 UTC m=+35.091608565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:47:39.454193 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.454059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-trusted-ca\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.454193 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.454082    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:47:39.454193 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.454097    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:47:39.454193 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.454153    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:39.954136913 +0000 UTC m=+35.091888222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:47:39.454416 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.454210    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:47:39.454416 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.454246    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:39.954233869 +0000 UTC m=+35.091985180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:47:39.454755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.454538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-tmp-dir\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.454755 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.454583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faca0ff3-97d4-4c25-854e-6e5690bcae41-ca-trust-extracted\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.454887 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.454780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e198839-97a7-48df-b13e-3f2f216bff60-nginx-conf\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.455025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.455003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-config-volume\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.458186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.458161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-image-registry-private-configuration\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.458358 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.458168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-installation-pull-secrets\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.458358 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.458170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fa5a7e1-e148-4ec9-9da2-9549e4100826-cert\") pod \"ingress-canary-qglkr\" (UID: \"6fa5a7e1-e148-4ec9-9da2-9549e4100826\") " pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.463433 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.463003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75q9h\" (UniqueName: \"kubernetes.io/projected/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-kube-api-access-75q9h\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:39.463539 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.463511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8n89\" (UniqueName: \"kubernetes.io/projected/6fa5a7e1-e148-4ec9-9da2-9549e4100826-kube-api-access-v8n89\") pod \"ingress-canary-qglkr\" (UID: \"6fa5a7e1-e148-4ec9-9da2-9549e4100826\") " pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.464090 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.464051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-bound-sa-token\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.464473 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.464424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68n9c\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-kube-api-access-68n9c\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.583000 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.582968    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qglkr"
Sep 07 11:47:39.957634 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.957535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:39.957634 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.957588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:39.957859 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957711    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:47:39.957859 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957790    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:47:39.957859 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957792    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:40.957769352 +0000 UTC m=+36.095520642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:47:39.957859 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957837    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:47:39.957859 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957861    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:40.957845564 +0000 UTC m=+36.095596854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:47:39.958150 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957862    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:47:39.958150 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:39.957894    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:40.957888215 +0000 UTC m=+36.095639503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:47:39.958150 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:39.957715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:40.352852 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.352826    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:47:40.353036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.353013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:47:40.357408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.357332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gtblx\""
Sep 07 11:47:40.357408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.357381    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2v7c7\""
Sep 07 11:47:40.357796 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.357377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 11:47:40.357796 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.357620    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 11:47:40.357796 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.357709    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 11:47:40.777632 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.777432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qglkr"]
Sep 07 11:47:40.782191 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:47:40.782159    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa5a7e1_e148_4ec9_9da2_9549e4100826.slice/crio-12f1ee7527abca741e25d599a7a33952ab0ddca7d0449f0f6ae30e1a16ef3305 WatchSource:0}: Error finding container 12f1ee7527abca741e25d599a7a33952ab0ddca7d0449f0f6ae30e1a16ef3305: Status 404 returned error can't find the container with id 12f1ee7527abca741e25d599a7a33952ab0ddca7d0449f0f6ae30e1a16ef3305
Sep 07 11:47:40.967740 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.967703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:40.967740 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.967739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:40.967764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967854    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967859    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967899    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:42.967884797 +0000 UTC m=+38.105636090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967860    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967911    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:42.967905264 +0000 UTC m=+38.105656553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967913    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:47:40.967942 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:40.967942    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:42.967929572 +0000 UTC m=+38.105680866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:47:41.531488 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:41.531450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qglkr" event={"ID":"6fa5a7e1-e148-4ec9-9da2-9549e4100826","Type":"ContainerStarted","Data":"12f1ee7527abca741e25d599a7a33952ab0ddca7d0449f0f6ae30e1a16ef3305"}
Sep 07 11:47:41.534055 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:41.534027    2560 generic.go:356] "Generic (PLEG): container finished" podID="73337008-191e-4f5b-af2d-78d7a15904d3" containerID="1e5c1660e6b7f49f2214ddabc39a90fe0ec24809596bc0789f0c279d04f598d1" exitCode=0
Sep 07 11:47:41.534175 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:41.534076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerDied","Data":"1e5c1660e6b7f49f2214ddabc39a90fe0ec24809596bc0789f0c279d04f598d1"}
Sep 07 11:47:42.540508 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:42.540476    2560 generic.go:356] "Generic (PLEG): container finished" podID="73337008-191e-4f5b-af2d-78d7a15904d3" containerID="0c8b54ebc5387173560ffff03e632ba25a0040e56fc2cfe650bd1bd4f511049e" exitCode=0
Sep 07 11:47:42.541329 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:42.540543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerDied","Data":"0c8b54ebc5387173560ffff03e632ba25a0040e56fc2cfe650bd1bd4f511049e"}
Sep 07 11:47:42.984330 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:42.984295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:42.984330 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:42.984335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:42.984585 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:42.984385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:42.984585 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984451    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:47:42.984585 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984517    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:46.984499477 +0000 UTC m=+42.122250785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:47:42.984585 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984519    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:47:42.984585 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984555    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:46.984545131 +0000 UTC m=+42.122296424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:47:42.984838 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984593    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:47:42.984838 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984617    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:47:42.984838 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:42.984681    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:46.984661335 +0000 UTC m=+42.122412640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:47:43.547420 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:43.547378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" event={"ID":"73337008-191e-4f5b-af2d-78d7a15904d3","Type":"ContainerStarted","Data":"8c9a2f6be89b9a4cd952a0c65293473da857f27428ed6a71ad4beaecf3092e7e"}
Sep 07 11:47:43.572104 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:43.572053    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wpnfg" podStartSLOduration=6.824195833 podStartE2EDuration="37.572032606s" totalImagesPullingTime="30.747836773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:43.570069105 +0000 UTC m=+38.707820417" watchObservedRunningTime="2026-09-07 11:47:43.572032606 +0000 UTC m=+38.709783920"
Sep 07 11:47:44.551125 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:44.551085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qglkr" event={"ID":"6fa5a7e1-e148-4ec9-9da2-9549e4100826","Type":"ContainerStarted","Data":"e0139db9a26cd572349a9caaa2152330fd78af3ef00682ee5a9b4835a1fb51c5"}
Sep 07 11:47:44.566734 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:44.566690    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qglkr" podStartSLOduration=2.249915917 podStartE2EDuration="5.56667395s" totalImagesPullingTime="3.316758033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:47:44.566357837 +0000 UTC m=+39.704109140" watchObservedRunningTime="2026-09-07 11:47:44.56667395 +0000 UTC m=+39.704425260"
Sep 07 11:47:47.015194 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:47.015149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:47.015194 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:47.015196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:47.015223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015320    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015336    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015361    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015317    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015405    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:55.015392896 +0000 UTC m=+50.153144185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015417    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:55.015411536 +0000 UTC m=+50.153162825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:47:47.015645 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:47.015427    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:47:55.015421845 +0000 UTC m=+50.153173134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:47:55.075584 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:55.075542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:47:55.075584 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:55.075586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:47:55.075612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075727    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075752    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075770    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075773    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075812    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:11.07579389 +0000 UTC m=+66.213545178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075838    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:11.075818131 +0000 UTC m=+66.213569424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:47:55.076111 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:47:55.075858    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:11.075848265 +0000 UTC m=+66.213599555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:48:04.522983 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:04.522951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc59l"
Sep 07 11:48:11.092714 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.092664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.092759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.092792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.092822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.092912    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.092927    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.092931    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.092980    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:43.092961606 +0000 UTC m=+98.230712897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.092996    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:43.092988303 +0000 UTC m=+98.230739592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.092974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.093040    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:48:11.093211 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.093097    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:48:43.093080383 +0000 UTC m=+98.230831671 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:48:11.095567 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.095533    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 11:48:11.095567 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.095540    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 11:48:11.105718 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.105700    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 11:48:11.106704 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.106685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143741c1-926c-4aa7-bc16-798a7755855e-original-pull-secret\") pod \"global-pull-secret-syncer-gzsd2\" (UID: \"143741c1-926c-4aa7-bc16-798a7755855e\") " pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:48:11.116607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.116587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnlwn\" (UniqueName: \"kubernetes.io/projected/6cbf1aed-8067-4d5a-9df0-c7601d3410a8-kube-api-access-jnlwn\") pod \"network-check-target-cn97r\" (UID: \"6cbf1aed-8067-4d5a-9df0-c7601d3410a8\") " pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:48:11.163471 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.163444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzsd2"
Sep 07 11:48:11.193457 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.193427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:48:11.196060 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.196043    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 11:48:11.203995 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.203972    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 11:48:11.204112 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:11.204067    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:49:15.204044695 +0000 UTC m=+130.341795998 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : secret "metrics-daemon-secret" not found
Sep 07 11:48:11.268419 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.268388    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2v7c7\""
Sep 07 11:48:11.276424 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.276405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:48:11.431402 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.431374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzsd2"]
Sep 07 11:48:11.433828 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:48:11.433803    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143741c1_926c_4aa7_bc16_798a7755855e.slice/crio-fd44f07cadd26053a1a9eec44da8ab4575e9bd0cf987561b4a13a1f54f6c93f1 WatchSource:0}: Error finding container fd44f07cadd26053a1a9eec44da8ab4575e9bd0cf987561b4a13a1f54f6c93f1: Status 404 returned error can't find the container with id fd44f07cadd26053a1a9eec44da8ab4575e9bd0cf987561b4a13a1f54f6c93f1
Sep 07 11:48:11.539040 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.538862    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cn97r"]
Sep 07 11:48:11.541292 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:48:11.541261    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbf1aed_8067_4d5a_9df0_c7601d3410a8.slice/crio-255ac8192bfed8636f439d2f88d15e9fd3b5eb5d6fe3ef5f8a252e9377b79f25 WatchSource:0}: Error finding container 255ac8192bfed8636f439d2f88d15e9fd3b5eb5d6fe3ef5f8a252e9377b79f25: Status 404 returned error can't find the container with id 255ac8192bfed8636f439d2f88d15e9fd3b5eb5d6fe3ef5f8a252e9377b79f25
Sep 07 11:48:11.612017 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.611985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cn97r" event={"ID":"6cbf1aed-8067-4d5a-9df0-c7601d3410a8","Type":"ContainerStarted","Data":"255ac8192bfed8636f439d2f88d15e9fd3b5eb5d6fe3ef5f8a252e9377b79f25"}
Sep 07 11:48:11.613096 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:11.613065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzsd2" event={"ID":"143741c1-926c-4aa7-bc16-798a7755855e","Type":"ContainerStarted","Data":"fd44f07cadd26053a1a9eec44da8ab4575e9bd0cf987561b4a13a1f54f6c93f1"}
Sep 07 11:48:16.629081 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:16.629045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cn97r" event={"ID":"6cbf1aed-8067-4d5a-9df0-c7601d3410a8","Type":"ContainerStarted","Data":"e078bab12b33d42e9446605275ef188f4f9f0c07599595ffaa9899c821427aa3"}
Sep 07 11:48:16.629546 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:16.629167    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:48:16.630653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:16.630627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzsd2" event={"ID":"143741c1-926c-4aa7-bc16-798a7755855e","Type":"ContainerStarted","Data":"c4af4fc62ec6b300dd563c055ba188daa655e5ec5818b84ecd4335fed41a3fb0"}
Sep 07 11:48:16.646603 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:16.646560    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cn97r" podStartSLOduration=65.868737675 podStartE2EDuration="1m10.646545928s" totalImagesPullingTime="4.777808253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:48:16.645677939 +0000 UTC m=+71.783429250" watchObservedRunningTime="2026-09-07 11:48:16.646545928 +0000 UTC m=+71.784297239"
Sep 07 11:48:16.659961 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:16.659909    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gzsd2" podStartSLOduration=65.763351326 podStartE2EDuration="1m10.659893427s" totalImagesPullingTime="4.896542101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:48:16.659800587 +0000 UTC m=+71.797551899" watchObservedRunningTime="2026-09-07 11:48:16.659893427 +0000 UTC m=+71.797644739"
Sep 07 11:48:43.121144 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:43.121104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:43.121152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:43.121235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121267    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121285    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121316    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121370    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:49:47.121335004 +0000 UTC m=+162.259086296 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121321    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121410    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:49:47.121390492 +0000 UTC m=+162.259141800 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:48:43.121639 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:48:43.121448    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:49:47.12143647 +0000 UTC m=+162.259187776 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:48:47.635247 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:48:47.635213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cn97r"
Sep 07 11:49:15.248953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:15.248893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:49:15.249471 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:15.249059    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 11:49:15.249471 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:15.249134    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:17.249117261 +0000 UTC m=+252.386868550 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : secret "metrics-daemon-secret" not found
Sep 07 11:49:42.231168 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:42.231107    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-768565d46-5bngs" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41"
Sep 07 11:49:42.247390 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:42.247366    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb" podUID="5e198839-97a7-48df-b13e-3f2f216bff60"
Sep 07 11:49:42.265718 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:42.263159    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvqpd" podUID="d4ec4b8f-28d1-4159-968f-b8c6f7265c34"
Sep 07 11:49:42.843638 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:42.843606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:49:42.843778 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:42.843622    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:49:43.370984 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:43.370948    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:49:47.175067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:47.175027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:49:47.175067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:47.175068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:47.175095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175182    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175194    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175218    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768565d46-5bngs: secret "image-registry-tls" not found
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175227    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls podName:d4ec4b8f-28d1-4159-968f-b8c6f7265c34 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:49.175214217 +0000 UTC m=+284.312965505 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls") pod "dns-default-gvqpd" (UID: "d4ec4b8f-28d1-4159-968f-b8c6f7265c34") : secret "dns-default-metrics-tls" not found
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175269    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls podName:faca0ff3-97d4-4c25-854e-6e5690bcae41 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:49.175255683 +0000 UTC m=+284.313006977 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls") pod "image-registry-768565d46-5bngs" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41") : secret "image-registry-tls" not found
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175190    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 07 11:49:47.175570 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:49:47.175314    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert podName:5e198839-97a7-48df-b13e-3f2f216bff60 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:49.175303538 +0000 UTC m=+284.313054850 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-74krb" (UID: "5e198839-97a7-48df-b13e-3f2f216bff60") : secret "networking-console-plugin-cert" not found
Sep 07 11:49:55.353773 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:55.353732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:49:56.353330 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:49:56.353280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:51:17.321985 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:17.321927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:51:17.322537 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:17.322096    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 11:51:17.322537 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:17.322164    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs podName:38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c nodeName:}" failed. No retries permitted until 2026-09-07 11:53:19.322147725 +0000 UTC m=+374.459899013 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs") pod "network-metrics-daemon-2pg2r" (UID: "38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c") : secret "metrics-daemon-secret" not found
Sep 07 11:51:25.197292 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.197259    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"]
Sep 07 11:51:25.199839 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.199817    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"]
Sep 07 11:51:25.199951 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.199937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.202211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.202191    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"]
Sep 07 11:51:25.202361 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.202326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.202794 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.202777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 07 11:51:25.202882 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.202805    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 07 11:51:25.202882 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.202854    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 07 11:51:25.203267 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.203248    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8tztn\""
Sep 07 11:51:25.204190 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.204176    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 07 11:51:25.204873 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.204855    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.206920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.206903    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 11:51:25.208542 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 11:51:25.208623 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 07 11:51:25.208623 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208548    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6zzgd\""
Sep 07 11:51:25.208720 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208713    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 07 11:51:25.208899 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208779    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 07 11:51:25.208899 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208792    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q8kbs\""
Sep 07 11:51:25.208899 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208819    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 07 11:51:25.208899 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.208822    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 07 11:51:25.215862 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.215844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"]
Sep 07 11:51:25.222579 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.222560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"]
Sep 07 11:51:25.223199 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.223181    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"]
Sep 07 11:51:25.281333 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e429c41e-8a91-41a3-961d-79c41b75df6e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.281458 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.281458 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.281458 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml4kn\" (UniqueName: \"kubernetes.io/projected/e429c41e-8a91-41a3-961d-79c41b75df6e-kube-api-access-ml4kn\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.281561 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xff6l\" (UniqueName: \"kubernetes.io/projected/9adc86a4-2acb-48f6-86af-21e945541b83-kube-api-access-xff6l\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.281561 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eeedb772-4594-4a22-bb4f-8b766d74b52e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.281561 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmxw\" (UniqueName: \"kubernetes.io/projected/eeedb772-4594-4a22-bb4f-8b766d74b52e-kube-api-access-wpmxw\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.281648 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.281574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e429c41e-8a91-41a3-961d-79c41b75df6e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.291173 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.291148    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"]
Sep 07 11:51:25.293859 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.293845    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.296281 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.296262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 07 11:51:25.296607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.296593    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 07 11:51:25.296667 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.296594    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kdkfg\""
Sep 07 11:51:25.296667 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.296651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 07 11:51:25.297049 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.297034    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 07 11:51:25.298763 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.298744    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f55cf46dd-927gj"]
Sep 07 11:51:25.301265 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.301248    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.304138 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304112    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 11:51:25.304436 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304416    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 07 11:51:25.304555 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304535    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 07 11:51:25.304669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304577    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rh28r\""
Sep 07 11:51:25.304669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304529    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 07 11:51:25.304795 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 07 11:51:25.304795 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304679    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 11:51:25.304940 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.304842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"]
Sep 07 11:51:25.315734 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.315715    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f55cf46dd-927gj"]
Sep 07 11:51:25.381835 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.381809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml4kn\" (UniqueName: \"kubernetes.io/projected/e429c41e-8a91-41a3-961d-79c41b75df6e-kube-api-access-ml4kn\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.381947 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.381845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-config\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.381947 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.381869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.381947 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.381895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.381947 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.381921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h5xd\" (UniqueName: \"kubernetes.io/projected/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-kube-api-access-2h5xd\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.382151 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.381995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhgbm\" (UniqueName: \"kubernetes.io/projected/7235ec47-e695-43e9-8166-b826e9a950f3-kube-api-access-dhgbm\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.382151 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.382015    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 11:51:25.382151 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-serving-cert\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.382151 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.382077    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls podName:9adc86a4-2acb-48f6-86af-21e945541b83 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:25.882058328 +0000 UTC m=+261.019809640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5qlfm" (UID: "9adc86a4-2acb-48f6-86af-21e945541b83") : secret "samples-operator-tls" not found
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmxw\" (UniqueName: \"kubernetes.io/projected/eeedb772-4594-4a22-bb4f-8b766d74b52e-kube-api-access-wpmxw\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-stats-auth\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-default-certificate\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xff6l\" (UniqueName: \"kubernetes.io/projected/9adc86a4-2acb-48f6-86af-21e945541b83-kube-api-access-xff6l\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.382359    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eeedb772-4594-4a22-bb4f-8b766d74b52e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.382406 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.382412    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls podName:eeedb772-4594-4a22-bb4f-8b766d74b52e nodeName:}" failed. No retries permitted until 2026-09-07 11:51:25.882400226 +0000 UTC m=+261.020151519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ldq2c" (UID: "eeedb772-4594-4a22-bb4f-8b766d74b52e") : secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:25.382785 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.382785 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e429c41e-8a91-41a3-961d-79c41b75df6e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.382785 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.382529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e429c41e-8a91-41a3-961d-79c41b75df6e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.383030 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.383005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e429c41e-8a91-41a3-961d-79c41b75df6e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.383125 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.383027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eeedb772-4594-4a22-bb4f-8b766d74b52e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.384973 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.384953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e429c41e-8a91-41a3-961d-79c41b75df6e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.390428 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.390405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml4kn\" (UniqueName: \"kubernetes.io/projected/e429c41e-8a91-41a3-961d-79c41b75df6e-kube-api-access-ml4kn\") pod \"kube-storage-version-migrator-operator-8d7dd4675-c9x4g\" (UID: \"e429c41e-8a91-41a3-961d-79c41b75df6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.390534 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.390517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmxw\" (UniqueName: \"kubernetes.io/projected/eeedb772-4594-4a22-bb4f-8b766d74b52e-kube-api-access-wpmxw\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.390769 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.390752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xff6l\" (UniqueName: \"kubernetes.io/projected/9adc86a4-2acb-48f6-86af-21e945541b83-kube-api-access-xff6l\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.483255 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-default-certificate\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.483255 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.483436 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-config\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.483436 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.483436 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h5xd\" (UniqueName: \"kubernetes.io/projected/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-kube-api-access-2h5xd\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.483436 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.483390    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 11:51:25.483597 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.483450    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:25.983424259 +0000 UTC m=+261.121175548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : configmap references non-existent config key: service-ca.crt
Sep 07 11:51:25.483597 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.483476    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:25.983464988 +0000 UTC m=+261.121216277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : secret "router-metrics-certs-default" not found
Sep 07 11:51:25.483597 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhgbm\" (UniqueName: \"kubernetes.io/projected/7235ec47-e695-43e9-8166-b826e9a950f3-kube-api-access-dhgbm\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.483597 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-serving-cert\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.483786 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-stats-auth\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.484002 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.483960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-config\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.485576 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.485554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-default-certificate\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.485650 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.485592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-serving-cert\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.485650 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.485619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-stats-auth\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.502491 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.502469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h5xd\" (UniqueName: \"kubernetes.io/projected/7fcb7cfc-9e33-4b22-82f5-9db62a613f19-kube-api-access-2h5xd\") pod \"service-ca-operator-859f94c4b-p6wps\" (UID: \"7fcb7cfc-9e33-4b22-82f5-9db62a613f19\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.502720 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.502704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhgbm\" (UniqueName: \"kubernetes.io/projected/7235ec47-e695-43e9-8166-b826e9a950f3-kube-api-access-dhgbm\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.509921 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.509903    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"
Sep 07 11:51:25.602572 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.602548    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"
Sep 07 11:51:25.773458 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.773334    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g"]
Sep 07 11:51:25.775976 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:25.775948    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode429c41e_8a91_41a3_961d_79c41b75df6e.slice/crio-bf99e33f810d751c717f45e2bc52a52d77f0653db188cc32baddc51cd2809c3d WatchSource:0}: Error finding container bf99e33f810d751c717f45e2bc52a52d77f0653db188cc32baddc51cd2809c3d: Status 404 returned error can't find the container with id bf99e33f810d751c717f45e2bc52a52d77f0653db188cc32baddc51cd2809c3d
Sep 07 11:51:25.865377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.865229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps"]
Sep 07 11:51:25.868554 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:25.868530    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcb7cfc_9e33_4b22_82f5_9db62a613f19.slice/crio-057e415ae9a105d9e2c23e244509ad6d5e85f2ade1d1dd0805674536cc7a7bcb WatchSource:0}: Error finding container 057e415ae9a105d9e2c23e244509ad6d5e85f2ade1d1dd0805674536cc7a7bcb: Status 404 returned error can't find the container with id 057e415ae9a105d9e2c23e244509ad6d5e85f2ade1d1dd0805674536cc7a7bcb
Sep 07 11:51:25.886974 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.886949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:25.887087 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.887064    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:25.887150 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.887111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:25.887190 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.887152    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls podName:eeedb772-4594-4a22-bb4f-8b766d74b52e nodeName:}" failed. No retries permitted until 2026-09-07 11:51:26.887126927 +0000 UTC m=+262.024878220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ldq2c" (UID: "eeedb772-4594-4a22-bb4f-8b766d74b52e") : secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:25.887233 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.887191    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 11:51:25.887273 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.887245    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls podName:9adc86a4-2acb-48f6-86af-21e945541b83 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:26.887227892 +0000 UTC m=+262.024979196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5qlfm" (UID: "9adc86a4-2acb-48f6-86af-21e945541b83") : secret "samples-operator-tls" not found
Sep 07 11:51:25.987984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.987950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.988138 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:25.988084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:25.988138 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.988105    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:26.988089445 +0000 UTC m=+262.125840747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : configmap references non-existent config key: service-ca.crt
Sep 07 11:51:25.988262 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.988174    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 11:51:25.988262 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:25.988230    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:26.988213703 +0000 UTC m=+262.125965009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : secret "router-metrics-certs-default" not found
Sep 07 11:51:26.081027 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:26.080954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g" event={"ID":"e429c41e-8a91-41a3-961d-79c41b75df6e","Type":"ContainerStarted","Data":"bf99e33f810d751c717f45e2bc52a52d77f0653db188cc32baddc51cd2809c3d"}
Sep 07 11:51:26.082051 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:26.082031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps" event={"ID":"7fcb7cfc-9e33-4b22-82f5-9db62a613f19","Type":"ContainerStarted","Data":"057e415ae9a105d9e2c23e244509ad6d5e85f2ade1d1dd0805674536cc7a7bcb"}
Sep 07 11:51:26.896400 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:26.896361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:26.896853 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.896538    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:26.896853 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:26.896566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:26.896853 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.896614    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls podName:eeedb772-4594-4a22-bb4f-8b766d74b52e nodeName:}" failed. No retries permitted until 2026-09-07 11:51:28.896593213 +0000 UTC m=+264.034344524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ldq2c" (UID: "eeedb772-4594-4a22-bb4f-8b766d74b52e") : secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:26.896853 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.896689    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 11:51:26.896853 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.896748    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls podName:9adc86a4-2acb-48f6-86af-21e945541b83 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:28.896733633 +0000 UTC m=+264.034484925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5qlfm" (UID: "9adc86a4-2acb-48f6-86af-21e945541b83") : secret "samples-operator-tls" not found
Sep 07 11:51:26.997696 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:26.997380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:26.997696 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:26.997512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:26.997696 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.997573    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:28.997553055 +0000 UTC m=+264.135304366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : configmap references non-existent config key: service-ca.crt
Sep 07 11:51:26.997696 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.997626    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 11:51:26.997696 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:26.997672    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:28.997660332 +0000 UTC m=+264.135411622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : secret "router-metrics-certs-default" not found
Sep 07 11:51:28.089189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:28.089157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps" event={"ID":"7fcb7cfc-9e33-4b22-82f5-9db62a613f19","Type":"ContainerStarted","Data":"8c07347db7bb07d565e6ec9a37de2584000f5ac25996bf70135b28992ace00eb"}
Sep 07 11:51:28.091974 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:28.091590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g" event={"ID":"e429c41e-8a91-41a3-961d-79c41b75df6e","Type":"ContainerStarted","Data":"2044f7e5e711ab9d8748feb80334288ba11920d5ab75e13bd382a541da17442e"}
Sep 07 11:51:28.105663 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:28.105614    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps" podStartSLOduration=1.04101268 podStartE2EDuration="3.10559273s" totalImagesPullingTime="2.06458005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:28.104079052 +0000 UTC m=+263.241830365" watchObservedRunningTime="2026-09-07 11:51:28.10559273 +0000 UTC m=+263.243344043"
Sep 07 11:51:28.122804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:28.122762    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g" podStartSLOduration=0.968445732 podStartE2EDuration="3.122749866s" totalImagesPullingTime="2.154304134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:28.122064073 +0000 UTC m=+263.259815384" watchObservedRunningTime="2026-09-07 11:51:28.122749866 +0000 UTC m=+263.260501176"
Sep 07 11:51:28.910687 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:28.910646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:28.910850 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:28.910742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:28.910850 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:28.910789    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:28.910850 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:28.910834    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 11:51:28.910986 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:28.910862    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls podName:eeedb772-4594-4a22-bb4f-8b766d74b52e nodeName:}" failed. No retries permitted until 2026-09-07 11:51:32.91084235 +0000 UTC m=+268.048593640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ldq2c" (UID: "eeedb772-4594-4a22-bb4f-8b766d74b52e") : secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:28.910986 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:28.910883    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls podName:9adc86a4-2acb-48f6-86af-21e945541b83 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:32.910873069 +0000 UTC m=+268.048624359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5qlfm" (UID: "9adc86a4-2acb-48f6-86af-21e945541b83") : secret "samples-operator-tls" not found
Sep 07 11:51:29.011556 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.011521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:29.011714 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.011591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:29.011714 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.011686    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 11:51:29.011799 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.011743    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:33.011730232 +0000 UTC m=+268.149481534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : configmap references non-existent config key: service-ca.crt
Sep 07 11:51:29.011799 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.011762    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:33.011754519 +0000 UTC m=+268.149505808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : secret "router-metrics-certs-default" not found
Sep 07 11:51:29.102592 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.102559    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"]
Sep 07 11:51:29.105958 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.105942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"
Sep 07 11:51:29.108521 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.108497    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 07 11:51:29.108786 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.108769    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 07 11:51:29.109545 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.109529    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7cvqb\""
Sep 07 11:51:29.113516 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.113497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"]
Sep 07 11:51:29.212807 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.212714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4lfh\" (UniqueName: \"kubernetes.io/projected/125b673a-f309-41cf-9aa8-eb3dd59d68df-kube-api-access-m4lfh\") pod \"migrator-fdbb8fdff-xsfrh\" (UID: \"125b673a-f309-41cf-9aa8-eb3dd59d68df\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"
Sep 07 11:51:29.314106 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.314061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4lfh\" (UniqueName: \"kubernetes.io/projected/125b673a-f309-41cf-9aa8-eb3dd59d68df-kube-api-access-m4lfh\") pod \"migrator-fdbb8fdff-xsfrh\" (UID: \"125b673a-f309-41cf-9aa8-eb3dd59d68df\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"
Sep 07 11:51:29.321912 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.321880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4lfh\" (UniqueName: \"kubernetes.io/projected/125b673a-f309-41cf-9aa8-eb3dd59d68df-kube-api-access-m4lfh\") pod \"migrator-fdbb8fdff-xsfrh\" (UID: \"125b673a-f309-41cf-9aa8-eb3dd59d68df\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"
Sep 07 11:51:29.415135 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.415108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"
Sep 07 11:51:29.422995 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.422973    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z5vkr"]
Sep 07 11:51:29.426208 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.426186    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.428929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.428709    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 11:51:29.428929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.428718    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 11:51:29.428929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.428747    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 11:51:29.428929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.428713    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vwz2b\""
Sep 07 11:51:29.428929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.428713    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 11:51:29.438756 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.438733    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5vkr"]
Sep 07 11:51:29.515893 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.515851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-data-volume\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.516031 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.515919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2s97\" (UniqueName: \"kubernetes.io/projected/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-api-access-m2s97\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.516031 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.515992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.516119 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.516042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.516119 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.516062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-crio-socket\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617504 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-crio-socket\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617504 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-data-volume\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617504 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.617447    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:29.617504 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2s97\" (UniqueName: \"kubernetes.io/projected/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-api-access-m2s97\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617504 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.617503    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:30.117488647 +0000 UTC m=+265.255239935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:29.617738 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-crio-socket\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617738 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.617738 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.617652    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 11:51:29.617738 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:29.617693    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:30.117681897 +0000 UTC m=+265.255433186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : configmap "kube-rbac-proxy" not found
Sep 07 11:51:29.617890 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.617824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-data-volume\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.627849 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.627827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2s97\" (UniqueName: \"kubernetes.io/projected/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-api-access-m2s97\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:29.682740 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:29.682711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh"]
Sep 07 11:51:29.685597 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:29.685567    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125b673a_f309_41cf_9aa8_eb3dd59d68df.slice/crio-006b9d38f800b4115b786a809a4fae08f3f2b14864df0ff76bc7905b025d3604 WatchSource:0}: Error finding container 006b9d38f800b4115b786a809a4fae08f3f2b14864df0ff76bc7905b025d3604: Status 404 returned error can't find the container with id 006b9d38f800b4115b786a809a4fae08f3f2b14864df0ff76bc7905b025d3604
Sep 07 11:51:30.098440 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:30.098403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh" event={"ID":"125b673a-f309-41cf-9aa8-eb3dd59d68df","Type":"ContainerStarted","Data":"006b9d38f800b4115b786a809a4fae08f3f2b14864df0ff76bc7905b025d3604"}
Sep 07 11:51:30.121968 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:30.121938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:30.122417 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:30.122007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:30.122417 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:30.122091    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 11:51:30.122417 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:30.122171    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:31.122150556 +0000 UTC m=+266.259901859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : configmap "kube-rbac-proxy" not found
Sep 07 11:51:30.122417 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:30.122172    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:30.122417 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:30.122246    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:31.122229004 +0000 UTC m=+266.259980309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:31.102884 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:31.102849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh" event={"ID":"125b673a-f309-41cf-9aa8-eb3dd59d68df","Type":"ContainerStarted","Data":"0b8d93b340a2a3e930c883767469451375d80d4c58d3212f4fad2c3e09f94886"}
Sep 07 11:51:31.103098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:31.102910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh" event={"ID":"125b673a-f309-41cf-9aa8-eb3dd59d68df","Type":"ContainerStarted","Data":"6f91949db1ed63ccfe7de29f598cf165e54a785055417bb87147f41920fed01e"}
Sep 07 11:51:31.117856 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:31.117806    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-xsfrh" podStartSLOduration=1.156482278 podStartE2EDuration="2.117793634s" totalImagesPullingTime="961.311356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:31.117581794 +0000 UTC m=+266.255333117" watchObservedRunningTime="2026-09-07 11:51:31.117793634 +0000 UTC m=+266.255544957"
Sep 07 11:51:31.131910 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:31.131880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:31.132235 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:31.131928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:31.132235 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:31.131986    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 11:51:31.132235 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:31.132039    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:33.132026231 +0000 UTC m=+268.269777525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : configmap "kube-rbac-proxy" not found
Sep 07 11:51:31.132235 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:31.132055    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:31.132235 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:31.132100    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:33.132089243 +0000 UTC m=+268.269840547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:32.403849 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:32.403821    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w5x8s_5bcbbe64-545e-4ab3-bf23-fc83244bfde3/dns-node-resolver/0.log"
Sep 07 11:51:32.944469 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:32.944426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:32.944658 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:32.944537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:32.944658 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:32.944570    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 11:51:32.944658 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:32.944629    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls podName:9adc86a4-2acb-48f6-86af-21e945541b83 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:40.944615693 +0000 UTC m=+276.082366991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-5qlfm" (UID: "9adc86a4-2acb-48f6-86af-21e945541b83") : secret "samples-operator-tls" not found
Sep 07 11:51:32.944799 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:32.944675    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:32.944799 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:32.944733    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls podName:eeedb772-4594-4a22-bb4f-8b766d74b52e nodeName:}" failed. No retries permitted until 2026-09-07 11:51:40.944719882 +0000 UTC m=+276.082471181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ldq2c" (UID: "eeedb772-4594-4a22-bb4f-8b766d74b52e") : secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:33.044910 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:33.044874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:33.045092 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.045023    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 11:51:33.045092 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:33.045034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:33.045092 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.045078    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:41.045064946 +0000 UTC m=+276.182816235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : secret "router-metrics-certs-default" not found
Sep 07 11:51:33.045234 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.045150    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle podName:7235ec47-e695-43e9-8166-b826e9a950f3 nodeName:}" failed. No retries permitted until 2026-09-07 11:51:41.045132041 +0000 UTC m=+276.182883349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle") pod "router-default-6f55cf46dd-927gj" (UID: "7235ec47-e695-43e9-8166-b826e9a950f3") : configmap references non-existent config key: service-ca.crt
Sep 07 11:51:33.146018 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:33.145989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:33.146149 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:33.146036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:33.146149 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.146099    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 11:51:33.146231 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.146155    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:37.146140382 +0000 UTC m=+272.283891671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : configmap "kube-rbac-proxy" not found
Sep 07 11:51:33.146231 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.146156    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:33.146231 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:33.146195    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:37.146184409 +0000 UTC m=+272.283935697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:33.201472 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:33.201422    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r5258_b9a433b1-a66c-40bd-a086-d4910afe958d/node-ca/0.log"
Sep 07 11:51:34.001911 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:34.001883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qglkr_6fa5a7e1-e148-4ec9-9da2-9549e4100826/serve-healthcheck-canary/0.log"
Sep 07 11:51:34.403207 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:34.403176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-xsfrh_125b673a-f309-41cf-9aa8-eb3dd59d68df/migrator/0.log"
Sep 07 11:51:34.602009 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:34.601983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-xsfrh_125b673a-f309-41cf-9aa8-eb3dd59d68df/graceful-termination/0.log"
Sep 07 11:51:34.803639 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:34.803560    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c9x4g_e429c41e-8a91-41a3-961d-79c41b75df6e/kube-storage-version-migrator-operator/0.log"
Sep 07 11:51:37.180412 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:37.180372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:37.180805 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:37.180445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:37.180805 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:37.180493    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 11:51:37.180805 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:37.180551    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:45.180535268 +0000 UTC m=+280.318286556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : configmap "kube-rbac-proxy" not found
Sep 07 11:51:37.180805 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:37.180590    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:37.180805 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:37.180653    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls podName:3dee941a-c72f-4a59-82c6-3baf53cbfe3c nodeName:}" failed. No retries permitted until 2026-09-07 11:51:45.180639029 +0000 UTC m=+280.318390320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vkr" (UID: "3dee941a-c72f-4a59-82c6-3baf53cbfe3c") : secret "insights-runtime-extractor-tls" not found
Sep 07 11:51:41.011193 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.011162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:41.011741 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.011323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:41.011741 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:41.011331    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:41.011741 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:41.011432    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls podName:eeedb772-4594-4a22-bb4f-8b766d74b52e nodeName:}" failed. No retries permitted until 2026-09-07 11:51:57.01141095 +0000 UTC m=+292.149162246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ldq2c" (UID: "eeedb772-4594-4a22-bb4f-8b766d74b52e") : secret "cluster-monitoring-operator-tls" not found
Sep 07 11:51:41.013608 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.013587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9adc86a4-2acb-48f6-86af-21e945541b83-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-5qlfm\" (UID: \"9adc86a4-2acb-48f6-86af-21e945541b83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:41.112717 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.112675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:41.112879 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.112784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:41.113298 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.113276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7235ec47-e695-43e9-8166-b826e9a950f3-service-ca-bundle\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:41.115010 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.114985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7235ec47-e695-43e9-8166-b826e9a950f3-metrics-certs\") pod \"router-default-6f55cf46dd-927gj\" (UID: \"7235ec47-e695-43e9-8166-b826e9a950f3\") " pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:41.121929 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.121910    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"
Sep 07 11:51:41.210731 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.210694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:41.393396 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.393154    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm"]
Sep 07 11:51:41.477333 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:41.477310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f55cf46dd-927gj"]
Sep 07 11:51:41.479135 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:41.479108    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7235ec47_e695_43e9_8166_b826e9a950f3.slice/crio-3e3184077c5f51304f420f89f325431f2638e630fb9f82c8c1cad957b7bb2e64 WatchSource:0}: Error finding container 3e3184077c5f51304f420f89f325431f2638e630fb9f82c8c1cad957b7bb2e64: Status 404 returned error can't find the container with id 3e3184077c5f51304f420f89f325431f2638e630fb9f82c8c1cad957b7bb2e64
Sep 07 11:51:42.137027 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:42.136987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm" event={"ID":"9adc86a4-2acb-48f6-86af-21e945541b83","Type":"ContainerStarted","Data":"5121f84e85ca51c89cffd18387280602395e35f86914e960233c3be108139d2a"}
Sep 07 11:51:42.139153 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:42.139128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f55cf46dd-927gj" event={"ID":"7235ec47-e695-43e9-8166-b826e9a950f3","Type":"ContainerStarted","Data":"900f7bada76876c79a429f21604add93aa0d1c4aacaa70c712fe35d0b6bb3638"}
Sep 07 11:51:42.139282 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:42.139171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f55cf46dd-927gj" event={"ID":"7235ec47-e695-43e9-8166-b826e9a950f3","Type":"ContainerStarted","Data":"3e3184077c5f51304f420f89f325431f2638e630fb9f82c8c1cad957b7bb2e64"}
Sep 07 11:51:42.157918 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:42.157861    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f55cf46dd-927gj" podStartSLOduration=17.157841945 podStartE2EDuration="17.157841945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:42.157834899 +0000 UTC m=+277.295586237" watchObservedRunningTime="2026-09-07 11:51:42.157841945 +0000 UTC m=+277.295593259"
Sep 07 11:51:42.210963 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:42.210938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:42.213886 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:42.213867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:43.144666 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:43.144633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm" event={"ID":"9adc86a4-2acb-48f6-86af-21e945541b83","Type":"ContainerStarted","Data":"46787097d8aef22df64b5100dcc68827200c35f8332c3ff79db241e6be444a34"}
Sep 07 11:51:43.145038 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:43.144839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:43.146061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:43.146040    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f55cf46dd-927gj"
Sep 07 11:51:44.149542 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:44.149501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm" event={"ID":"9adc86a4-2acb-48f6-86af-21e945541b83","Type":"ContainerStarted","Data":"b042d0c510578dd6e1646f3decf72e5ceb361c9d6e662afaacc7e6ef8272e6f5"}
Sep 07 11:51:44.166626 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:44.166582    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-5qlfm" podStartSLOduration=17.559234417 podStartE2EDuration="19.166565691s" totalImagesPullingTime="1.607331274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:44.164491576 +0000 UTC m=+279.302242887" watchObservedRunningTime="2026-09-07 11:51:44.166565691 +0000 UTC m=+279.304317002"
Sep 07 11:51:45.246087 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:45.246050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:45.246532 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:45.246371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:45.246826 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:45.246804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:45.248461 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:45.248445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3dee941a-c72f-4a59-82c6-3baf53cbfe3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vkr\" (UID: \"3dee941a-c72f-4a59-82c6-3baf53cbfe3c\") " pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:45.339876 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:45.339839    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5vkr"
Sep 07 11:51:45.611564 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:45.611533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5vkr"]
Sep 07 11:51:45.614247 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:45.614222    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dee941a_c72f_4a59_82c6_3baf53cbfe3c.slice/crio-27fb8a066e6c29a7440c21512b12f80987fa51961c1812f4019b4167a78dea7b WatchSource:0}: Error finding container 27fb8a066e6c29a7440c21512b12f80987fa51961c1812f4019b4167a78dea7b: Status 404 returned error can't find the container with id 27fb8a066e6c29a7440c21512b12f80987fa51961c1812f4019b4167a78dea7b
Sep 07 11:51:45.844717 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:45.844673    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-768565d46-5bngs" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41"
Sep 07 11:51:45.844717 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:45.844674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvqpd" podUID="d4ec4b8f-28d1-4159-968f-b8c6f7265c34"
Sep 07 11:51:46.157219 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:46.157194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:51:46.157406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:46.157233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:51:46.157406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:46.157194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vkr" event={"ID":"3dee941a-c72f-4a59-82c6-3baf53cbfe3c","Type":"ContainerStarted","Data":"3593942c48eaed6f9be0a6deb1ee8ba77c38eb0b917da5b2a5916ee28c8d865b"}
Sep 07 11:51:46.157406 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:46.157324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vkr" event={"ID":"3dee941a-c72f-4a59-82c6-3baf53cbfe3c","Type":"ContainerStarted","Data":"27fb8a066e6c29a7440c21512b12f80987fa51961c1812f4019b4167a78dea7b"}
Sep 07 11:51:47.162922 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:47.162880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vkr" event={"ID":"3dee941a-c72f-4a59-82c6-3baf53cbfe3c","Type":"ContainerStarted","Data":"bc0f8c3a1d5ec3d9035ddf32028e871ab6b65faddb5515ca2d5a072a05de627b"}
Sep 07 11:51:48.167631 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:48.167590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vkr" event={"ID":"3dee941a-c72f-4a59-82c6-3baf53cbfe3c","Type":"ContainerStarted","Data":"2be4d50b1d5c226744820d4727eb00295385d031aba3c1ca2c05850e4ad52f77"}
Sep 07 11:51:48.184740 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:48.184693    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z5vkr" podStartSLOduration=17.117700578 podStartE2EDuration="19.184678249s" totalImagesPullingTime="2.066977671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 11:51:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:48.183070795 +0000 UTC m=+283.320822105" watchObservedRunningTime="2026-09-07 11:51:48.184678249 +0000 UTC m=+283.322429560"
Sep 07 11:51:49.175910 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.175877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:51:49.176279 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.175933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:51:49.176279 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.175973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:51:49.178397 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.178368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4ec4b8f-28d1-4159-968f-b8c6f7265c34-metrics-tls\") pod \"dns-default-gvqpd\" (UID: \"d4ec4b8f-28d1-4159-968f-b8c6f7265c34\") " pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:51:49.178504 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.178459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"image-registry-768565d46-5bngs\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") " pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:51:49.178504 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.178490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e198839-97a7-48df-b13e-3f2f216bff60-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-74krb\" (UID: \"5e198839-97a7-48df-b13e-3f2f216bff60\") " pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:51:49.456511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.456437    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dqvkp\""
Sep 07 11:51:49.460539 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.460520    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kd29r\""
Sep 07 11:51:49.460650 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.460569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6v9dx\""
Sep 07 11:51:49.464640 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.464621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb"
Sep 07 11:51:49.469332 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.469317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:51:49.469445 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.469429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:51:49.735760 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.735687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-74krb"]
Sep 07 11:51:49.738423 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:49.738397    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e198839_97a7_48df_b13e_3f2f216bff60.slice/crio-78be99a1577b51c576e4560c236050e993aa2fddcf406e06dddf1de936f59522 WatchSource:0}: Error finding container 78be99a1577b51c576e4560c236050e993aa2fddcf406e06dddf1de936f59522: Status 404 returned error can't find the container with id 78be99a1577b51c576e4560c236050e993aa2fddcf406e06dddf1de936f59522
Sep 07 11:51:49.760486 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.760465    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvqpd"]
Sep 07 11:51:49.762866 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:49.762844    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ec4b8f_28d1_4159_968f_b8c6f7265c34.slice/crio-e1c35f34b9d5e40a68149b9aa9123313c8a5403081a9c315e7c6300c45b95b70 WatchSource:0}: Error finding container e1c35f34b9d5e40a68149b9aa9123313c8a5403081a9c315e7c6300c45b95b70: Status 404 returned error can't find the container with id e1c35f34b9d5e40a68149b9aa9123313c8a5403081a9c315e7c6300c45b95b70
Sep 07 11:51:49.763473 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:49.763389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768565d46-5bngs"]
Sep 07 11:51:49.765731 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:49.765711    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaca0ff3_97d4_4c25_854e_6e5690bcae41.slice/crio-73032b6a372ed167da2867fc6d6a0f48d5c2d71f82bd09bf3e465f504ce2452b WatchSource:0}: Error finding container 73032b6a372ed167da2867fc6d6a0f48d5c2d71f82bd09bf3e465f504ce2452b: Status 404 returned error can't find the container with id 73032b6a372ed167da2867fc6d6a0f48d5c2d71f82bd09bf3e465f504ce2452b
Sep 07 11:51:50.176029 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:50.175953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768565d46-5bngs" event={"ID":"faca0ff3-97d4-4c25-854e-6e5690bcae41","Type":"ContainerStarted","Data":"3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2"}
Sep 07 11:51:50.176485 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:50.176122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:51:50.176485 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:50.176157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768565d46-5bngs" event={"ID":"faca0ff3-97d4-4c25-854e-6e5690bcae41","Type":"ContainerStarted","Data":"73032b6a372ed167da2867fc6d6a0f48d5c2d71f82bd09bf3e465f504ce2452b"}
Sep 07 11:51:50.177260 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:50.177233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvqpd" event={"ID":"d4ec4b8f-28d1-4159-968f-b8c6f7265c34","Type":"ContainerStarted","Data":"e1c35f34b9d5e40a68149b9aa9123313c8a5403081a9c315e7c6300c45b95b70"}
Sep 07 11:51:50.178578 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:50.178554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb" event={"ID":"5e198839-97a7-48df-b13e-3f2f216bff60","Type":"ContainerStarted","Data":"78be99a1577b51c576e4560c236050e993aa2fddcf406e06dddf1de936f59522"}
Sep 07 11:51:50.196074 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:50.196033    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-768565d46-5bngs" podStartSLOduration=284.196017291 podStartE2EDuration="4m44.196017291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:50.194412245 +0000 UTC m=+285.332163556" watchObservedRunningTime="2026-09-07 11:51:50.196017291 +0000 UTC m=+285.333768604"
Sep 07 11:51:52.186262 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:52.186224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvqpd" event={"ID":"d4ec4b8f-28d1-4159-968f-b8c6f7265c34","Type":"ContainerStarted","Data":"6c07bfe1dd1dcee90cd42467503885451846e2b3b0febdaab98b790bb9f3a70b"}
Sep 07 11:51:52.186794 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:52.186287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvqpd" event={"ID":"d4ec4b8f-28d1-4159-968f-b8c6f7265c34","Type":"ContainerStarted","Data":"bf92a80686456b46d0ca2660d69682edcf9ce159214aa733e0f0d468a0293306"}
Sep 07 11:51:52.186794 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:52.186348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:51:52.187711 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:52.187694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb" event={"ID":"5e198839-97a7-48df-b13e-3f2f216bff60","Type":"ContainerStarted","Data":"e8124acf9c781a8d8d82a62678ae5ea81a270a2d895027b7fc2d68639a7abeb2"}
Sep 07 11:51:52.203753 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:52.203713    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvqpd" podStartSLOduration=251.492331298 podStartE2EDuration="4m13.203701452s" totalImagesPullingTime="1.711370154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:52.202610815 +0000 UTC m=+287.340362125" watchObservedRunningTime="2026-09-07 11:51:52.203701452 +0000 UTC m=+287.341452762"
Sep 07 11:51:52.217906 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:52.217869    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-74krb" podStartSLOduration=266.48246349 podStartE2EDuration="4m28.217857506s" totalImagesPullingTime="1.735394016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:52.217397256 +0000 UTC m=+287.355148568" watchObservedRunningTime="2026-09-07 11:51:52.217857506 +0000 UTC m=+287.355608816"
Sep 07 11:51:57.033955 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:57.033919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:57.036275 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:57.036238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eeedb772-4594-4a22-bb4f-8b766d74b52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ldq2c\" (UID: \"eeedb772-4594-4a22-bb4f-8b766d74b52e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:57.315468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:57.315374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"
Sep 07 11:51:57.582806 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:57.582735    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c"]
Sep 07 11:51:57.586244 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:51:57.586215    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeedb772_4594_4a22_bb4f_8b766d74b52e.slice/crio-54af0dbc98e774cd3194c440425cae10db7d35182bcb10a2fdcfc0de4258deb0 WatchSource:0}: Error finding container 54af0dbc98e774cd3194c440425cae10db7d35182bcb10a2fdcfc0de4258deb0: Status 404 returned error can't find the container with id 54af0dbc98e774cd3194c440425cae10db7d35182bcb10a2fdcfc0de4258deb0
Sep 07 11:51:58.207489 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:58.207458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c" event={"ID":"eeedb772-4594-4a22-bb4f-8b766d74b52e","Type":"ContainerStarted","Data":"54af0dbc98e774cd3194c440425cae10db7d35182bcb10a2fdcfc0de4258deb0"}
Sep 07 11:51:58.354749 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:58.354711    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2pg2r" podUID="38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c"
Sep 07 11:51:59.212438 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.212401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c" event={"ID":"eeedb772-4594-4a22-bb4f-8b766d74b52e","Type":"ContainerStarted","Data":"692a37f29fdfa60365b0f41a81d199f3f40adb99a809f4a36b265524fc782a33"}
Sep 07 11:51:59.228894 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.228849    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ldq2c" podStartSLOduration=32.810045052 podStartE2EDuration="34.228833657s" totalImagesPullingTime="1.418788605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:51:59.227792592 +0000 UTC m=+294.365543906" watchObservedRunningTime="2026-09-07 11:51:59.228833657 +0000 UTC m=+294.366584969"
Sep 07 11:51:59.496269 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.496240    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"]
Sep 07 11:51:59.499280 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.499258    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:51:59.501804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.501786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 07 11:51:59.501869 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.501819    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6pwj8\""
Sep 07 11:51:59.509007 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.508989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"]
Sep 07 11:51:59.653870 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.653833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8051e533-8967-4dfc-a489-f5183a4f73ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z6l6z\" (UID: \"8051e533-8967-4dfc-a489-f5183a4f73ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:51:59.754836 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:51:59.754756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8051e533-8967-4dfc-a489-f5183a4f73ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z6l6z\" (UID: \"8051e533-8967-4dfc-a489-f5183a4f73ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:51:59.754971 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:59.754902    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 07 11:51:59.754971 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:51:59.754966    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8051e533-8967-4dfc-a489-f5183a4f73ec-tls-certificates podName:8051e533-8967-4dfc-a489-f5183a4f73ec nodeName:}" failed. No retries permitted until 2026-09-07 11:52:00.254950756 +0000 UTC m=+295.392702045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8051e533-8967-4dfc-a489-f5183a4f73ec-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-z6l6z" (UID: "8051e533-8967-4dfc-a489-f5183a4f73ec") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 07 11:52:00.258797 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:00.258758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8051e533-8967-4dfc-a489-f5183a4f73ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z6l6z\" (UID: \"8051e533-8967-4dfc-a489-f5183a4f73ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:52:00.261113 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:00.261090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8051e533-8967-4dfc-a489-f5183a4f73ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z6l6z\" (UID: \"8051e533-8967-4dfc-a489-f5183a4f73ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:52:00.407594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:00.407569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:52:00.673023 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:00.672998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"]
Sep 07 11:52:00.675239 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:00.675216    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051e533_8967_4dfc_a489_f5183a4f73ec.slice/crio-997d2fdff13ed6476bdcf27c1e321257ac149d0c2df37065f249ee61ec517e10 WatchSource:0}: Error finding container 997d2fdff13ed6476bdcf27c1e321257ac149d0c2df37065f249ee61ec517e10: Status 404 returned error can't find the container with id 997d2fdff13ed6476bdcf27c1e321257ac149d0c2df37065f249ee61ec517e10
Sep 07 11:52:01.225950 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:01.225906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z" event={"ID":"8051e533-8967-4dfc-a489-f5183a4f73ec","Type":"ContainerStarted","Data":"997d2fdff13ed6476bdcf27c1e321257ac149d0c2df37065f249ee61ec517e10"}
Sep 07 11:52:02.193042 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.193010    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvqpd"
Sep 07 11:52:02.231192 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.231154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z" event={"ID":"8051e533-8967-4dfc-a489-f5183a4f73ec","Type":"ContainerStarted","Data":"99d6b781d1b13401d6c3e898252ea72d3be167044562c38e4545b3ec8314fda5"}
Sep 07 11:52:02.231656 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.231620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:52:02.235867 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.235840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z"
Sep 07 11:52:02.246392 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.246334    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z6l6z" podStartSLOduration=2.278175676 podStartE2EDuration="3.246321007s" totalImagesPullingTime="968.145331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:02.245710051 +0000 UTC m=+297.383461363" watchObservedRunningTime="2026-09-07 11:52:02.246321007 +0000 UTC m=+297.384072318"
Sep 07 11:52:02.573785 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.573718    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-s267g"]
Sep 07 11:52:02.577000 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.576982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.579446 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.579422    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 11:52:02.579558 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.579430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 11:52:02.580383 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.580358    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2gdcv\""
Sep 07 11:52:02.580464 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.580385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 11:52:02.586387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.586365    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-s267g"]
Sep 07 11:52:02.680224 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.680187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p47nk\" (UniqueName: \"kubernetes.io/projected/701ba2fd-0aa9-43c8-8105-50deaab41b59-kube-api-access-p47nk\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.680224 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.680224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.680462 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.680314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.680462 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.680386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/701ba2fd-0aa9-43c8-8105-50deaab41b59-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.781182 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.781144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/701ba2fd-0aa9-43c8-8105-50deaab41b59-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.781331 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.781190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p47nk\" (UniqueName: \"kubernetes.io/projected/701ba2fd-0aa9-43c8-8105-50deaab41b59-kube-api-access-p47nk\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.781331 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.781208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.781331 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.781267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.781532 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:52:02.781406    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 07 11:52:02.781532 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:52:02.781463    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-tls podName:701ba2fd-0aa9-43c8-8105-50deaab41b59 nodeName:}" failed. No retries permitted until 2026-09-07 11:52:03.281446885 +0000 UTC m=+298.419198193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-s267g" (UID: "701ba2fd-0aa9-43c8-8105-50deaab41b59") : secret "prometheus-operator-tls" not found
Sep 07 11:52:02.781791 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.781770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/701ba2fd-0aa9-43c8-8105-50deaab41b59-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.783616 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.783591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:02.789210 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:02.789188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p47nk\" (UniqueName: \"kubernetes.io/projected/701ba2fd-0aa9-43c8-8105-50deaab41b59-kube-api-access-p47nk\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:03.284839 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:03.284798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:03.287133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:03.287111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/701ba2fd-0aa9-43c8-8105-50deaab41b59-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-s267g\" (UID: \"701ba2fd-0aa9-43c8-8105-50deaab41b59\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:03.486091 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:03.486056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g"
Sep 07 11:52:03.753152 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:03.753120    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-s267g"]
Sep 07 11:52:03.757132 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:03.757101    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701ba2fd_0aa9_43c8_8105_50deaab41b59.slice/crio-44e79ea4d92ad95915601ca9d6859ee0585eef9faccd5c303ace08fa1c847104 WatchSource:0}: Error finding container 44e79ea4d92ad95915601ca9d6859ee0585eef9faccd5c303ace08fa1c847104: Status 404 returned error can't find the container with id 44e79ea4d92ad95915601ca9d6859ee0585eef9faccd5c303ace08fa1c847104
Sep 07 11:52:04.239235 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:04.239195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g" event={"ID":"701ba2fd-0aa9-43c8-8105-50deaab41b59","Type":"ContainerStarted","Data":"44e79ea4d92ad95915601ca9d6859ee0585eef9faccd5c303ace08fa1c847104"}
Sep 07 11:52:05.246744 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:05.246661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g" event={"ID":"701ba2fd-0aa9-43c8-8105-50deaab41b59","Type":"ContainerStarted","Data":"e82d9c29a36cc88964417cb915087ff8ad2ec14466758ad19c7f0974069f47b6"}
Sep 07 11:52:05.246744 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:05.246714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g" event={"ID":"701ba2fd-0aa9-43c8-8105-50deaab41b59","Type":"ContainerStarted","Data":"812aeeeb495726fa20d96639d2b621a1948d47c4ae7ee9dd35a87ea40a7d219c"}
Sep 07 11:52:05.263113 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:05.263073    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-s267g" podStartSLOduration=2.141270819 podStartE2EDuration="3.263058591s" totalImagesPullingTime="1.121787772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:05.262294633 +0000 UTC m=+300.400045944" watchObservedRunningTime="2026-09-07 11:52:05.263058591 +0000 UTC m=+300.400809901"
Sep 07 11:52:05.305271 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:05.305245    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 11:52:06.921086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:06.921050    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xwmnw"]
Sep 07 11:52:06.924391 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:06.924375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:06.926765 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:06.926742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rw24l\""
Sep 07 11:52:06.926765 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:06.926754    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 11:52:06.926953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:06.926860    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 11:52:06.927012 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:06.926991    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 11:52:07.007713 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-sys\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.007713 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-tls\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.007875 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-root\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.007875 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-textfile\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.007875 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d947h\" (UniqueName: \"kubernetes.io/projected/74f36382-e944-4561-9de7-e5cd212c0ef9-kube-api-access-d947h\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.007875 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-wtmp\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.007875 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.008025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.008025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.007919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74f36382-e944-4561-9de7-e5cd212c0ef9-metrics-client-ca\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.108960 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.108933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74f36382-e944-4561-9de7-e5cd212c0ef9-metrics-client-ca\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109106 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.108984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-sys\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109106 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-tls\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109106 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-sys\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109106 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:52:07.109076    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 07 11:52:07.109106 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-root\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:52:07.109120    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-tls podName:74f36382-e944-4561-9de7-e5cd212c0ef9 nodeName:}" failed. No retries permitted until 2026-09-07 11:52:07.609105257 +0000 UTC m=+302.746856545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-tls") pod "node-exporter-xwmnw" (UID: "74f36382-e944-4561-9de7-e5cd212c0ef9") : secret "node-exporter-tls" not found
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-root\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-textfile\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d947h\" (UniqueName: \"kubernetes.io/projected/74f36382-e944-4561-9de7-e5cd212c0ef9-kube-api-access-d947h\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-wtmp\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109654 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-wtmp\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109654 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-textfile\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109654 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74f36382-e944-4561-9de7-e5cd212c0ef9-metrics-client-ca\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.109859 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.109837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.111487 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.111469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.117179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.117159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d947h\" (UniqueName: \"kubernetes.io/projected/74f36382-e944-4561-9de7-e5cd212c0ef9-kube-api-access-d947h\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.613556 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.613519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-tls\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.615801 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.615779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74f36382-e944-4561-9de7-e5cd212c0ef9-node-exporter-tls\") pod \"node-exporter-xwmnw\" (UID: \"74f36382-e944-4561-9de7-e5cd212c0ef9\") " pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.833181 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.833124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xwmnw"
Sep 07 11:52:07.846009 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:07.845982    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f36382_e944_4561_9de7_e5cd212c0ef9.slice/crio-0847cadccdcd7ea799b11ef6c69767d0d86bb813215ad59df8b7a2b5c783391e WatchSource:0}: Error finding container 0847cadccdcd7ea799b11ef6c69767d0d86bb813215ad59df8b7a2b5c783391e: Status 404 returned error can't find the container with id 0847cadccdcd7ea799b11ef6c69767d0d86bb813215ad59df8b7a2b5c783391e
Sep 07 11:52:07.848451 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:07.848427    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 11:52:08.261948 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:08.258825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwmnw" event={"ID":"74f36382-e944-4561-9de7-e5cd212c0ef9","Type":"ContainerStarted","Data":"0847cadccdcd7ea799b11ef6c69767d0d86bb813215ad59df8b7a2b5c783391e"}
Sep 07 11:52:09.263597 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:09.263513    2560 generic.go:356] "Generic (PLEG): container finished" podID="74f36382-e944-4561-9de7-e5cd212c0ef9" containerID="fa8db4d5a156b0686b0716dd4d0c6ee4a586c5e50dcf50e7602e87d9d956ee38" exitCode=0
Sep 07 11:52:09.263597 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:09.263572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwmnw" event={"ID":"74f36382-e944-4561-9de7-e5cd212c0ef9","Type":"ContainerDied","Data":"fa8db4d5a156b0686b0716dd4d0c6ee4a586c5e50dcf50e7602e87d9d956ee38"}
Sep 07 11:52:09.474262 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:09.474230    2560 patch_prober.go:28] interesting pod/image-registry-768565d46-5bngs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 07 11:52:09.474411 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:09.474279    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-768565d46-5bngs" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 11:52:10.269669 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:10.269633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwmnw" event={"ID":"74f36382-e944-4561-9de7-e5cd212c0ef9","Type":"ContainerStarted","Data":"af625e2b2985b441330aa7d0f892fb675631790b03c3a0e9e2d08bb3380a0648"}
Sep 07 11:52:10.270041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:10.269696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwmnw" event={"ID":"74f36382-e944-4561-9de7-e5cd212c0ef9","Type":"ContainerStarted","Data":"52a5d547904a46765808efd905adf51c23829699dffa267f1c52fd1370ba4d7b"}
Sep 07 11:52:10.290824 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:10.290779    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xwmnw" podStartSLOduration=3.215803112 podStartE2EDuration="4.290763034s" totalImagesPullingTime="1.013578074s" totalInitContainerRuntime="61.381848ms" isStatefulPod=true podCreationTimestamp="2026-09-07 11:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:10.288742902 +0000 UTC m=+305.426494214" watchObservedRunningTime="2026-09-07 11:52:10.290763034 +0000 UTC m=+305.428514344"
Sep 07 11:52:11.186263 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.186235    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:52:11.257630 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.257593    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-545fc5c959-wwv97"]
Sep 07 11:52:11.260638 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.260619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.263138 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.263118    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n9lzt\""
Sep 07 11:52:11.263243 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.263118    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 07 11:52:11.263480 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.263427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 07 11:52:11.263671 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.263650    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 11:52:11.263898 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.263883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3r68tvhem3e8t\""
Sep 07 11:52:11.263979 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.263923    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 07 11:52:11.270370 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.270325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-545fc5c959-wwv97"]
Sep 07 11:52:11.441420 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-secret-metrics-server-tls\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.441420 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38f061c2-b2ad-4b4c-8db7-353f12102745-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.441653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-secret-metrics-server-client-certs\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.441653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38f061c2-b2ad-4b4c-8db7-353f12102745-metrics-server-audit-profiles\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.441653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-client-ca-bundle\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.441653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38f061c2-b2ad-4b4c-8db7-353f12102745-audit-log\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.441653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.441619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9d5\" (UniqueName: \"kubernetes.io/projected/38f061c2-b2ad-4b4c-8db7-353f12102745-kube-api-access-hp9d5\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.542873 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.542840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-client-ca-bundle\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.542873 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.542878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38f061c2-b2ad-4b4c-8db7-353f12102745-audit-log\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.542895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9d5\" (UniqueName: \"kubernetes.io/projected/38f061c2-b2ad-4b4c-8db7-353f12102745-kube-api-access-hp9d5\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.542930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-secret-metrics-server-tls\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.542966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38f061c2-b2ad-4b4c-8db7-353f12102745-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.542987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-secret-metrics-server-client-certs\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.543028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38f061c2-b2ad-4b4c-8db7-353f12102745-metrics-server-audit-profiles\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543358 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.543294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38f061c2-b2ad-4b4c-8db7-353f12102745-audit-log\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.543884 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.543858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38f061c2-b2ad-4b4c-8db7-353f12102745-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.544005 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.543890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38f061c2-b2ad-4b4c-8db7-353f12102745-metrics-server-audit-profiles\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.545552 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.545524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-secret-metrics-server-client-certs\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.545650 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.545560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-secret-metrics-server-tls\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.545650 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.545579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38f061c2-b2ad-4b4c-8db7-353f12102745-client-ca-bundle\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.550613 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.550593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9d5\" (UniqueName: \"kubernetes.io/projected/38f061c2-b2ad-4b4c-8db7-353f12102745-kube-api-access-hp9d5\") pod \"metrics-server-545fc5c959-wwv97\" (UID: \"38f061c2-b2ad-4b4c-8db7-353f12102745\") " pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.570609 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.570584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:11.839677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:11.839520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-545fc5c959-wwv97"]
Sep 07 11:52:11.841524 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:11.841499    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f061c2_b2ad_4b4c_8db7_353f12102745.slice/crio-bda7182c94dfb1f7b8c71570ddef923d7cda8301b8e363fe3e319992abfa3428 WatchSource:0}: Error finding container bda7182c94dfb1f7b8c71570ddef923d7cda8301b8e363fe3e319992abfa3428: Status 404 returned error can't find the container with id bda7182c94dfb1f7b8c71570ddef923d7cda8301b8e363fe3e319992abfa3428
Sep 07 11:52:12.278235 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:12.278202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97" event={"ID":"38f061c2-b2ad-4b4c-8db7-353f12102745","Type":"ContainerStarted","Data":"bda7182c94dfb1f7b8c71570ddef923d7cda8301b8e363fe3e319992abfa3428"}
Sep 07 11:52:12.353651 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:12.353622    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:52:14.287089 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:14.287046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97" event={"ID":"38f061c2-b2ad-4b4c-8db7-353f12102745","Type":"ContainerStarted","Data":"e26282fa63cc0e347bb8d2e2d21302793c9d512a889474d7c8f626415ba44a02"}
Sep 07 11:52:14.304007 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:14.303959    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97" podStartSLOduration=1.869935232 podStartE2EDuration="3.303943724s" totalImagesPullingTime="1.434008492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:14.302852297 +0000 UTC m=+309.440603610" watchObservedRunningTime="2026-09-07 11:52:14.303943724 +0000 UTC m=+309.441695036"
Sep 07 11:52:14.972367 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:14.972322    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768565d46-5bngs"]
Sep 07 11:52:18.260557 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.260522    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-89nmh"]
Sep 07 11:52:18.265709 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.265692    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:18.268617 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.268593    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 11:52:18.268725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.268592    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9g8r8\""
Sep 07 11:52:18.268725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.268651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 11:52:18.273565 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.273542    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-89nmh"]
Sep 07 11:52:18.400072 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.400032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbpp9\" (UniqueName: \"kubernetes.io/projected/bb185c32-718c-41a6-aba4-45261affdab6-kube-api-access-cbpp9\") pod \"downloads-85d98c998f-89nmh\" (UID: \"bb185c32-718c-41a6-aba4-45261affdab6\") " pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:18.501214 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.501180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbpp9\" (UniqueName: \"kubernetes.io/projected/bb185c32-718c-41a6-aba4-45261affdab6-kube-api-access-cbpp9\") pod \"downloads-85d98c998f-89nmh\" (UID: \"bb185c32-718c-41a6-aba4-45261affdab6\") " pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:18.510362 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.510307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbpp9\" (UniqueName: \"kubernetes.io/projected/bb185c32-718c-41a6-aba4-45261affdab6-kube-api-access-cbpp9\") pod \"downloads-85d98c998f-89nmh\" (UID: \"bb185c32-718c-41a6-aba4-45261affdab6\") " pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:18.576927 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.576843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:18.845953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:18.845929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-89nmh"]
Sep 07 11:52:18.847775 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:18.847749    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb185c32_718c_41a6_aba4_45261affdab6.slice/crio-b004e4c0f64fd68a0f1c6ad8e408dd07431dbff728c7f1b42e55518eab78b4d9 WatchSource:0}: Error finding container b004e4c0f64fd68a0f1c6ad8e408dd07431dbff728c7f1b42e55518eab78b4d9: Status 404 returned error can't find the container with id b004e4c0f64fd68a0f1c6ad8e408dd07431dbff728c7f1b42e55518eab78b4d9
Sep 07 11:52:19.307113 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:19.307066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-89nmh" event={"ID":"bb185c32-718c-41a6-aba4-45261affdab6","Type":"ContainerStarted","Data":"b004e4c0f64fd68a0f1c6ad8e408dd07431dbff728c7f1b42e55518eab78b4d9"}
Sep 07 11:52:31.570930 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:31.570890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:31.571495 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:31.570960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:32.091828 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.091791    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58696779fd-nhgrx"]
Sep 07 11:52:32.097772 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.097748    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.100478 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.100452    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 11:52:32.101725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.101531    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 11:52:32.101725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.101531    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 11:52:32.101725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.101621    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 11:52:32.101953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.101832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 11:52:32.101953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.101883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9d2tw\""
Sep 07 11:52:32.104037 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.104016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58696779fd-nhgrx"]
Sep 07 11:52:32.220358 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.220314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nx8z\" (UniqueName: \"kubernetes.io/projected/b9770724-5e40-45e9-a51b-f07873061342-kube-api-access-2nx8z\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.220529 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.220429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-service-ca\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.220529 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.220468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-console-config\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.220632 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.220548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-oauth-serving-cert\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.220632 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.220582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-oauth-config\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.220719 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.220636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-serving-cert\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.321971 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.321939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-oauth-serving-cert\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.322146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.321985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-oauth-config\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.322146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.322023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-serving-cert\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.322146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.322068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nx8z\" (UniqueName: \"kubernetes.io/projected/b9770724-5e40-45e9-a51b-f07873061342-kube-api-access-2nx8z\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.322146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.322106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-service-ca\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.322146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.322130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-console-config\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.322831 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.322779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-oauth-serving-cert\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.323113 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.323090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-console-config\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.323221 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.323116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-service-ca\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.324925 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.324902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-serving-cert\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.325054 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.325033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-oauth-config\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.329811 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.329789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nx8z\" (UniqueName: \"kubernetes.io/projected/b9770724-5e40-45e9-a51b-f07873061342-kube-api-access-2nx8z\") pod \"console-58696779fd-nhgrx\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") " pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:32.410223 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:32.410185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:34.369894 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:34.369865    2560 generic.go:356] "Generic (PLEG): container finished" podID="7fcb7cfc-9e33-4b22-82f5-9db62a613f19" containerID="8c07347db7bb07d565e6ec9a37de2584000f5ac25996bf70135b28992ace00eb" exitCode=0
Sep 07 11:52:34.370282 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:34.369941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps" event={"ID":"7fcb7cfc-9e33-4b22-82f5-9db62a613f19","Type":"ContainerDied","Data":"8c07347db7bb07d565e6ec9a37de2584000f5ac25996bf70135b28992ace00eb"}
Sep 07 11:52:34.370282 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:34.370226    2560 scope.go:117] "RemoveContainer" containerID="8c07347db7bb07d565e6ec9a37de2584000f5ac25996bf70135b28992ace00eb"
Sep 07 11:52:34.558459 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:34.558370    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58696779fd-nhgrx"]
Sep 07 11:52:34.561330 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:34.561304    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9770724_5e40_45e9_a51b_f07873061342.slice/crio-b469faad410617d74da54120414f9a4ac42be9a22a56ba80488df7092f6d8749 WatchSource:0}: Error finding container b469faad410617d74da54120414f9a4ac42be9a22a56ba80488df7092f6d8749: Status 404 returned error can't find the container with id b469faad410617d74da54120414f9a4ac42be9a22a56ba80488df7092f6d8749
Sep 07 11:52:35.379590 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:35.379548    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58696779fd-nhgrx" event={"ID":"b9770724-5e40-45e9-a51b-f07873061342","Type":"ContainerStarted","Data":"b469faad410617d74da54120414f9a4ac42be9a22a56ba80488df7092f6d8749"}
Sep 07 11:52:35.382012 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:35.381944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-89nmh" event={"ID":"bb185c32-718c-41a6-aba4-45261affdab6","Type":"ContainerStarted","Data":"26ccb28a44c6053ae048dd172a0163dcc2034199eba94da131cef15a045951b1"}
Sep 07 11:52:35.382966 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:35.382936    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:35.385725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:35.385603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p6wps" event={"ID":"7fcb7cfc-9e33-4b22-82f5-9db62a613f19","Type":"ContainerStarted","Data":"d589e46aba2c5a8a6d57b229f85afcfbe9047451e26deff3e614099b0fd693ae"}
Sep 07 11:52:35.388468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:35.388445    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-89nmh"
Sep 07 11:52:35.405626 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:35.403066    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-89nmh" podStartSLOduration=1.8646470929999999 podStartE2EDuration="17.403050952s" totalImagesPullingTime="15.538403859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:35.402804671 +0000 UTC m=+330.540555986" watchObservedRunningTime="2026-09-07 11:52:35.403050952 +0000 UTC m=+330.540802262"
Sep 07 11:52:39.404164 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:39.404129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58696779fd-nhgrx" event={"ID":"b9770724-5e40-45e9-a51b-f07873061342","Type":"ContainerStarted","Data":"1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3"}
Sep 07 11:52:39.421301 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:39.421254    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58696779fd-nhgrx" podStartSLOduration=3.64157442 podStartE2EDuration="7.421237649s" totalImagesPullingTime="3.779663229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:39.41962272 +0000 UTC m=+334.557374043" watchObservedRunningTime="2026-09-07 11:52:39.421237649 +0000 UTC m=+334.558988960"
Sep 07 11:52:39.991864 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:39.991799    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-768565d46-5bngs" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41" containerName="registry" containerID="cri-o://3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2" gracePeriod=30
Sep 07 11:52:40.282287 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.282255    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:52:40.397497 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397462    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-bound-sa-token\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397659 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397518    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faca0ff3-97d4-4c25-854e-6e5690bcae41-ca-trust-extracted\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397659 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397549    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-image-registry-private-configuration\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397659 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68n9c\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-kube-api-access-68n9c\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397659 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397659 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-trusted-ca\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-installation-pull-secrets\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.397825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.397692    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-certificates\") pod \"faca0ff3-97d4-4c25-854e-6e5690bcae41\" (UID: \"faca0ff3-97d4-4c25-854e-6e5690bcae41\") "
Sep 07 11:52:40.398209 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.398142    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:52:40.398209 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.398169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:52:40.400468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.400409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:52:40.400766 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.400726    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:52:40.401004 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.400975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:52:40.401089 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.401016    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-kube-api-access-68n9c" (OuterVolumeSpecName: "kube-api-access-68n9c") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "kube-api-access-68n9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:52:40.401089 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.401079    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:52:40.410984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.410959    2560 generic.go:356] "Generic (PLEG): container finished" podID="faca0ff3-97d4-4c25-854e-6e5690bcae41" containerID="3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2" exitCode=0
Sep 07 11:52:40.411743 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.411122    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768565d46-5bngs"
Sep 07 11:52:40.411743 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.411167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768565d46-5bngs" event={"ID":"faca0ff3-97d4-4c25-854e-6e5690bcae41","Type":"ContainerDied","Data":"3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2"}
Sep 07 11:52:40.411743 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.411211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768565d46-5bngs" event={"ID":"faca0ff3-97d4-4c25-854e-6e5690bcae41","Type":"ContainerDied","Data":"73032b6a372ed167da2867fc6d6a0f48d5c2d71f82bd09bf3e465f504ce2452b"}
Sep 07 11:52:40.411743 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.411255    2560 scope.go:117] "RemoveContainer" containerID="3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2"
Sep 07 11:52:40.412318 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.412292    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faca0ff3-97d4-4c25-854e-6e5690bcae41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "faca0ff3-97d4-4c25-854e-6e5690bcae41" (UID: "faca0ff3-97d4-4c25-854e-6e5690bcae41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:52:40.420617 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.420597    2560 scope.go:117] "RemoveContainer" containerID="3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2"
Sep 07 11:52:40.420938 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:52:40.420917    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2\": container with ID starting with 3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2 not found: ID does not exist" containerID="3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2"
Sep 07 11:52:40.421031 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.420947    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2"} err="failed to get container status \"3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2\": rpc error: code = NotFound desc = could not find container \"3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2\": container with ID starting with 3379101fcc11a298b0cf4380223a4619e3d6c2b2f60f3b0975135d739a66d6c2 not found: ID does not exist"
Sep 07 11:52:40.498815 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498641    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-bound-sa-token\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.498949 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498895    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faca0ff3-97d4-4c25-854e-6e5690bcae41-ca-trust-extracted\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.498949 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498917    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-image-registry-private-configuration\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.498949 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498934    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68n9c\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-kube-api-access-68n9c\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.498949 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498948    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.499133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498960    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-trusted-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.499133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498971    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faca0ff3-97d4-4c25-854e-6e5690bcae41-installation-pull-secrets\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.499133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.498979    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faca0ff3-97d4-4c25-854e-6e5690bcae41-registry-certificates\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:52:40.734127 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.734093    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768565d46-5bngs"]
Sep 07 11:52:40.741823 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:40.738807    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-768565d46-5bngs"]
Sep 07 11:52:41.359572 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:41.359535    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41" path="/var/lib/kubelet/pods/faca0ff3-97d4-4c25-854e-6e5690bcae41/volumes"
Sep 07 11:52:42.163799 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.163761    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54dc5f889-bm5pt"]
Sep 07 11:52:42.164186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.164076    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41" containerName="registry"
Sep 07 11:52:42.164186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.164089    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41" containerName="registry"
Sep 07 11:52:42.164186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.164150    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="faca0ff3-97d4-4c25-854e-6e5690bcae41" containerName="registry"
Sep 07 11:52:42.197110 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.197075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54dc5f889-bm5pt"]
Sep 07 11:52:42.197271 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.197193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.207083 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.207056    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 11:52:42.317472 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-oauth-serving-cert\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.317647 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-oauth-config\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.317647 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-service-ca\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.317745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-serving-cert\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.317789 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmmzt\" (UniqueName: \"kubernetes.io/projected/76f818fa-25c4-4a0d-8e6a-11c0212f6028-kube-api-access-wmmzt\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.317842 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-trusted-ca-bundle\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.317894 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.317840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-config\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.411374 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.411321    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:42.411554 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.411423    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:42.416988 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.416926    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:42.418242 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-config\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.418394 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-oauth-serving-cert\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.418394 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-oauth-config\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.418394 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-service-ca\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.418394 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-serving-cert\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.418599 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzt\" (UniqueName: \"kubernetes.io/projected/76f818fa-25c4-4a0d-8e6a-11c0212f6028-kube-api-access-wmmzt\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.418599 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.418515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-trusted-ca-bundle\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.419113 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.419086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-oauth-serving-cert\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.419378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.419323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-service-ca\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.419496 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.419442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-config\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.420172 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.420148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-trusted-ca-bundle\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.421649 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.421627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-oauth-config\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.421850 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.421820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-serving-cert\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.425158 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.425135    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:52:42.426841 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.426819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmmzt\" (UniqueName: \"kubernetes.io/projected/76f818fa-25c4-4a0d-8e6a-11c0212f6028-kube-api-access-wmmzt\") pod \"console-54dc5f889-bm5pt\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") " pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.508095 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.508031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:42.811986 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:42.811906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54dc5f889-bm5pt"]
Sep 07 11:52:42.815417 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:52:42.815379    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f818fa_25c4_4a0d_8e6a_11c0212f6028.slice/crio-75f5b42a149dbbcb2a9224dc84fbdd2296a267d0c0bb85ebdf064f0f6f28591b WatchSource:0}: Error finding container 75f5b42a149dbbcb2a9224dc84fbdd2296a267d0c0bb85ebdf064f0f6f28591b: Status 404 returned error can't find the container with id 75f5b42a149dbbcb2a9224dc84fbdd2296a267d0c0bb85ebdf064f0f6f28591b
Sep 07 11:52:43.427783 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:43.427744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54dc5f889-bm5pt" event={"ID":"76f818fa-25c4-4a0d-8e6a-11c0212f6028","Type":"ContainerStarted","Data":"2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0"}
Sep 07 11:52:43.428217 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:43.427810    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54dc5f889-bm5pt" event={"ID":"76f818fa-25c4-4a0d-8e6a-11c0212f6028","Type":"ContainerStarted","Data":"75f5b42a149dbbcb2a9224dc84fbdd2296a267d0c0bb85ebdf064f0f6f28591b"}
Sep 07 11:52:43.447163 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:43.447115    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54dc5f889-bm5pt" podStartSLOduration=1.447100092 podStartE2EDuration="1.447100092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:52:43.445705623 +0000 UTC m=+338.583456947" watchObservedRunningTime="2026-09-07 11:52:43.447100092 +0000 UTC m=+338.584851403"
Sep 07 11:52:48.447527 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:48.447495    2560 generic.go:356] "Generic (PLEG): container finished" podID="e429c41e-8a91-41a3-961d-79c41b75df6e" containerID="2044f7e5e711ab9d8748feb80334288ba11920d5ab75e13bd382a541da17442e" exitCode=0
Sep 07 11:52:48.447987 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:48.447569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g" event={"ID":"e429c41e-8a91-41a3-961d-79c41b75df6e","Type":"ContainerDied","Data":"2044f7e5e711ab9d8748feb80334288ba11920d5ab75e13bd382a541da17442e"}
Sep 07 11:52:48.447987 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:48.447966    2560 scope.go:117] "RemoveContainer" containerID="2044f7e5e711ab9d8748feb80334288ba11920d5ab75e13bd382a541da17442e"
Sep 07 11:52:49.452496 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:49.452465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-c9x4g" event={"ID":"e429c41e-8a91-41a3-961d-79c41b75df6e","Type":"ContainerStarted","Data":"a0b6a78ccd83798cea06a2bd682adc701a12a088444e11be55c578f634dcb070"}
Sep 07 11:52:51.578441 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:51.578398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:51.588982 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:51.588956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-545fc5c959-wwv97"
Sep 07 11:52:52.509839 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:52.508802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:52.509839 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:52.509781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:52.516610 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:52.516412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:53.471580 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:53.471554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:52:53.519404 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:52:53.519369    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58696779fd-nhgrx"]
Sep 07 11:53:18.539782 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.539744    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58696779fd-nhgrx" podUID="b9770724-5e40-45e9-a51b-f07873061342" containerName="console" containerID="cri-o://1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3" gracePeriod=15
Sep 07 11:53:18.787971 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.787940    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:53:18.836677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.836602    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-serving-cert\") pod \"b9770724-5e40-45e9-a51b-f07873061342\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") "
Sep 07 11:53:18.836677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.836641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-console-config\") pod \"b9770724-5e40-45e9-a51b-f07873061342\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") "
Sep 07 11:53:18.836677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.836665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-oauth-serving-cert\") pod \"b9770724-5e40-45e9-a51b-f07873061342\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") "
Sep 07 11:53:18.836925 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.836713    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nx8z\" (UniqueName: \"kubernetes.io/projected/b9770724-5e40-45e9-a51b-f07873061342-kube-api-access-2nx8z\") pod \"b9770724-5e40-45e9-a51b-f07873061342\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") "
Sep 07 11:53:18.836925 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.836749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-service-ca\") pod \"b9770724-5e40-45e9-a51b-f07873061342\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") "
Sep 07 11:53:18.836925 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.836846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-oauth-config\") pod \"b9770724-5e40-45e9-a51b-f07873061342\" (UID: \"b9770724-5e40-45e9-a51b-f07873061342\") "
Sep 07 11:53:18.837076 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.837052    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-console-config" (OuterVolumeSpecName: "console-config") pod "b9770724-5e40-45e9-a51b-f07873061342" (UID: "b9770724-5e40-45e9-a51b-f07873061342"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:53:18.837175 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.837143    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b9770724-5e40-45e9-a51b-f07873061342" (UID: "b9770724-5e40-45e9-a51b-f07873061342"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:53:18.837175 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.837147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-service-ca" (OuterVolumeSpecName: "service-ca") pod "b9770724-5e40-45e9-a51b-f07873061342" (UID: "b9770724-5e40-45e9-a51b-f07873061342"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:53:18.839079 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.839053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b9770724-5e40-45e9-a51b-f07873061342" (UID: "b9770724-5e40-45e9-a51b-f07873061342"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:53:18.839177 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.839086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b9770724-5e40-45e9-a51b-f07873061342" (UID: "b9770724-5e40-45e9-a51b-f07873061342"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:53:18.839233 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.839184    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9770724-5e40-45e9-a51b-f07873061342-kube-api-access-2nx8z" (OuterVolumeSpecName: "kube-api-access-2nx8z") pod "b9770724-5e40-45e9-a51b-f07873061342" (UID: "b9770724-5e40-45e9-a51b-f07873061342"). InnerVolumeSpecName "kube-api-access-2nx8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:53:18.938248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.938202    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:53:18.938248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.938241    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nx8z\" (UniqueName: \"kubernetes.io/projected/b9770724-5e40-45e9-a51b-f07873061342-kube-api-access-2nx8z\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:53:18.938248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.938251    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:53:18.938248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.938260    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:53:18.938248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.938268    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9770724-5e40-45e9-a51b-f07873061342-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:53:18.938548 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:18.938277    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9770724-5e40-45e9-a51b-f07873061342-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:53:19.340504 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.340472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:53:19.342679 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.342658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c-metrics-certs\") pod \"network-metrics-daemon-2pg2r\" (UID: \"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c\") " pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:53:19.557361 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.557324    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gtblx\""
Sep 07 11:53:19.564721 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.564702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pg2r"
Sep 07 11:53:19.567108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.567084    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9770724-5e40-45e9-a51b-f07873061342" containerID="1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3" exitCode=0
Sep 07 11:53:19.567189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.567132    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58696779fd-nhgrx"
Sep 07 11:53:19.567189 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.567145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58696779fd-nhgrx" event={"ID":"b9770724-5e40-45e9-a51b-f07873061342","Type":"ContainerDied","Data":"1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3"}
Sep 07 11:53:19.567270 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.567191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58696779fd-nhgrx" event={"ID":"b9770724-5e40-45e9-a51b-f07873061342","Type":"ContainerDied","Data":"b469faad410617d74da54120414f9a4ac42be9a22a56ba80488df7092f6d8749"}
Sep 07 11:53:19.567270 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.567218    2560 scope.go:117] "RemoveContainer" containerID="1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3"
Sep 07 11:53:19.574773 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.574754    2560 scope.go:117] "RemoveContainer" containerID="1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3"
Sep 07 11:53:19.575041 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:53:19.575022    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3\": container with ID starting with 1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3 not found: ID does not exist" containerID="1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3"
Sep 07 11:53:19.575100 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.575052    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3"} err="failed to get container status \"1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3\": rpc error: code = NotFound desc = could not find container \"1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3\": container with ID starting with 1cc2574e93f99b0ba71b67870de17532d9b92d513c75bcd57debdb3a013dc3c3 not found: ID does not exist"
Sep 07 11:53:19.603256 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.603235    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58696779fd-nhgrx"]
Sep 07 11:53:19.607586 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.607565    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58696779fd-nhgrx"]
Sep 07 11:53:19.854396 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:19.854373    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2pg2r"]
Sep 07 11:53:19.856845 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:53:19.856817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e2941a_a8ea_4fe2_9dc9_c9deba0ecb3c.slice/crio-8e67a0a96beb83ce0742115424173fc0e8eb8350c2c6fbd8454f3d45dca0f723 WatchSource:0}: Error finding container 8e67a0a96beb83ce0742115424173fc0e8eb8350c2c6fbd8454f3d45dca0f723: Status 404 returned error can't find the container with id 8e67a0a96beb83ce0742115424173fc0e8eb8350c2c6fbd8454f3d45dca0f723
Sep 07 11:53:20.574168 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:20.574127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pg2r" event={"ID":"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c","Type":"ContainerStarted","Data":"8e67a0a96beb83ce0742115424173fc0e8eb8350c2c6fbd8454f3d45dca0f723"}
Sep 07 11:53:21.358245 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:21.358215    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9770724-5e40-45e9-a51b-f07873061342" path="/var/lib/kubelet/pods/b9770724-5e40-45e9-a51b-f07873061342/volumes"
Sep 07 11:53:21.579264 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:21.579234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pg2r" event={"ID":"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c","Type":"ContainerStarted","Data":"b29fa7db30bcbb4f540b49db3275206ddb1e8741228e6193547afd34c35fab6c"}
Sep 07 11:53:21.579647 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:21.579283    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pg2r" event={"ID":"38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c","Type":"ContainerStarted","Data":"de6d1fc22ca958b2e6c1387b9e957627af58ca1725a05ee44bacd24defd52e53"}
Sep 07 11:53:21.595152 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:21.595111    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2pg2r" podStartSLOduration=374.436900362 podStartE2EDuration="6m15.59509822s" totalImagesPullingTime="1.158197858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:53:21.594383085 +0000 UTC m=+376.732134396" watchObservedRunningTime="2026-09-07 11:53:21.59509822 +0000 UTC m=+376.732849531"
Sep 07 11:53:34.472864 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.472832    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69c446d79c-tsnvd"]
Sep 07 11:53:34.473237 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.473108    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9770724-5e40-45e9-a51b-f07873061342" containerName="console"
Sep 07 11:53:34.473237 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.473118    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9770724-5e40-45e9-a51b-f07873061342" containerName="console"
Sep 07 11:53:34.473237 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.473168    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9770724-5e40-45e9-a51b-f07873061342" containerName="console"
Sep 07 11:53:34.475126 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.475106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.486987 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.486957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c446d79c-tsnvd"]
Sep 07 11:53:34.557765 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-oauth-config\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.557918 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-service-ca\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.557918 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-serving-cert\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.557918 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-oauth-serving-cert\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.557918 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-trusted-ca-bundle\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.557918 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-console-config\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.558119 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.557933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctnb7\" (UniqueName: \"kubernetes.io/projected/1bd35df1-7e75-4566-8cd9-af826582c806-kube-api-access-ctnb7\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659005 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.658978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-serving-cert\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-oauth-serving-cert\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-trusted-ca-bundle\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-console-config\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctnb7\" (UniqueName: \"kubernetes.io/projected/1bd35df1-7e75-4566-8cd9-af826582c806-kube-api-access-ctnb7\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-oauth-config\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-service-ca\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.659877 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-oauth-serving-cert\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.660015 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.659989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-console-config\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.660067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.660002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-service-ca\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.660067 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.660002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-trusted-ca-bundle\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.661527 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.661497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-oauth-config\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.661600 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.661588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-serving-cert\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.666924 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.666881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctnb7\" (UniqueName: \"kubernetes.io/projected/1bd35df1-7e75-4566-8cd9-af826582c806-kube-api-access-ctnb7\") pod \"console-69c446d79c-tsnvd\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") " pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:34.784122 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:34.784064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:35.051837 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:35.051778    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c446d79c-tsnvd"]
Sep 07 11:53:35.053945 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:53:35.053915    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd35df1_7e75_4566_8cd9_af826582c806.slice/crio-a693c71294ef918ce5cad769325f1280b5ecd70ea34ca2b6b79dc9acf1e2ee58 WatchSource:0}: Error finding container a693c71294ef918ce5cad769325f1280b5ecd70ea34ca2b6b79dc9acf1e2ee58: Status 404 returned error can't find the container with id a693c71294ef918ce5cad769325f1280b5ecd70ea34ca2b6b79dc9acf1e2ee58
Sep 07 11:53:35.632603 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:35.632568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c446d79c-tsnvd" event={"ID":"1bd35df1-7e75-4566-8cd9-af826582c806","Type":"ContainerStarted","Data":"8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea"}
Sep 07 11:53:35.633014 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:35.632650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c446d79c-tsnvd" event={"ID":"1bd35df1-7e75-4566-8cd9-af826582c806","Type":"ContainerStarted","Data":"a693c71294ef918ce5cad769325f1280b5ecd70ea34ca2b6b79dc9acf1e2ee58"}
Sep 07 11:53:35.649112 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:35.649060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69c446d79c-tsnvd" podStartSLOduration=1.6490455339999999 podStartE2EDuration="1.649045534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:53:35.648566531 +0000 UTC m=+390.786317847" watchObservedRunningTime="2026-09-07 11:53:35.649045534 +0000 UTC m=+390.786796845"
Sep 07 11:53:44.784286 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:44.784245    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:44.784696 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:44.784303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:44.788936 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:44.788914    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:45.673415 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:45.673390    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:53:45.719965 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:53:45.719934    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54dc5f889-bm5pt"]
Sep 07 11:54:10.742987 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:10.742932    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54dc5f889-bm5pt" podUID="76f818fa-25c4-4a0d-8e6a-11c0212f6028" containerName="console" containerID="cri-o://2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0" gracePeriod=15
Sep 07 11:54:10.977387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:10.977358    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:54:11.026985 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.026922    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-serving-cert\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.026985 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.026962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-oauth-serving-cert\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.027131 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.026996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmmzt\" (UniqueName: \"kubernetes.io/projected/76f818fa-25c4-4a0d-8e6a-11c0212f6028-kube-api-access-wmmzt\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.027179 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027125    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-trusted-ca-bundle\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.027232 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-config\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.027232 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-oauth-config\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.027325 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027241    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-service-ca\") pod \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\" (UID: \"76f818fa-25c4-4a0d-8e6a-11c0212f6028\") "
Sep 07 11:54:11.027532 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:54:11.027532 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027516    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:54:11.027729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-config" (OuterVolumeSpecName: "console-config") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:54:11.027858 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.027733    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-service-ca" (OuterVolumeSpecName: "service-ca") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:54:11.029070 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.029049    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:54:11.029549 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.029520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:54:11.029628 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.029527    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76f818fa-25c4-4a0d-8e6a-11c0212f6028-kube-api-access-wmmzt" (OuterVolumeSpecName: "kube-api-access-wmmzt") pod "76f818fa-25c4-4a0d-8e6a-11c0212f6028" (UID: "76f818fa-25c4-4a0d-8e6a-11c0212f6028"). InnerVolumeSpecName "kube-api-access-wmmzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:54:11.128056 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128023    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.128056 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128053    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmmzt\" (UniqueName: \"kubernetes.io/projected/76f818fa-25c4-4a0d-8e6a-11c0212f6028-kube-api-access-wmmzt\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.128056 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128063    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.128261 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128072    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.128261 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128080    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.128261 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128089    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76f818fa-25c4-4a0d-8e6a-11c0212f6028-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.128261 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.128097    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76f818fa-25c4-4a0d-8e6a-11c0212f6028-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:54:11.766570 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.766485    2560 generic.go:356] "Generic (PLEG): container finished" podID="76f818fa-25c4-4a0d-8e6a-11c0212f6028" containerID="2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0" exitCode=0
Sep 07 11:54:11.766570 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.766526    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54dc5f889-bm5pt"
Sep 07 11:54:11.766570 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.766556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54dc5f889-bm5pt" event={"ID":"76f818fa-25c4-4a0d-8e6a-11c0212f6028","Type":"ContainerDied","Data":"2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0"}
Sep 07 11:54:11.767039 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.766607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54dc5f889-bm5pt" event={"ID":"76f818fa-25c4-4a0d-8e6a-11c0212f6028","Type":"ContainerDied","Data":"75f5b42a149dbbcb2a9224dc84fbdd2296a267d0c0bb85ebdf064f0f6f28591b"}
Sep 07 11:54:11.767039 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.766627    2560 scope.go:117] "RemoveContainer" containerID="2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0"
Sep 07 11:54:11.774817 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.774798    2560 scope.go:117] "RemoveContainer" containerID="2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0"
Sep 07 11:54:11.775079 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:54:11.775059    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0\": container with ID starting with 2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0 not found: ID does not exist" containerID="2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0"
Sep 07 11:54:11.775136 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.775088    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0"} err="failed to get container status \"2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0\": rpc error: code = NotFound desc = could not find container \"2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0\": container with ID starting with 2ed0508423915081c976fd0434a4f652908e05951732bf1aff2573079acb07c0 not found: ID does not exist"
Sep 07 11:54:11.783495 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.783470    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54dc5f889-bm5pt"]
Sep 07 11:54:11.786543 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:11.786525    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54dc5f889-bm5pt"]
Sep 07 11:54:13.357895 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:13.357856    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76f818fa-25c4-4a0d-8e6a-11c0212f6028" path="/var/lib/kubelet/pods/76f818fa-25c4-4a0d-8e6a-11c0212f6028/volumes"
Sep 07 11:54:55.183053 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.183017    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7b496b45-8qksj"]
Sep 07 11:54:55.183531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.183349    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f818fa-25c4-4a0d-8e6a-11c0212f6028" containerName="console"
Sep 07 11:54:55.183531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.183365    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f818fa-25c4-4a0d-8e6a-11c0212f6028" containerName="console"
Sep 07 11:54:55.183531 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.183429    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76f818fa-25c4-4a0d-8e6a-11c0212f6028" containerName="console"
Sep 07 11:54:55.185247 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.185230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.197494 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.197466    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7b496b45-8qksj"]
Sep 07 11:54:55.347537 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-serving-cert\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.347694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-oauth-config\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.347694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-trusted-ca-bundle\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.347694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-config\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.347694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-service-ca\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.347694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-oauth-serving-cert\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.347694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.347686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28f2q\" (UniqueName: \"kubernetes.io/projected/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-kube-api-access-28f2q\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448618 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-trusted-ca-bundle\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448618 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-config\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448618 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-service-ca\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448852 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-oauth-serving-cert\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448852 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28f2q\" (UniqueName: \"kubernetes.io/projected/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-kube-api-access-28f2q\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448852 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-serving-cert\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.448852 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.448707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-oauth-config\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.449331 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.449308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-service-ca\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.449472 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.449453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-config\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.449532 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.449453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-oauth-serving-cert\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.449817 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.449790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-trusted-ca-bundle\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.451169 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.451138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-oauth-config\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.451299 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.451269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-serving-cert\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.466548 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.466522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28f2q\" (UniqueName: \"kubernetes.io/projected/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-kube-api-access-28f2q\") pod \"console-d7b496b45-8qksj\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") " pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.494477 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.494453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:54:55.761325 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.761301    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7b496b45-8qksj"]
Sep 07 11:54:55.763642 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:54:55.763612    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c06e5a_69a7_4f3c_8f64_0bbc66338c60.slice/crio-3f22e62f0db0bcb6550eaec8e0d3abd9e673aa5347fbe53517867bede5254c32 WatchSource:0}: Error finding container 3f22e62f0db0bcb6550eaec8e0d3abd9e673aa5347fbe53517867bede5254c32: Status 404 returned error can't find the container with id 3f22e62f0db0bcb6550eaec8e0d3abd9e673aa5347fbe53517867bede5254c32
Sep 07 11:54:55.932945 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.932911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b496b45-8qksj" event={"ID":"46c06e5a-69a7-4f3c-8f64-0bbc66338c60","Type":"ContainerStarted","Data":"b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1"}
Sep 07 11:54:55.933090 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.932957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b496b45-8qksj" event={"ID":"46c06e5a-69a7-4f3c-8f64-0bbc66338c60","Type":"ContainerStarted","Data":"3f22e62f0db0bcb6550eaec8e0d3abd9e673aa5347fbe53517867bede5254c32"}
Sep 07 11:54:55.950601 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:54:55.950553    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7b496b45-8qksj" podStartSLOduration=0.950536905 podStartE2EDuration="950.536905ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:54:55.949210481 +0000 UTC m=+471.086961796" watchObservedRunningTime="2026-09-07 11:54:55.950536905 +0000 UTC m=+471.088288216"
Sep 07 11:55:05.495129 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:05.495086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:55:05.495652 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:05.495157    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:55:05.499977 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:05.499954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:55:05.973215 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:05.973174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:55:06.015825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:06.015793    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c446d79c-tsnvd"]
Sep 07 11:55:31.037505 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.037436    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69c446d79c-tsnvd" podUID="1bd35df1-7e75-4566-8cd9-af826582c806" containerName="console" containerID="cri-o://8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea" gracePeriod=15
Sep 07 11:55:31.272220 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.272192    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:55:31.333259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-console-config\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctnb7\" (UniqueName: \"kubernetes.io/projected/1bd35df1-7e75-4566-8cd9-af826582c806-kube-api-access-ctnb7\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333267    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-service-ca\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333291    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-trusted-ca-bundle\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333322    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-oauth-serving-cert\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333376    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-oauth-config\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-serving-cert\") pod \"1bd35df1-7e75-4566-8cd9-af826582c806\" (UID: \"1bd35df1-7e75-4566-8cd9-af826582c806\") "
Sep 07 11:55:31.333747 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:55:31.333747 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333697    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-console-config" (OuterVolumeSpecName: "console-config") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:55:31.333747 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:55:31.333855 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.333770    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:55:31.335322 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.335301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd35df1-7e75-4566-8cd9-af826582c806-kube-api-access-ctnb7" (OuterVolumeSpecName: "kube-api-access-ctnb7") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "kube-api-access-ctnb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:55:31.335563 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.335543    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:55:31.335659 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.335635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bd35df1-7e75-4566-8cd9-af826582c806" (UID: "1bd35df1-7e75-4566-8cd9-af826582c806"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:55:31.434583 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434558    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctnb7\" (UniqueName: \"kubernetes.io/projected/1bd35df1-7e75-4566-8cd9-af826582c806-kube-api-access-ctnb7\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:31.434583 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434579    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:31.434723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434592    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:31.434723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434603    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:31.434723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434618    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:31.434723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434629    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bd35df1-7e75-4566-8cd9-af826582c806-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:31.434723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:31.434637    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bd35df1-7e75-4566-8cd9-af826582c806-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:55:32.063869 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.063827    2560 generic.go:356] "Generic (PLEG): container finished" podID="1bd35df1-7e75-4566-8cd9-af826582c806" containerID="8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea" exitCode=0
Sep 07 11:55:32.063869 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.063871    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c446d79c-tsnvd"
Sep 07 11:55:32.064291 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.063907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c446d79c-tsnvd" event={"ID":"1bd35df1-7e75-4566-8cd9-af826582c806","Type":"ContainerDied","Data":"8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea"}
Sep 07 11:55:32.064291 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.063961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c446d79c-tsnvd" event={"ID":"1bd35df1-7e75-4566-8cd9-af826582c806","Type":"ContainerDied","Data":"a693c71294ef918ce5cad769325f1280b5ecd70ea34ca2b6b79dc9acf1e2ee58"}
Sep 07 11:55:32.064291 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.063982    2560 scope.go:117] "RemoveContainer" containerID="8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea"
Sep 07 11:55:32.071799 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.071782    2560 scope.go:117] "RemoveContainer" containerID="8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea"
Sep 07 11:55:32.072053 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:55:32.072037    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea\": container with ID starting with 8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea not found: ID does not exist" containerID="8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea"
Sep 07 11:55:32.072098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.072060    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea"} err="failed to get container status \"8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea\": rpc error: code = NotFound desc = could not find container \"8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea\": container with ID starting with 8983639c8f774d126bab9a36e3542e3ee537408b4c54fc3c9caac6c7876dfcea not found: ID does not exist"
Sep 07 11:55:32.080414 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.080390    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c446d79c-tsnvd"]
Sep 07 11:55:32.085893 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:32.085872    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69c446d79c-tsnvd"]
Sep 07 11:55:33.358550 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:33.358517    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd35df1-7e75-4566-8cd9-af826582c806" path="/var/lib/kubelet/pods/1bd35df1-7e75-4566-8cd9-af826582c806/volumes"
Sep 07 11:55:58.049827 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.049752    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"]
Sep 07 11:55:58.050248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.050009    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd35df1-7e75-4566-8cd9-af826582c806" containerName="console"
Sep 07 11:55:58.050248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.050019    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd35df1-7e75-4566-8cd9-af826582c806" containerName="console"
Sep 07 11:55:58.050248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.050080    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd35df1-7e75-4566-8cd9-af826582c806" containerName="console"
Sep 07 11:55:58.054396 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.054379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.056776 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.056753    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zjtz\""
Sep 07 11:55:58.056938 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.056919    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 11:55:58.057678 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.057660    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 11:55:58.061232 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.061211    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"]
Sep 07 11:55:58.131411 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.131384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kgsn\" (UniqueName: \"kubernetes.io/projected/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-kube-api-access-2kgsn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.131558 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.131416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.131558 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.131504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.232254 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.232223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.232386 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.232266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kgsn\" (UniqueName: \"kubernetes.io/projected/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-kube-api-access-2kgsn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.232386 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.232286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.232607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.232588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.232655 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.232642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.240303 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.240276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kgsn\" (UniqueName: \"kubernetes.io/projected/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-kube-api-access-2kgsn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.363746 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.363705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:55:58.629455 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:58.629424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"]
Sep 07 11:55:58.632047 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:55:58.632019    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e657faf_3cd6_4cd3_93c4_6c074f81abbf.slice/crio-8b8e3aeefac0c6d1645e662ca6573370ba92db19d9e00f8c74b045c71c49abfc WatchSource:0}: Error finding container 8b8e3aeefac0c6d1645e662ca6573370ba92db19d9e00f8c74b045c71c49abfc: Status 404 returned error can't find the container with id 8b8e3aeefac0c6d1645e662ca6573370ba92db19d9e00f8c74b045c71c49abfc
Sep 07 11:55:59.164511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:55:59.164477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj" event={"ID":"3e657faf-3cd6-4cd3-93c4-6c074f81abbf","Type":"ContainerStarted","Data":"8b8e3aeefac0c6d1645e662ca6573370ba92db19d9e00f8c74b045c71c49abfc"}
Sep 07 11:56:06.194968 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:06.194930    2560 generic.go:356] "Generic (PLEG): container finished" podID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerID="9a4217e94da2f5c879cab2b66456d8dd819670c4bc12beeb1761dc47e54ed0b5" exitCode=0
Sep 07 11:56:06.195392 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:06.194975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj" event={"ID":"3e657faf-3cd6-4cd3-93c4-6c074f81abbf","Type":"ContainerDied","Data":"9a4217e94da2f5c879cab2b66456d8dd819670c4bc12beeb1761dc47e54ed0b5"}
Sep 07 11:56:08.204196 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:08.204119    2560 generic.go:356] "Generic (PLEG): container finished" podID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerID="fc147bdd17c44ccd7ff0c75096f2993af9be55714e829f21d5c256c70f396c60" exitCode=0
Sep 07 11:56:08.204196 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:08.204191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj" event={"ID":"3e657faf-3cd6-4cd3-93c4-6c074f81abbf","Type":"ContainerDied","Data":"fc147bdd17c44ccd7ff0c75096f2993af9be55714e829f21d5c256c70f396c60"}
Sep 07 11:56:15.238247 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:15.238211    2560 generic.go:356] "Generic (PLEG): container finished" podID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerID="ac98b2d6addff5f06fead6f2748af0527d64d30d9653c72d3871f2a62d40651d" exitCode=0
Sep 07 11:56:15.238801 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:15.238253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj" event={"ID":"3e657faf-3cd6-4cd3-93c4-6c074f81abbf","Type":"ContainerDied","Data":"ac98b2d6addff5f06fead6f2748af0527d64d30d9653c72d3871f2a62d40651d"}
Sep 07 11:56:16.362888 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.362866    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:56:16.485884 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.485848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kgsn\" (UniqueName: \"kubernetes.io/projected/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-kube-api-access-2kgsn\") pod \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") "
Sep 07 11:56:16.486061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.485918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-util\") pod \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") "
Sep 07 11:56:16.486061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.485948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-bundle\") pod \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\" (UID: \"3e657faf-3cd6-4cd3-93c4-6c074f81abbf\") "
Sep 07 11:56:16.486601 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.486577    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-bundle" (OuterVolumeSpecName: "bundle") pod "3e657faf-3cd6-4cd3-93c4-6c074f81abbf" (UID: "3e657faf-3cd6-4cd3-93c4-6c074f81abbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:56:16.488082 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.488057    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-kube-api-access-2kgsn" (OuterVolumeSpecName: "kube-api-access-2kgsn") pod "3e657faf-3cd6-4cd3-93c4-6c074f81abbf" (UID: "3e657faf-3cd6-4cd3-93c4-6c074f81abbf"). InnerVolumeSpecName "kube-api-access-2kgsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:56:16.489987 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.489951    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-util" (OuterVolumeSpecName: "util") pod "3e657faf-3cd6-4cd3-93c4-6c074f81abbf" (UID: "3e657faf-3cd6-4cd3-93c4-6c074f81abbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:56:16.587162 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.587091    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:16.587162 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.587116    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kgsn\" (UniqueName: \"kubernetes.io/projected/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-kube-api-access-2kgsn\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:16.587162 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:16.587127    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e657faf-3cd6-4cd3-93c4-6c074f81abbf-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:17.247960 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:17.247927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj" event={"ID":"3e657faf-3cd6-4cd3-93c4-6c074f81abbf","Type":"ContainerDied","Data":"8b8e3aeefac0c6d1645e662ca6573370ba92db19d9e00f8c74b045c71c49abfc"}
Sep 07 11:56:17.248120 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:17.248003    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b8e3aeefac0c6d1645e662ca6573370ba92db19d9e00f8c74b045c71c49abfc"
Sep 07 11:56:17.248120 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:17.247942    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s8gqj"
Sep 07 11:56:20.920763 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.920734    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"]
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921022    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="pull"
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921033    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="pull"
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921042    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="extract"
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921049    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="extract"
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921058    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="util"
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921063    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="util"
Sep 07 11:56:20.921211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.921104    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e657faf-3cd6-4cd3-93c4-6c074f81abbf" containerName="extract"
Sep 07 11:56:20.958269 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.958242    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"]
Sep 07 11:56:20.958421 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.958352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:20.961047 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.961022    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qh8dx\""
Sep 07 11:56:20.961185 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.961024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 07 11:56:20.961185 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:20.961125    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 07 11:56:21.125316 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.125286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdtn\" (UniqueName: \"kubernetes.io/projected/74256454-486d-4574-affd-72310a48f43a-kube-api-access-nsdtn\") pod \"cert-manager-operator-controller-manager-55c444bf86-kch2j\" (UID: \"74256454-486d-4574-affd-72310a48f43a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.125458 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.125374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74256454-486d-4574-affd-72310a48f43a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kch2j\" (UID: \"74256454-486d-4574-affd-72310a48f43a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.226601 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.226535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74256454-486d-4574-affd-72310a48f43a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kch2j\" (UID: \"74256454-486d-4574-affd-72310a48f43a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.226601 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.226582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdtn\" (UniqueName: \"kubernetes.io/projected/74256454-486d-4574-affd-72310a48f43a-kube-api-access-nsdtn\") pod \"cert-manager-operator-controller-manager-55c444bf86-kch2j\" (UID: \"74256454-486d-4574-affd-72310a48f43a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.226879 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.226861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74256454-486d-4574-affd-72310a48f43a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kch2j\" (UID: \"74256454-486d-4574-affd-72310a48f43a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.236821 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.236791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdtn\" (UniqueName: \"kubernetes.io/projected/74256454-486d-4574-affd-72310a48f43a-kube-api-access-nsdtn\") pod \"cert-manager-operator-controller-manager-55c444bf86-kch2j\" (UID: \"74256454-486d-4574-affd-72310a48f43a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.267254 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.267228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"
Sep 07 11:56:21.560559 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:21.560529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j"]
Sep 07 11:56:21.561514 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:56:21.561482    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74256454_486d_4574_affd_72310a48f43a.slice/crio-9bb055cca2edc8b99624db275f418a9832ab41b04251f70141d0ecc04e54ad51 WatchSource:0}: Error finding container 9bb055cca2edc8b99624db275f418a9832ab41b04251f70141d0ecc04e54ad51: Status 404 returned error can't find the container with id 9bb055cca2edc8b99624db275f418a9832ab41b04251f70141d0ecc04e54ad51
Sep 07 11:56:22.273541 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:22.273494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j" event={"ID":"74256454-486d-4574-affd-72310a48f43a","Type":"ContainerStarted","Data":"9bb055cca2edc8b99624db275f418a9832ab41b04251f70141d0ecc04e54ad51"}
Sep 07 11:56:23.280019 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:23.279941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j" event={"ID":"74256454-486d-4574-affd-72310a48f43a","Type":"ContainerStarted","Data":"ef65dee3f6b7e4b0c22960faec0d44475a10e993eb06072615e190fc937254c1"}
Sep 07 11:56:23.303573 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:23.303521    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kch2j" podStartSLOduration=1.869930395 podStartE2EDuration="3.30350579s" totalImagesPullingTime="1.433575395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:56:23.300891609 +0000 UTC m=+558.438642948" watchObservedRunningTime="2026-09-07 11:56:23.30350579 +0000 UTC m=+558.441257111"
Sep 07 11:56:24.654389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.654353    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"]
Sep 07 11:56:24.656547 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.656530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.659233 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.659212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 11:56:24.660452 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.660430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zjtz\""
Sep 07 11:56:24.660609 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.660583    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 11:56:24.666602 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.666582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"]
Sep 07 11:56:24.753656 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.753632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.753774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.753672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm5kl\" (UniqueName: \"kubernetes.io/projected/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-kube-api-access-jm5kl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.753774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.753765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.854547 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.854520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.854664 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.854568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.854706 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.854680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm5kl\" (UniqueName: \"kubernetes.io/projected/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-kube-api-access-jm5kl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.854895 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.854875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.854946 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.854927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.862125 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.862103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm5kl\" (UniqueName: \"kubernetes.io/projected/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-kube-api-access-jm5kl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:24.966307 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:24.966222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:25.235695 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.235625    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"]
Sep 07 11:56:25.238755 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:56:25.238721    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb22dda_58b1_4672_b7ff_4c54f2c859ed.slice/crio-2068016a188bb0f12a9b5920c77b021979c63f67e2353509a250b151cff14af9 WatchSource:0}: Error finding container 2068016a188bb0f12a9b5920c77b021979c63f67e2353509a250b151cff14af9: Status 404 returned error can't find the container with id 2068016a188bb0f12a9b5920c77b021979c63f67e2353509a250b151cff14af9
Sep 07 11:56:25.289577 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.289551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww" event={"ID":"2eb22dda-58b1-4672-b7ff-4c54f2c859ed","Type":"ContainerStarted","Data":"2068016a188bb0f12a9b5920c77b021979c63f67e2353509a250b151cff14af9"}
Sep 07 11:56:25.642998 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.642967    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mb7hq"]
Sep 07 11:56:25.645006 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.644990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.647467 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.647444    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4nmlg\""
Sep 07 11:56:25.647467 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.647459    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 11:56:25.648657 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.648642    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 11:56:25.653083 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.653064    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mb7hq"]
Sep 07 11:56:25.761248 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.761209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv78n\" (UniqueName: \"kubernetes.io/projected/50175368-5428-43ef-8675-123ec6e03aa4-kube-api-access-nv78n\") pod \"cert-manager-webhook-6486ffd997-mb7hq\" (UID: \"50175368-5428-43ef-8675-123ec6e03aa4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.761641 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.761261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50175368-5428-43ef-8675-123ec6e03aa4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mb7hq\" (UID: \"50175368-5428-43ef-8675-123ec6e03aa4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.861934 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.861900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv78n\" (UniqueName: \"kubernetes.io/projected/50175368-5428-43ef-8675-123ec6e03aa4-kube-api-access-nv78n\") pod \"cert-manager-webhook-6486ffd997-mb7hq\" (UID: \"50175368-5428-43ef-8675-123ec6e03aa4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.862278 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.861964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50175368-5428-43ef-8675-123ec6e03aa4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mb7hq\" (UID: \"50175368-5428-43ef-8675-123ec6e03aa4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.870324 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.870293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50175368-5428-43ef-8675-123ec6e03aa4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mb7hq\" (UID: \"50175368-5428-43ef-8675-123ec6e03aa4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.870487 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.870327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv78n\" (UniqueName: \"kubernetes.io/projected/50175368-5428-43ef-8675-123ec6e03aa4-kube-api-access-nv78n\") pod \"cert-manager-webhook-6486ffd997-mb7hq\" (UID: \"50175368-5428-43ef-8675-123ec6e03aa4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:25.966606 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:25.966521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:26.237305 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:26.237278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mb7hq"]
Sep 07 11:56:26.239711 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:56:26.239686    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50175368_5428_43ef_8675_123ec6e03aa4.slice/crio-201e45c8a60b8b49f30c1da88d6422a0b9e9a9728f175e71e8d645529724b436 WatchSource:0}: Error finding container 201e45c8a60b8b49f30c1da88d6422a0b9e9a9728f175e71e8d645529724b436: Status 404 returned error can't find the container with id 201e45c8a60b8b49f30c1da88d6422a0b9e9a9728f175e71e8d645529724b436
Sep 07 11:56:26.294698 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:26.294673    2560 generic.go:356] "Generic (PLEG): container finished" podID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerID="7723c2b5612fb849557f74b6d4c59c00b4340356fe96455bbd49dc2077ba85c1" exitCode=0
Sep 07 11:56:26.294807 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:26.294738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww" event={"ID":"2eb22dda-58b1-4672-b7ff-4c54f2c859ed","Type":"ContainerDied","Data":"7723c2b5612fb849557f74b6d4c59c00b4340356fe96455bbd49dc2077ba85c1"}
Sep 07 11:56:26.296051 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:26.296029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq" event={"ID":"50175368-5428-43ef-8675-123ec6e03aa4","Type":"ContainerStarted","Data":"201e45c8a60b8b49f30c1da88d6422a0b9e9a9728f175e71e8d645529724b436"}
Sep 07 11:56:29.311708 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:29.311625    2560 generic.go:356] "Generic (PLEG): container finished" podID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerID="43882e79a297dcb30db35427c38b2634e649b5144e733d7bd0edb7d0005ea4b0" exitCode=0
Sep 07 11:56:29.311708 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:29.311696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww" event={"ID":"2eb22dda-58b1-4672-b7ff-4c54f2c859ed","Type":"ContainerDied","Data":"43882e79a297dcb30db35427c38b2634e649b5144e733d7bd0edb7d0005ea4b0"}
Sep 07 11:56:29.313288 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:29.313264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq" event={"ID":"50175368-5428-43ef-8675-123ec6e03aa4","Type":"ContainerStarted","Data":"82b72d58b35f58c13c3b2dc292a9d6cb9b660635b9cd7ad7a9c8497a02156ecb"}
Sep 07 11:56:29.313413 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:29.313375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:29.341498 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:29.341460    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq" podStartSLOduration=1.563507402 podStartE2EDuration="4.341445288s" totalImagesPullingTime="2.777937886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:56:29.341023622 +0000 UTC m=+564.478774932" watchObservedRunningTime="2026-09-07 11:56:29.341445288 +0000 UTC m=+564.479196598"
Sep 07 11:56:30.319162 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:30.319125    2560 generic.go:356] "Generic (PLEG): container finished" podID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerID="d2add146218d7a87012c0f4bda7fbd4590b130053ae5986ff9f850388441de18" exitCode=0
Sep 07 11:56:30.319549 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:30.319204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww" event={"ID":"2eb22dda-58b1-4672-b7ff-4c54f2c859ed","Type":"ContainerDied","Data":"d2add146218d7a87012c0f4bda7fbd4590b130053ae5986ff9f850388441de18"}
Sep 07 11:56:31.449236 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.449210    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:31.504608 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.504574    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-bundle\") pod \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") "
Sep 07 11:56:31.504774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.504646    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-util\") pod \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") "
Sep 07 11:56:31.504774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.504678    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm5kl\" (UniqueName: \"kubernetes.io/projected/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-kube-api-access-jm5kl\") pod \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\" (UID: \"2eb22dda-58b1-4672-b7ff-4c54f2c859ed\") "
Sep 07 11:56:31.504995 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.504968    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-bundle" (OuterVolumeSpecName: "bundle") pod "2eb22dda-58b1-4672-b7ff-4c54f2c859ed" (UID: "2eb22dda-58b1-4672-b7ff-4c54f2c859ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:56:31.506718 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.506691    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-kube-api-access-jm5kl" (OuterVolumeSpecName: "kube-api-access-jm5kl") pod "2eb22dda-58b1-4672-b7ff-4c54f2c859ed" (UID: "2eb22dda-58b1-4672-b7ff-4c54f2c859ed"). InnerVolumeSpecName "kube-api-access-jm5kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:56:31.509948 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.509908    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-util" (OuterVolumeSpecName: "util") pod "2eb22dda-58b1-4672-b7ff-4c54f2c859ed" (UID: "2eb22dda-58b1-4672-b7ff-4c54f2c859ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:56:31.605645 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.605613    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:31.605645 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.605642    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm5kl\" (UniqueName: \"kubernetes.io/projected/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-kube-api-access-jm5kl\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:31.605862 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:31.605655    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eb22dda-58b1-4672-b7ff-4c54f2c859ed-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:32.330901 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:32.330874    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww"
Sep 07 11:56:32.331065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:32.330873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8f9ww" event={"ID":"2eb22dda-58b1-4672-b7ff-4c54f2c859ed","Type":"ContainerDied","Data":"2068016a188bb0f12a9b5920c77b021979c63f67e2353509a250b151cff14af9"}
Sep 07 11:56:32.331065 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:32.330993    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2068016a188bb0f12a9b5920c77b021979c63f67e2353509a250b151cff14af9"
Sep 07 11:56:35.321221 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:35.321191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mb7hq"
Sep 07 11:56:44.320500 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320460    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzqsh"]
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320748    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="util"
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320760    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="util"
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320767    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="pull"
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320773    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="pull"
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320781    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="extract"
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320786    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="extract"
Sep 07 11:56:44.320920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.320835    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb22dda-58b1-4672-b7ff-4c54f2c859ed" containerName="extract"
Sep 07 11:56:44.323805 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.323789    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.326426 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.326403    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-75v7k\""
Sep 07 11:56:44.332570 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.332550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzqsh"]
Sep 07 11:56:44.387388 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.387366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfpkc\" (UniqueName: \"kubernetes.io/projected/7aa99ad7-d302-447d-95c1-d11e21666403-kube-api-access-xfpkc\") pod \"cert-manager-55b4d954d5-qzqsh\" (UID: \"7aa99ad7-d302-447d-95c1-d11e21666403\") " pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.387695 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.387670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7aa99ad7-d302-447d-95c1-d11e21666403-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzqsh\" (UID: \"7aa99ad7-d302-447d-95c1-d11e21666403\") " pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.488746 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.488712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7aa99ad7-d302-447d-95c1-d11e21666403-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzqsh\" (UID: \"7aa99ad7-d302-447d-95c1-d11e21666403\") " pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.488905 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.488829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfpkc\" (UniqueName: \"kubernetes.io/projected/7aa99ad7-d302-447d-95c1-d11e21666403-kube-api-access-xfpkc\") pod \"cert-manager-55b4d954d5-qzqsh\" (UID: \"7aa99ad7-d302-447d-95c1-d11e21666403\") " pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.496867 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.496834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7aa99ad7-d302-447d-95c1-d11e21666403-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzqsh\" (UID: \"7aa99ad7-d302-447d-95c1-d11e21666403\") " pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.497040 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.497021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfpkc\" (UniqueName: \"kubernetes.io/projected/7aa99ad7-d302-447d-95c1-d11e21666403-kube-api-access-xfpkc\") pod \"cert-manager-55b4d954d5-qzqsh\" (UID: \"7aa99ad7-d302-447d-95c1-d11e21666403\") " pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.632723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.632683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzqsh"
Sep 07 11:56:44.897857 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:44.897786    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzqsh"]
Sep 07 11:56:44.900077 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:56:44.900045    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7aa99ad7_d302_447d_95c1_d11e21666403.slice/crio-8e3ca63cd7de2c7a22d998d636addf51af4f48fbc052074c0d3c2ece2d2d40c4 WatchSource:0}: Error finding container 8e3ca63cd7de2c7a22d998d636addf51af4f48fbc052074c0d3c2ece2d2d40c4: Status 404 returned error can't find the container with id 8e3ca63cd7de2c7a22d998d636addf51af4f48fbc052074c0d3c2ece2d2d40c4
Sep 07 11:56:45.384594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:45.384558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzqsh" event={"ID":"7aa99ad7-d302-447d-95c1-d11e21666403","Type":"ContainerStarted","Data":"2902713ec14213fbe8137e2f10fabf3e56722c84004432300aa0b92094c77c15"}
Sep 07 11:56:45.384950 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:45.384605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzqsh" event={"ID":"7aa99ad7-d302-447d-95c1-d11e21666403","Type":"ContainerStarted","Data":"8e3ca63cd7de2c7a22d998d636addf51af4f48fbc052074c0d3c2ece2d2d40c4"}
Sep 07 11:56:45.401512 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:45.401462    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qzqsh" podStartSLOduration=1.4014487199999999 podStartE2EDuration="1.40144872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:56:45.400440811 +0000 UTC m=+580.538192123" watchObservedRunningTime="2026-09-07 11:56:45.40144872 +0000 UTC m=+580.539200031"
Sep 07 11:56:49.438501 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.438469    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"]
Sep 07 11:56:49.458143 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.458120    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"]
Sep 07 11:56:49.458283 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.458208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.461219 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.461187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 11:56:49.461219 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.461187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 11:56:49.462216 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.462200    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zjtz\""
Sep 07 11:56:49.530157 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.530130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.530271 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.530183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8nd5\" (UniqueName: \"kubernetes.io/projected/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-kube-api-access-r8nd5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.530312 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.530289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.630876 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.630844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8nd5\" (UniqueName: \"kubernetes.io/projected/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-kube-api-access-r8nd5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.630996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.630915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.630996 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.630947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.631327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.631299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.631389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.631329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.638869 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.638847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8nd5\" (UniqueName: \"kubernetes.io/projected/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-kube-api-access-r8nd5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:49.767687 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:49.767616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:50.054734 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:50.054703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"]
Sep 07 11:56:50.055911 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:56:50.055888    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796255bc_8ba9_4b1c_8d10_66b7ee3b093d.slice/crio-4b82b027710deff4ad2114ae459c1c4a97d6ccd1de01f8edad5cd44b2b78147f WatchSource:0}: Error finding container 4b82b027710deff4ad2114ae459c1c4a97d6ccd1de01f8edad5cd44b2b78147f: Status 404 returned error can't find the container with id 4b82b027710deff4ad2114ae459c1c4a97d6ccd1de01f8edad5cd44b2b78147f
Sep 07 11:56:50.406416 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:50.406382    2560 generic.go:356] "Generic (PLEG): container finished" podID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerID="20a408e92e64d2d9f75b5dedbf0fd2e9aff72328058ebac152e1e5c8a416bb7e" exitCode=0
Sep 07 11:56:50.406579 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:50.406465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7" event={"ID":"796255bc-8ba9-4b1c-8d10-66b7ee3b093d","Type":"ContainerDied","Data":"20a408e92e64d2d9f75b5dedbf0fd2e9aff72328058ebac152e1e5c8a416bb7e"}
Sep 07 11:56:50.406579 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:50.406512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7" event={"ID":"796255bc-8ba9-4b1c-8d10-66b7ee3b093d","Type":"ContainerStarted","Data":"4b82b027710deff4ad2114ae459c1c4a97d6ccd1de01f8edad5cd44b2b78147f"}
Sep 07 11:56:51.411970 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:51.411933    2560 generic.go:356] "Generic (PLEG): container finished" podID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerID="6440f3cfa88f68c0f2907058a15a94f0195d7d0af7d73a43eeeb05c665ac29e7" exitCode=0
Sep 07 11:56:51.412336 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:51.411993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7" event={"ID":"796255bc-8ba9-4b1c-8d10-66b7ee3b093d","Type":"ContainerDied","Data":"6440f3cfa88f68c0f2907058a15a94f0195d7d0af7d73a43eeeb05c665ac29e7"}
Sep 07 11:56:52.418387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:52.418334    2560 generic.go:356] "Generic (PLEG): container finished" podID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerID="454456d39840d15007523d0527ecc978e2ae9c3b0d906bba511d08f07c684c34" exitCode=0
Sep 07 11:56:52.418387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:52.418372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7" event={"ID":"796255bc-8ba9-4b1c-8d10-66b7ee3b093d","Type":"ContainerDied","Data":"454456d39840d15007523d0527ecc978e2ae9c3b0d906bba511d08f07c684c34"}
Sep 07 11:56:53.541061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.541038    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:53.562511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.562481    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8nd5\" (UniqueName: \"kubernetes.io/projected/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-kube-api-access-r8nd5\") pod \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") "
Sep 07 11:56:53.562632 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.562551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-bundle\") pod \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") "
Sep 07 11:56:53.562698 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.562641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-util\") pod \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\" (UID: \"796255bc-8ba9-4b1c-8d10-66b7ee3b093d\") "
Sep 07 11:56:53.563244 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.563217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-bundle" (OuterVolumeSpecName: "bundle") pod "796255bc-8ba9-4b1c-8d10-66b7ee3b093d" (UID: "796255bc-8ba9-4b1c-8d10-66b7ee3b093d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:56:53.564935 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.564911    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-kube-api-access-r8nd5" (OuterVolumeSpecName: "kube-api-access-r8nd5") pod "796255bc-8ba9-4b1c-8d10-66b7ee3b093d" (UID: "796255bc-8ba9-4b1c-8d10-66b7ee3b093d"). InnerVolumeSpecName "kube-api-access-r8nd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:56:53.568101 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.568076    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-util" (OuterVolumeSpecName: "util") pod "796255bc-8ba9-4b1c-8d10-66b7ee3b093d" (UID: "796255bc-8ba9-4b1c-8d10-66b7ee3b093d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:56:53.663464 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.663434    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8nd5\" (UniqueName: \"kubernetes.io/projected/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-kube-api-access-r8nd5\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:53.663464 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.663460    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:53.663464 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:53.663470    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/796255bc-8ba9-4b1c-8d10-66b7ee3b093d-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:56:54.428831 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:54.428799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7" event={"ID":"796255bc-8ba9-4b1c-8d10-66b7ee3b093d","Type":"ContainerDied","Data":"4b82b027710deff4ad2114ae459c1c4a97d6ccd1de01f8edad5cd44b2b78147f"}
Sep 07 11:56:54.429001 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:54.428846    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b82b027710deff4ad2114ae459c1c4a97d6ccd1de01f8edad5cd44b2b78147f"
Sep 07 11:56:54.429001 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:54.428815    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflg9d7"
Sep 07 11:56:59.064720 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.064681    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"]
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.064994    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="pull"
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.065005    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="pull"
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.065016    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="util"
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.065021    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="util"
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.065027    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="extract"
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.065032    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="extract"
Sep 07 11:56:59.065098 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.065083    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="796255bc-8ba9-4b1c-8d10-66b7ee3b093d" containerName="extract"
Sep 07 11:56:59.070259 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.070240    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.073022 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.072998    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zjtz\""
Sep 07 11:56:59.073128 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.073079    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 11:56:59.074124 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.074105    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 11:56:59.077060 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.076847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"]
Sep 07 11:56:59.105285 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.105250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.105480 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.105309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.105480 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.105394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dbb9\" (UniqueName: \"kubernetes.io/projected/74954fb5-8dc6-4b69-9046-577261c0796c-kube-api-access-2dbb9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.205931 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.205896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.206108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.205951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.206108 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.205984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dbb9\" (UniqueName: \"kubernetes.io/projected/74954fb5-8dc6-4b69-9046-577261c0796c-kube-api-access-2dbb9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.206384 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.206359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.206453 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.206379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.213615 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.213589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dbb9\" (UniqueName: \"kubernetes.io/projected/74954fb5-8dc6-4b69-9046-577261c0796c-kube-api-access-2dbb9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.379192 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.379158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:56:59.649246 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:56:59.649219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"]
Sep 07 11:56:59.651391 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:56:59.651360    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74954fb5_8dc6_4b69_9046_577261c0796c.slice/crio-fb51dccedb08f2f7fc0c13424ddadd565cd1107b77e55036707fa542aa228f3e WatchSource:0}: Error finding container fb51dccedb08f2f7fc0c13424ddadd565cd1107b77e55036707fa542aa228f3e: Status 404 returned error can't find the container with id fb51dccedb08f2f7fc0c13424ddadd565cd1107b77e55036707fa542aa228f3e
Sep 07 11:57:00.456861 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:00.456823    2560 generic.go:356] "Generic (PLEG): container finished" podID="74954fb5-8dc6-4b69-9046-577261c0796c" containerID="3a4ace806f3b8dcad432b97e74f340611dfc86b5e1f29a31e42c568a838a1776" exitCode=0
Sep 07 11:57:00.457297 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:00.456903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs" event={"ID":"74954fb5-8dc6-4b69-9046-577261c0796c","Type":"ContainerDied","Data":"3a4ace806f3b8dcad432b97e74f340611dfc86b5e1f29a31e42c568a838a1776"}
Sep 07 11:57:00.457297 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:00.456951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs" event={"ID":"74954fb5-8dc6-4b69-9046-577261c0796c","Type":"ContainerStarted","Data":"fb51dccedb08f2f7fc0c13424ddadd565cd1107b77e55036707fa542aa228f3e"}
Sep 07 11:57:01.096583 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.096548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"]
Sep 07 11:57:01.099809 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.099778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.102428 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.102401    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 11:57:01.102549 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.102525    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 11:57:01.102634 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.102554    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 11:57:01.102818 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.102802    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 11:57:01.102884 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.102836    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qnxxt\""
Sep 07 11:57:01.114896 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.114875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"]
Sep 07 11:57:01.223633 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.223594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66cs\" (UniqueName: \"kubernetes.io/projected/52c11e2e-1b68-4905-a009-48ec0453249a-kube-api-access-v66cs\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.223825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.223654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52c11e2e-1b68-4905-a009-48ec0453249a-webhook-cert\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.223825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.223725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/52c11e2e-1b68-4905-a009-48ec0453249a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.223825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.223803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/52c11e2e-1b68-4905-a009-48ec0453249a-manifests\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.223946 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.223842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52c11e2e-1b68-4905-a009-48ec0453249a-tmp\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.324766 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.324729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52c11e2e-1b68-4905-a009-48ec0453249a-webhook-cert\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.324938 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.324782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/52c11e2e-1b68-4905-a009-48ec0453249a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.324938 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.324814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/52c11e2e-1b68-4905-a009-48ec0453249a-manifests\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.324938 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.324832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52c11e2e-1b68-4905-a009-48ec0453249a-tmp\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.324938 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.324860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66cs\" (UniqueName: \"kubernetes.io/projected/52c11e2e-1b68-4905-a009-48ec0453249a-kube-api-access-v66cs\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.325279 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.325251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/52c11e2e-1b68-4905-a009-48ec0453249a-manifests\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.327244 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.327225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52c11e2e-1b68-4905-a009-48ec0453249a-tmp\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.327389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.327365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52c11e2e-1b68-4905-a009-48ec0453249a-webhook-cert\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.327481 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.327468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/52c11e2e-1b68-4905-a009-48ec0453249a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.333462 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.333441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66cs\" (UniqueName: \"kubernetes.io/projected/52c11e2e-1b68-4905-a009-48ec0453249a-kube-api-access-v66cs\") pod \"opendatahub-operator-controller-manager-648db6df7b-xr9bt\" (UID: \"52c11e2e-1b68-4905-a009-48ec0453249a\") " pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.410328 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.410292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:01.691010 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:01.690983    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"]
Sep 07 11:57:01.693594 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:01.693562    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c11e2e_1b68_4905_a009_48ec0453249a.slice/crio-d1cc17a8c9f447d894688376465087aec686058c6dcc172c018c1b7a7e879b80 WatchSource:0}: Error finding container d1cc17a8c9f447d894688376465087aec686058c6dcc172c018c1b7a7e879b80: Status 404 returned error can't find the container with id d1cc17a8c9f447d894688376465087aec686058c6dcc172c018c1b7a7e879b80
Sep 07 11:57:02.469279 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:02.469232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt" event={"ID":"52c11e2e-1b68-4905-a009-48ec0453249a","Type":"ContainerStarted","Data":"d1cc17a8c9f447d894688376465087aec686058c6dcc172c018c1b7a7e879b80"}
Sep 07 11:57:02.471762 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:02.471716    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs" event={"ID":"74954fb5-8dc6-4b69-9046-577261c0796c","Type":"ContainerStarted","Data":"71a1f8e8fffff176fa6b29da233ac696bd3f29c8501b038459358b4414abe707"}
Sep 07 11:57:03.481017 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:03.480885    2560 generic.go:356] "Generic (PLEG): container finished" podID="74954fb5-8dc6-4b69-9046-577261c0796c" containerID="71a1f8e8fffff176fa6b29da233ac696bd3f29c8501b038459358b4414abe707" exitCode=0
Sep 07 11:57:03.481596 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:03.481013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs" event={"ID":"74954fb5-8dc6-4b69-9046-577261c0796c","Type":"ContainerDied","Data":"71a1f8e8fffff176fa6b29da233ac696bd3f29c8501b038459358b4414abe707"}
Sep 07 11:57:04.493901 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:04.493862    2560 generic.go:356] "Generic (PLEG): container finished" podID="74954fb5-8dc6-4b69-9046-577261c0796c" containerID="dabc09a64f5d3d1d391dccabba97b84bd44baf84f9e07190538162677b124365" exitCode=0
Sep 07 11:57:04.494317 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:04.493948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs" event={"ID":"74954fb5-8dc6-4b69-9046-577261c0796c","Type":"ContainerDied","Data":"dabc09a64f5d3d1d391dccabba97b84bd44baf84f9e07190538162677b124365"}
Sep 07 11:57:05.500169 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.500132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt" event={"ID":"52c11e2e-1b68-4905-a009-48ec0453249a","Type":"ContainerStarted","Data":"5273ced89ecf044a0904f9497ab210be9555db2ac8579abb723a75dc8e7b4aef"}
Sep 07 11:57:05.633951 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.633925    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:57:05.759820 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.759729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-util\") pod \"74954fb5-8dc6-4b69-9046-577261c0796c\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") "
Sep 07 11:57:05.759820 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.759774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-bundle\") pod \"74954fb5-8dc6-4b69-9046-577261c0796c\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") "
Sep 07 11:57:05.760069 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.759865    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dbb9\" (UniqueName: \"kubernetes.io/projected/74954fb5-8dc6-4b69-9046-577261c0796c-kube-api-access-2dbb9\") pod \"74954fb5-8dc6-4b69-9046-577261c0796c\" (UID: \"74954fb5-8dc6-4b69-9046-577261c0796c\") "
Sep 07 11:57:05.760572 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.760544    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-bundle" (OuterVolumeSpecName: "bundle") pod "74954fb5-8dc6-4b69-9046-577261c0796c" (UID: "74954fb5-8dc6-4b69-9046-577261c0796c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:57:05.761917 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.761892    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74954fb5-8dc6-4b69-9046-577261c0796c-kube-api-access-2dbb9" (OuterVolumeSpecName: "kube-api-access-2dbb9") pod "74954fb5-8dc6-4b69-9046-577261c0796c" (UID: "74954fb5-8dc6-4b69-9046-577261c0796c"). InnerVolumeSpecName "kube-api-access-2dbb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:57:05.765118 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.765083    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-util" (OuterVolumeSpecName: "util") pod "74954fb5-8dc6-4b69-9046-577261c0796c" (UID: "74954fb5-8dc6-4b69-9046-577261c0796c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:57:05.861446 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.861391    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:05.861446 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.861439    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74954fb5-8dc6-4b69-9046-577261c0796c-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:05.861446 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:05.861448    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dbb9\" (UniqueName: \"kubernetes.io/projected/74954fb5-8dc6-4b69-9046-577261c0796c-kube-api-access-2dbb9\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:06.506596 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:06.506507    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs"
Sep 07 11:57:06.506596 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:06.506516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09f4zs" event={"ID":"74954fb5-8dc6-4b69-9046-577261c0796c","Type":"ContainerDied","Data":"fb51dccedb08f2f7fc0c13424ddadd565cd1107b77e55036707fa542aa228f3e"}
Sep 07 11:57:06.506596 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:06.506560    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb51dccedb08f2f7fc0c13424ddadd565cd1107b77e55036707fa542aa228f3e"
Sep 07 11:57:06.508186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:06.508161    2560 generic.go:356] "Generic (PLEG): container finished" podID="52c11e2e-1b68-4905-a009-48ec0453249a" containerID="5273ced89ecf044a0904f9497ab210be9555db2ac8579abb723a75dc8e7b4aef" exitCode=0
Sep 07 11:57:06.508295 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:06.508226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt" event={"ID":"52c11e2e-1b68-4905-a009-48ec0453249a","Type":"ContainerDied","Data":"5273ced89ecf044a0904f9497ab210be9555db2ac8579abb723a75dc8e7b4aef"}
Sep 07 11:57:07.514664 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:07.514626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt" event={"ID":"52c11e2e-1b68-4905-a009-48ec0453249a","Type":"ContainerStarted","Data":"0c34b1bf0a0bf16909cb7852c716936a3beaa59db5d0e451b1ee3e92dc29d9a7"}
Sep 07 11:57:07.515100 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:07.514725    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:07.539025 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:07.538972    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt" podStartSLOduration=1.7781080519999999 podStartE2EDuration="6.538955536s" totalImagesPullingTime="3.716123525s" totalInitContainerRuntime="1.044723959s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:07.537105647 +0000 UTC m=+602.674856977" watchObservedRunningTime="2026-09-07 11:57:07.538955536 +0000 UTC m=+602.676706847"
Sep 07 11:57:18.520758 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:18.520727    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-648db6df7b-xr9bt"
Sep 07 11:57:20.439805 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.439766    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"]
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440090    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="pull"
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440105    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="pull"
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440115    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="util"
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440121    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="util"
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440133    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="extract"
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440139    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="extract"
Sep 07 11:57:20.440311 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.440207    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="74954fb5-8dc6-4b69-9046-577261c0796c" containerName="extract"
Sep 07 11:57:20.448202 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.448175    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.450904 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.450878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 11:57:20.450904 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.450901    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 07 11:57:20.459452 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.459425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"]
Sep 07 11:57:20.581813 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.581785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-tmp\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.581993 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.581822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-tls-certs\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.581993 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.581850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtnv\" (UniqueName: \"kubernetes.io/projected/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-kube-api-access-nvtnv\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.683261 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.683220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-tmp\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.683261 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.683271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-tls-certs\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.683490 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.683296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtnv\" (UniqueName: \"kubernetes.io/projected/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-kube-api-access-nvtnv\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.685566 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.685537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-tmp\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.685683 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.685665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-tls-certs\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.690737 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.690690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtnv\" (UniqueName: \"kubernetes.io/projected/fb860421-e6dc-42f8-ac6e-92eafe6e46f8-kube-api-access-nvtnv\") pod \"kube-auth-proxy-5b6777d477-m8cjc\" (UID: \"fb860421-e6dc-42f8-ac6e-92eafe6e46f8\") " pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:20.757629 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:20.757600    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"
Sep 07 11:57:21.032369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.032210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc"]
Sep 07 11:57:21.035251 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:21.035218    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb860421_e6dc_42f8_ac6e_92eafe6e46f8.slice/crio-ef6d7579671bf0dea956be7fbd9e09100aa8678d2803232df5f68dd892b0a1db WatchSource:0}: Error finding container ef6d7579671bf0dea956be7fbd9e09100aa8678d2803232df5f68dd892b0a1db: Status 404 returned error can't find the container with id ef6d7579671bf0dea956be7fbd9e09100aa8678d2803232df5f68dd892b0a1db
Sep 07 11:57:21.037243 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.037225    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 11:57:21.578541 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.578504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc" event={"ID":"fb860421-e6dc-42f8-ac6e-92eafe6e46f8","Type":"ContainerStarted","Data":"ef6d7579671bf0dea956be7fbd9e09100aa8678d2803232df5f68dd892b0a1db"}
Sep 07 11:57:21.673971 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.673942    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"]
Sep 07 11:57:21.678594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.678577    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.681255 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.681224    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 11:57:21.681389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.681264    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 07 11:57:21.681389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.681264    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 07 11:57:21.681389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.681285    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 07 11:57:21.681389 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.681382    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vmvtw\""
Sep 07 11:57:21.689750 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.689728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"]
Sep 07 11:57:21.794439 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.794607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.794607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.794607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5708219a-eff0-47a2-8bfb-0a67e946a12a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.794607 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.794806 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjt9\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-kube-api-access-jbjt9\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.794806 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.794669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896043 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.895989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896228 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896228 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5708219a-eff0-47a2-8bfb-0a67e946a12a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjt9\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-kube-api-access-jbjt9\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.896991 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.896941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.899215 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.899167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5708219a-eff0-47a2-8bfb-0a67e946a12a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.899415 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.899395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.899505 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.899462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.899941 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.899918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.904438 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.904413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjt9\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-kube-api-access-jbjt9\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.904523 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.904446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2tjx2\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:21.988267 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:21.988227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:22.277788 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:22.277470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"]
Sep 07 11:57:22.279271 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:22.279232    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5708219a_eff0_47a2_8bfb_0a67e946a12a.slice/crio-63aa5edd5b34de7e98b022c1da6b07669590ba0a6a7efd40c1155deb90d64966 WatchSource:0}: Error finding container 63aa5edd5b34de7e98b022c1da6b07669590ba0a6a7efd40c1155deb90d64966: Status 404 returned error can't find the container with id 63aa5edd5b34de7e98b022c1da6b07669590ba0a6a7efd40c1155deb90d64966
Sep 07 11:57:22.587054 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:22.586966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" event={"ID":"5708219a-eff0-47a2-8bfb-0a67e946a12a","Type":"ContainerStarted","Data":"63aa5edd5b34de7e98b022c1da6b07669590ba0a6a7efd40c1155deb90d64966"}
Sep 07 11:57:24.604997 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:24.604942    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc" event={"ID":"fb860421-e6dc-42f8-ac6e-92eafe6e46f8","Type":"ContainerStarted","Data":"2487bc57908d7f2b3b1564a78d64fbc84f32184bef944c305d181f4e9931b8a9"}
Sep 07 11:57:24.620829 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:24.620773    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b6777d477-m8cjc" podStartSLOduration=1.775780396 podStartE2EDuration="4.620752377s" totalImagesPullingTime="2.844971981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:24.619594979 +0000 UTC m=+619.757346283" watchObservedRunningTime="2026-09-07 11:57:24.620752377 +0000 UTC m=+619.758503689"
Sep 07 11:57:25.700514 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:25.700469    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 11:57:25.700796 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:25.700544    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 11:57:26.617215 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:26.617178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" event={"ID":"5708219a-eff0-47a2-8bfb-0a67e946a12a","Type":"ContainerStarted","Data":"9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1"}
Sep 07 11:57:26.617497 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:26.617367    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:26.618834 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:26.618810    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2tjx2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 11:57:26.618957 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:26.618859    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 11:57:26.644535 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:26.644481    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" podStartSLOduration=2.226180476 podStartE2EDuration="5.644467661s" totalImagesPullingTime="3.418287185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:26.643175636 +0000 UTC m=+621.780926972" watchObservedRunningTime="2026-09-07 11:57:26.644467661 +0000 UTC m=+621.782218971"
Sep 07 11:57:27.622643 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:27.622613    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:31.236853 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.236820    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pnggk"]
Sep 07 11:57:31.239945 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.239929    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.242409 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.242384    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 11:57:31.242534 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.242435    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cwr44\""
Sep 07 11:57:31.248488 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.248467    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pnggk"]
Sep 07 11:57:31.381632 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.381601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d87168b8-505c-409f-98d6-9e7a9ed8ae48-cert\") pod \"odh-model-controller-7998c67dc4-pnggk\" (UID: \"d87168b8-505c-409f-98d6-9e7a9ed8ae48\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.381810 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.381650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwtrf\" (UniqueName: \"kubernetes.io/projected/d87168b8-505c-409f-98d6-9e7a9ed8ae48-kube-api-access-gwtrf\") pod \"odh-model-controller-7998c67dc4-pnggk\" (UID: \"d87168b8-505c-409f-98d6-9e7a9ed8ae48\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.482435 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.482403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d87168b8-505c-409f-98d6-9e7a9ed8ae48-cert\") pod \"odh-model-controller-7998c67dc4-pnggk\" (UID: \"d87168b8-505c-409f-98d6-9e7a9ed8ae48\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.482619 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.482451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwtrf\" (UniqueName: \"kubernetes.io/projected/d87168b8-505c-409f-98d6-9e7a9ed8ae48-kube-api-access-gwtrf\") pod \"odh-model-controller-7998c67dc4-pnggk\" (UID: \"d87168b8-505c-409f-98d6-9e7a9ed8ae48\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.484825 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.484800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d87168b8-505c-409f-98d6-9e7a9ed8ae48-cert\") pod \"odh-model-controller-7998c67dc4-pnggk\" (UID: \"d87168b8-505c-409f-98d6-9e7a9ed8ae48\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.492708 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.492650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwtrf\" (UniqueName: \"kubernetes.io/projected/d87168b8-505c-409f-98d6-9e7a9ed8ae48-kube-api-access-gwtrf\") pod \"odh-model-controller-7998c67dc4-pnggk\" (UID: \"d87168b8-505c-409f-98d6-9e7a9ed8ae48\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.550268 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.550243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:31.820819 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.820785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pnggk"]
Sep 07 11:57:31.823522 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:31.823492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87168b8_505c_409f_98d6_9e7a9ed8ae48.slice/crio-aff14896ffbbcc1ef3af3d30464c92d93f7cb4020f2f554548f21d9a15888076 WatchSource:0}: Error finding container aff14896ffbbcc1ef3af3d30464c92d93f7cb4020f2f554548f21d9a15888076: Status 404 returned error can't find the container with id aff14896ffbbcc1ef3af3d30464c92d93f7cb4020f2f554548f21d9a15888076
Sep 07 11:57:31.837036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.837009    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f2xzf"]
Sep 07 11:57:31.841525 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.841502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:31.843935 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.843914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 07 11:57:31.852368 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.852324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f2xzf"]
Sep 07 11:57:31.986736 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.986703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64b71e-492a-4480-ae60-79c883d6e074-tls-certs\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:31.986906 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:31.986758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dql7q\" (UniqueName: \"kubernetes.io/projected/8b64b71e-492a-4480-ae60-79c883d6e074-kube-api-access-dql7q\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:32.087672 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.087565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql7q\" (UniqueName: \"kubernetes.io/projected/8b64b71e-492a-4480-ae60-79c883d6e074-kube-api-access-dql7q\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:32.087672 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.087661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64b71e-492a-4480-ae60-79c883d6e074-tls-certs\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:32.087852 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:57:32.087763    2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 07 11:57:32.087852 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:57:32.087828    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b64b71e-492a-4480-ae60-79c883d6e074-tls-certs podName:8b64b71e-492a-4480-ae60-79c883d6e074 nodeName:}" failed. No retries permitted until 2026-09-07 11:57:32.587811307 +0000 UTC m=+627.725562596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8b64b71e-492a-4480-ae60-79c883d6e074-tls-certs") pod "model-serving-api-54d89bd5fc-f2xzf" (UID: "8b64b71e-492a-4480-ae60-79c883d6e074") : secret "model-serving-api-tls" not found
Sep 07 11:57:32.096144 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.096117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql7q\" (UniqueName: \"kubernetes.io/projected/8b64b71e-492a-4480-ae60-79c883d6e074-kube-api-access-dql7q\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:32.591799 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.591763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64b71e-492a-4480-ae60-79c883d6e074-tls-certs\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:32.594127 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.594100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64b71e-492a-4480-ae60-79c883d6e074-tls-certs\") pod \"model-serving-api-54d89bd5fc-f2xzf\" (UID: \"8b64b71e-492a-4480-ae60-79c883d6e074\") " pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:32.645387 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.645328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk" event={"ID":"d87168b8-505c-409f-98d6-9e7a9ed8ae48","Type":"ContainerStarted","Data":"aff14896ffbbcc1ef3af3d30464c92d93f7cb4020f2f554548f21d9a15888076"}
Sep 07 11:57:32.752218 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:32.752185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:33.021841 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.021637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f2xzf"]
Sep 07 11:57:33.023915 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:33.023879    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b64b71e_492a_4480_ae60_79c883d6e074.slice/crio-cfbe5a1e98f5aaeff2fd3ac27e491ff47aa910506640346a80c0dc47e5a70fa8 WatchSource:0}: Error finding container cfbe5a1e98f5aaeff2fd3ac27e491ff47aa910506640346a80c0dc47e5a70fa8: Status 404 returned error can't find the container with id cfbe5a1e98f5aaeff2fd3ac27e491ff47aa910506640346a80c0dc47e5a70fa8
Sep 07 11:57:33.653369 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.653319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf" event={"ID":"8b64b71e-492a-4480-ae60-79c883d6e074","Type":"ContainerStarted","Data":"cfbe5a1e98f5aaeff2fd3ac27e491ff47aa910506640346a80c0dc47e5a70fa8"}
Sep 07 11:57:33.748700 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.748663    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ddfb5445d-bxpcd"]
Sep 07 11:57:33.763995 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.763824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddfb5445d-bxpcd"]
Sep 07 11:57:33.763995 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.763960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.904843 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.904765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-oauth-config\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.904843 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.904808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-service-ca\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.905041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.904894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-serving-cert\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.905041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.904930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2mh\" (UniqueName: \"kubernetes.io/projected/2444a14d-9a3f-4ad1-9a7a-204d59316c81-kube-api-access-gd2mh\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.905041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.904965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-trusted-ca-bundle\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.905202 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.905048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-config\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:33.905202 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:33.905090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-oauth-serving-cert\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005796 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-config\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-oauth-serving-cert\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-oauth-config\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-service-ca\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-serving-cert\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2mh\" (UniqueName: \"kubernetes.io/projected/2444a14d-9a3f-4ad1-9a7a-204d59316c81-kube-api-access-gd2mh\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.005972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.005947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-trusted-ca-bundle\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.006696 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.006622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-service-ca\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.006696 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.006688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-config\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.007014 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.006975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-oauth-serving-cert\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.007130 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.007102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2444a14d-9a3f-4ad1-9a7a-204d59316c81-trusted-ca-bundle\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.008712 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.008690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-serving-cert\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.009316 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.009296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2444a14d-9a3f-4ad1-9a7a-204d59316c81-console-oauth-config\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.013773 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.013750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2mh\" (UniqueName: \"kubernetes.io/projected/2444a14d-9a3f-4ad1-9a7a-204d59316c81-kube-api-access-gd2mh\") pod \"console-6ddfb5445d-bxpcd\" (UID: \"2444a14d-9a3f-4ad1-9a7a-204d59316c81\") " pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:34.078765 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:34.078726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:35.665476 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.665437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk" event={"ID":"d87168b8-505c-409f-98d6-9e7a9ed8ae48","Type":"ContainerStarted","Data":"c467512f8dee4c937019be7bd15908cdd5fa67a7903eb31f7d4cd1580176c7db"}
Sep 07 11:57:35.665917 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.665615    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:35.667102 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.667074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf" event={"ID":"8b64b71e-492a-4480-ae60-79c883d6e074","Type":"ContainerStarted","Data":"aca2b71ab4b9270a8c3c2eb23016cb123bde32fc19e7125fef4ff36733371048"}
Sep 07 11:57:35.667246 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.667163    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:35.681984 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.681938    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk" podStartSLOduration=1.03930535 podStartE2EDuration="4.681924188s" totalImagesPullingTime="3.642618838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:35.679989731 +0000 UTC m=+630.817741042" watchObservedRunningTime="2026-09-07 11:57:35.681924188 +0000 UTC m=+630.819675499"
Sep 07 11:57:35.696234 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.696189    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf" podStartSLOduration=2.268731796 podStartE2EDuration="4.696174961s" totalImagesPullingTime="2.427443165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:35.693948407 +0000 UTC m=+630.831699711" watchObservedRunningTime="2026-09-07 11:57:35.696174961 +0000 UTC m=+630.833926272"
Sep 07 11:57:35.722759 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:35.722731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddfb5445d-bxpcd"]
Sep 07 11:57:35.724801 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:35.724776    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2444a14d_9a3f_4ad1_9a7a_204d59316c81.slice/crio-5eea10750e322925179812b4c81611dfdf3de235c483740c116f3dda8a8468a4 WatchSource:0}: Error finding container 5eea10750e322925179812b4c81611dfdf3de235c483740c116f3dda8a8468a4: Status 404 returned error can't find the container with id 5eea10750e322925179812b4c81611dfdf3de235c483740c116f3dda8a8468a4
Sep 07 11:57:36.673467 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:36.673428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddfb5445d-bxpcd" event={"ID":"2444a14d-9a3f-4ad1-9a7a-204d59316c81","Type":"ContainerStarted","Data":"42e18337a2bd93c4d1079e1d6a075c63be5bfeb8781c0874e75c0069629c3630"}
Sep 07 11:57:36.673891 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:36.673516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddfb5445d-bxpcd" event={"ID":"2444a14d-9a3f-4ad1-9a7a-204d59316c81","Type":"ContainerStarted","Data":"5eea10750e322925179812b4c81611dfdf3de235c483740c116f3dda8a8468a4"}
Sep 07 11:57:36.695240 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:36.695181    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ddfb5445d-bxpcd" podStartSLOduration=3.695166252 podStartE2EDuration="3.695166252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:36.693018206 +0000 UTC m=+631.830769516" watchObservedRunningTime="2026-09-07 11:57:36.695166252 +0000 UTC m=+631.832917563"
Sep 07 11:57:40.478319 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.478285    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"]
Sep 07 11:57:40.487553 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.487521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.491764 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.491736    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-l6wvk\""
Sep 07 11:57:40.495245 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.495222    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 07 11:57:40.495408 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.495362    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"]
Sep 07 11:57:40.499606 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.499585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.503232 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.503213    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 07 11:57:40.508312 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.508289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s96sr\""
Sep 07 11:57:40.511413 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.511393    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"]
Sep 07 11:57:40.529520 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.529491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"]
Sep 07 11:57:40.564122 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.564082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btxn9\" (UniqueName: \"kubernetes.io/projected/c3191588-9590-4330-97bb-23cf395c37ac-kube-api-access-btxn9\") pod \"kserve-controller-manager-d6f4b65b8-dkgmc\" (UID: \"c3191588-9590-4330-97bb-23cf395c37ac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.564281 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.564147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8ec3208-7aac-4ea8-a4c3-d82921e60d12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xnpf2\" (UID: \"d8ec3208-7aac-4ea8-a4c3-d82921e60d12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.564281 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.564177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3191588-9590-4330-97bb-23cf395c37ac-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkgmc\" (UID: \"c3191588-9590-4330-97bb-23cf395c37ac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.564281 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.564200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64l4\" (UniqueName: \"kubernetes.io/projected/d8ec3208-7aac-4ea8-a4c3-d82921e60d12-kube-api-access-r64l4\") pod \"llmisvc-controller-manager-777c6bd7d5-xnpf2\" (UID: \"d8ec3208-7aac-4ea8-a4c3-d82921e60d12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.664630 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.664597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8ec3208-7aac-4ea8-a4c3-d82921e60d12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xnpf2\" (UID: \"d8ec3208-7aac-4ea8-a4c3-d82921e60d12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.664804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.664650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3191588-9590-4330-97bb-23cf395c37ac-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkgmc\" (UID: \"c3191588-9590-4330-97bb-23cf395c37ac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.664804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.664685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64l4\" (UniqueName: \"kubernetes.io/projected/d8ec3208-7aac-4ea8-a4c3-d82921e60d12-kube-api-access-r64l4\") pod \"llmisvc-controller-manager-777c6bd7d5-xnpf2\" (UID: \"d8ec3208-7aac-4ea8-a4c3-d82921e60d12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.664804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.664737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btxn9\" (UniqueName: \"kubernetes.io/projected/c3191588-9590-4330-97bb-23cf395c37ac-kube-api-access-btxn9\") pod \"kserve-controller-manager-d6f4b65b8-dkgmc\" (UID: \"c3191588-9590-4330-97bb-23cf395c37ac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.667127 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.667093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8ec3208-7aac-4ea8-a4c3-d82921e60d12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xnpf2\" (UID: \"d8ec3208-7aac-4ea8-a4c3-d82921e60d12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.667258 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.667179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3191588-9590-4330-97bb-23cf395c37ac-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkgmc\" (UID: \"c3191588-9590-4330-97bb-23cf395c37ac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.677023 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.676996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64l4\" (UniqueName: \"kubernetes.io/projected/d8ec3208-7aac-4ea8-a4c3-d82921e60d12-kube-api-access-r64l4\") pod \"llmisvc-controller-manager-777c6bd7d5-xnpf2\" (UID: \"d8ec3208-7aac-4ea8-a4c3-d82921e60d12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:40.677135 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.677047    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btxn9\" (UniqueName: \"kubernetes.io/projected/c3191588-9590-4330-97bb-23cf395c37ac-kube-api-access-btxn9\") pod \"kserve-controller-manager-d6f4b65b8-dkgmc\" (UID: \"c3191588-9590-4330-97bb-23cf395c37ac\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.799468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.799383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:40.809437 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:40.809410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:41.090748 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:41.090724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"]
Sep 07 11:57:41.091530 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:41.091506    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3191588_9590_4330_97bb_23cf395c37ac.slice/crio-4fb6d4b58f695d97daad6ec3b7d6aa1c95939f0d03c78fec81bd4b1ece551d2b WatchSource:0}: Error finding container 4fb6d4b58f695d97daad6ec3b7d6aa1c95939f0d03c78fec81bd4b1ece551d2b: Status 404 returned error can't find the container with id 4fb6d4b58f695d97daad6ec3b7d6aa1c95939f0d03c78fec81bd4b1ece551d2b
Sep 07 11:57:41.101235 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:41.099857    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"]
Sep 07 11:57:41.104141 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:57:41.104112    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd8ec3208_7aac_4ea8_a4c3_d82921e60d12.slice/crio-b62f79f9b0e663223e2f5e9e6dcc1de55ea728eaba0d13295a0f693a2898add2 WatchSource:0}: Error finding container b62f79f9b0e663223e2f5e9e6dcc1de55ea728eaba0d13295a0f693a2898add2: Status 404 returned error can't find the container with id b62f79f9b0e663223e2f5e9e6dcc1de55ea728eaba0d13295a0f693a2898add2
Sep 07 11:57:41.698360 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:41.698304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc" event={"ID":"c3191588-9590-4330-97bb-23cf395c37ac","Type":"ContainerStarted","Data":"4fb6d4b58f695d97daad6ec3b7d6aa1c95939f0d03c78fec81bd4b1ece551d2b"}
Sep 07 11:57:41.699605 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:41.699582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2" event={"ID":"d8ec3208-7aac-4ea8-a4c3-d82921e60d12","Type":"ContainerStarted","Data":"b62f79f9b0e663223e2f5e9e6dcc1de55ea728eaba0d13295a0f693a2898add2"}
Sep 07 11:57:42.281534 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.280975    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"]
Sep 07 11:57:42.281534 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.281223    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerName="discovery" containerID="cri-o://9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1" gracePeriod=30
Sep 07 11:57:42.653414 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.653383    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:42.682924 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.682883    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-kubeconfig\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.683085 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.682951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-cacerts\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.683085 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.682981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-ca-configmap\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.683085 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.683026    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-dns-cert\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.683085 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.683065    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbjt9\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-kube-api-access-jbjt9\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.683322 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.683101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5708219a-eff0-47a2-8bfb-0a67e946a12a-local-certs\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.683322 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.683133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-token\") pod \"5708219a-eff0-47a2-8bfb-0a67e946a12a\" (UID: \"5708219a-eff0-47a2-8bfb-0a67e946a12a\") "
Sep 07 11:57:42.684465 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.684209    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:57:42.687104 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.687059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-cacerts" (OuterVolumeSpecName: "cacerts") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:57:42.689275 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.689104    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-token" (OuterVolumeSpecName: "istio-token") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:57:42.689902 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.689862    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:57:42.689998 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.689946    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:57:42.689998 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.689985    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-kube-api-access-jbjt9" (OuterVolumeSpecName: "kube-api-access-jbjt9") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "kube-api-access-jbjt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:57:42.695895 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.695848    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5708219a-eff0-47a2-8bfb-0a67e946a12a-local-certs" (OuterVolumeSpecName: "local-certs") pod "5708219a-eff0-47a2-8bfb-0a67e946a12a" (UID: "5708219a-eff0-47a2-8bfb-0a67e946a12a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:57:42.709638 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.709600    2560 generic.go:356] "Generic (PLEG): container finished" podID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerID="9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1" exitCode=0
Sep 07 11:57:42.710033 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.709681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" event={"ID":"5708219a-eff0-47a2-8bfb-0a67e946a12a","Type":"ContainerDied","Data":"9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1"}
Sep 07 11:57:42.710033 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.709726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" event={"ID":"5708219a-eff0-47a2-8bfb-0a67e946a12a","Type":"ContainerDied","Data":"63aa5edd5b34de7e98b022c1da6b07669590ba0a6a7efd40c1155deb90d64966"}
Sep 07 11:57:42.710033 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.709751    2560 scope.go:117] "RemoveContainer" containerID="9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1"
Sep 07 11:57:42.710033 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.709913    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"
Sep 07 11:57:42.723967 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.723896    2560 scope.go:117] "RemoveContainer" containerID="9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1"
Sep 07 11:57:42.724373 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:57:42.724318    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1\": container with ID starting with 9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1 not found: ID does not exist" containerID="9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1"
Sep 07 11:57:42.724470 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.724383    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1"} err="failed to get container status \"9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1\": rpc error: code = NotFound desc = could not find container \"9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1\": container with ID starting with 9fe7793bf9f1738554c7e849fdcab444e359df217c48202ec82461fad0580aa1 not found: ID does not exist"
Sep 07 11:57:42.759217 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.759032    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"]
Sep 07 11:57:42.767994 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.767960    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2"]
Sep 07 11:57:42.784115 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784084    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-kubeconfig\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:42.784115 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784114    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-cacerts\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:42.784327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784127    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-ca-configmap\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:42.784327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784140    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-csr-dns-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:42.784327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784153    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbjt9\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-kube-api-access-jbjt9\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:42.784327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784163    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5708219a-eff0-47a2-8bfb-0a67e946a12a-local-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:42.784327 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:42.784174    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5708219a-eff0-47a2-8bfb-0a67e946a12a-istio-token\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:57:43.360247 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:43.360204    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" path="/var/lib/kubelet/pods/5708219a-eff0-47a2-8bfb-0a67e946a12a/volumes"
Sep 07 11:57:44.079160 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.079123    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:44.079628 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.079197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:44.084349 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.084308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:44.722661 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.722624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2" event={"ID":"d8ec3208-7aac-4ea8-a4c3-d82921e60d12","Type":"ContainerStarted","Data":"7e9fea31665fd006c1e1416273d15524614ef2de33a07eaa3154adc35a7a2880"}
Sep 07 11:57:44.722854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.722688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:57:44.724131 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.724108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc" event={"ID":"c3191588-9590-4330-97bb-23cf395c37ac","Type":"ContainerStarted","Data":"615b8f7b403ac23f57d9d96da9b74f0c257259167333484b71b36685a78188c5"}
Sep 07 11:57:44.724233 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.724148    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:57:44.727773 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.727754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ddfb5445d-bxpcd"
Sep 07 11:57:44.740922 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.740877    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2" podStartSLOduration=1.9354993820000002 podStartE2EDuration="4.740863113s" totalImagesPullingTime="2.805363731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:44.739426381 +0000 UTC m=+639.877177696" watchObservedRunningTime="2026-09-07 11:57:44.740863113 +0000 UTC m=+639.878614420"
Sep 07 11:57:44.769976 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.769925    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc" podStartSLOduration=1.954864538 podStartE2EDuration="4.769905283s" totalImagesPullingTime="2.815040745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:57:44.768896154 +0000 UTC m=+639.906647467" watchObservedRunningTime="2026-09-07 11:57:44.769905283 +0000 UTC m=+639.907656596"
Sep 07 11:57:44.786930 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:44.786893    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7b496b45-8qksj"]
Sep 07 11:57:46.675969 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:46.675936    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pnggk"
Sep 07 11:57:46.678023 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:46.678000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-f2xzf"
Sep 07 11:57:47.622432 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:47.622389    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2tjx2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 11:57:47.622625 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:57:47.622453    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2tjx2" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.34:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 11:58:09.810372 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:09.810291    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d7b496b45-8qksj" podUID="46c06e5a-69a7-4f3c-8f64-0bbc66338c60" containerName="console" containerID="cri-o://b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1" gracePeriod=15
Sep 07 11:58:10.058054 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.058028    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:58:10.132091 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132059    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-oauth-config\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132257 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-trusted-ca-bundle\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132257 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-service-ca\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132257 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-serving-cert\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132257 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-oauth-serving-cert\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132257 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132237    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-config\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132525 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132275    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28f2q\" (UniqueName: \"kubernetes.io/projected/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-kube-api-access-28f2q\") pod \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\" (UID: \"46c06e5a-69a7-4f3c-8f64-0bbc66338c60\") "
Sep 07 11:58:10.132737 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132682    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-service-ca" (OuterVolumeSpecName: "service-ca") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:58:10.132737 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132709    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:58:10.132737 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:58:10.132904 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.132732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-config" (OuterVolumeSpecName: "console-config") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:58:10.134329 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.134304    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:58:10.134552 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.134434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-kube-api-access-28f2q" (OuterVolumeSpecName: "kube-api-access-28f2q") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "kube-api-access-28f2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:58:10.134552 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.134448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46c06e5a-69a7-4f3c-8f64-0bbc66338c60" (UID: "46c06e5a-69a7-4f3c-8f64-0bbc66338c60"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 11:58:10.233559 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233502    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.233559 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233550    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.233559 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233565    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.233559 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233577    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.233840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233590    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.233840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233603    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.233840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.233615    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28f2q\" (UniqueName: \"kubernetes.io/projected/46c06e5a-69a7-4f3c-8f64-0bbc66338c60-kube-api-access-28f2q\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:10.846761 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.846727    2560 generic.go:356] "Generic (PLEG): container finished" podID="46c06e5a-69a7-4f3c-8f64-0bbc66338c60" containerID="b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1" exitCode=0
Sep 07 11:58:10.847182 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.846769    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b496b45-8qksj"
Sep 07 11:58:10.847182 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.846818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b496b45-8qksj" event={"ID":"46c06e5a-69a7-4f3c-8f64-0bbc66338c60","Type":"ContainerDied","Data":"b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1"}
Sep 07 11:58:10.847182 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.846868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b496b45-8qksj" event={"ID":"46c06e5a-69a7-4f3c-8f64-0bbc66338c60","Type":"ContainerDied","Data":"3f22e62f0db0bcb6550eaec8e0d3abd9e673aa5347fbe53517867bede5254c32"}
Sep 07 11:58:10.847182 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.846891    2560 scope.go:117] "RemoveContainer" containerID="b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1"
Sep 07 11:58:10.856865 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.856850    2560 scope.go:117] "RemoveContainer" containerID="b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1"
Sep 07 11:58:10.857104 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:58:10.857088    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1\": container with ID starting with b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1 not found: ID does not exist" containerID="b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1"
Sep 07 11:58:10.857146 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.857111    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1"} err="failed to get container status \"b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1\": rpc error: code = NotFound desc = could not find container \"b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1\": container with ID starting with b77d9ef6f9b38b3b4193c44d75abb9af5120a73919c49c2a17820e1e7ba854f1 not found: ID does not exist"
Sep 07 11:58:10.868470 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.868443    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7b496b45-8qksj"]
Sep 07 11:58:10.871621 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:10.871600    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d7b496b45-8qksj"]
Sep 07 11:58:11.358854 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:11.358820    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46c06e5a-69a7-4f3c-8f64-0bbc66338c60" path="/var/lib/kubelet/pods/46c06e5a-69a7-4f3c-8f64-0bbc66338c60/volumes"
Sep 07 11:58:15.731824 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:15.731789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xnpf2"
Sep 07 11:58:15.735368 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:15.735334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkgmc"
Sep 07 11:58:35.557322 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557251    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"]
Sep 07 11:58:35.557675 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557603    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerName="discovery"
Sep 07 11:58:35.557675 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557617    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerName="discovery"
Sep 07 11:58:35.557675 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557627    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c06e5a-69a7-4f3c-8f64-0bbc66338c60" containerName="console"
Sep 07 11:58:35.557675 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557632    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c06e5a-69a7-4f3c-8f64-0bbc66338c60" containerName="console"
Sep 07 11:58:35.557802 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557691    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5708219a-eff0-47a2-8bfb-0a67e946a12a" containerName="discovery"
Sep 07 11:58:35.557802 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.557698    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="46c06e5a-69a7-4f3c-8f64-0bbc66338c60" containerName="console"
Sep 07 11:58:35.560783 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.560768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.563228 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.563199    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 11:58:35.564223 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.564207    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zjtz\""
Sep 07 11:58:35.564273 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.564210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 11:58:35.568569 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.568547    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"]
Sep 07 11:58:35.583149 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.583122    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"]
Sep 07 11:58:35.587214 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.587197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.591756 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.591730    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"]
Sep 07 11:58:35.649482 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.649453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25rz\" (UniqueName: \"kubernetes.io/projected/e7930627-1dab-4292-a632-6a0b1914d197-kube-api-access-w25rz\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.649666 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.649496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.649666 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.649535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnsq\" (UniqueName: \"kubernetes.io/projected/89671075-c970-4acf-b1ff-5babd2423f55-kube-api-access-2qnsq\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.649666 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.649633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.649766 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.649670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.649766 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.649691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.681318 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.681286    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"]
Sep 07 11:58:35.684776 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.684759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.693523 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.693501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"]
Sep 07 11:58:35.750110 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.750110 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxd7z\" (UniqueName: \"kubernetes.io/projected/757a4b56-ec63-46b4-ae19-a15dd6b28f08-kube-api-access-hxd7z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25rz\" (UniqueName: \"kubernetes.io/projected/e7930627-1dab-4292-a632-6a0b1914d197-kube-api-access-w25rz\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnsq\" (UniqueName: \"kubernetes.io/projected/89671075-c970-4acf-b1ff-5babd2423f55-kube-api-access-2qnsq\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.750378 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.750713 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.750713 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.750713 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.750713 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.750647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.760047 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.760012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnsq\" (UniqueName: \"kubernetes.io/projected/89671075-c970-4acf-b1ff-5babd2423f55-kube-api-access-2qnsq\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.760191 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.760169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25rz\" (UniqueName: \"kubernetes.io/projected/e7930627-1dab-4292-a632-6a0b1914d197-kube-api-access-w25rz\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.783956 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.783928    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"]
Sep 07 11:58:35.788501 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.788485    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.794994 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.794968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"]
Sep 07 11:58:35.851262 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.851262 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.851522 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.851522 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxd7z\" (UniqueName: \"kubernetes.io/projected/757a4b56-ec63-46b4-ae19-a15dd6b28f08-kube-api-access-hxd7z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.851522 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmf5g\" (UniqueName: \"kubernetes.io/projected/1f51a311-2ff7-47f6-8487-e1225b8f8119-kube-api-access-gmf5g\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.851661 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.851661 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.851807 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.851790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.861844 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.861815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxd7z\" (UniqueName: \"kubernetes.io/projected/757a4b56-ec63-46b4-ae19-a15dd6b28f08-kube-api-access-hxd7z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:35.871107 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.871085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:35.897130 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.897097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:35.952316 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.952210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmf5g\" (UniqueName: \"kubernetes.io/projected/1f51a311-2ff7-47f6-8487-e1225b8f8119-kube-api-access-gmf5g\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.952316 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.952257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.952316 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.952286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.952735 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.952699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.952948 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.952917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.962107 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.962067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmf5g\" (UniqueName: \"kubernetes.io/projected/1f51a311-2ff7-47f6-8487-e1225b8f8119-kube-api-access-gmf5g\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:35.994749 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:35.994719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:36.099684 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.099643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:36.152469 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.152021    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"]
Sep 07 11:58:36.152469 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:36.152407    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7930627_1dab_4292_a632_6a0b1914d197.slice/crio-17b1bcd2256513fd29806595c1caa3220f76f8dbcfe26244ac4c69630566275f WatchSource:0}: Error finding container 17b1bcd2256513fd29806595c1caa3220f76f8dbcfe26244ac4c69630566275f: Status 404 returned error can't find the container with id 17b1bcd2256513fd29806595c1caa3220f76f8dbcfe26244ac4c69630566275f
Sep 07 11:58:36.180595 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.180568    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"]
Sep 07 11:58:36.188402 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:36.188372    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89671075_c970_4acf_b1ff_5babd2423f55.slice/crio-fe3bdfd1197ce6907db5740a61f5c4f2c510db28634c57d21325c72f3c3727e5 WatchSource:0}: Error finding container fe3bdfd1197ce6907db5740a61f5c4f2c510db28634c57d21325c72f3c3727e5: Status 404 returned error can't find the container with id fe3bdfd1197ce6907db5740a61f5c4f2c510db28634c57d21325c72f3c3727e5
Sep 07 11:58:36.271020 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.270994    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"]
Sep 07 11:58:36.294205 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:36.294170    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757a4b56_ec63_46b4_ae19_a15dd6b28f08.slice/crio-0969ce5db50e75c60124f660301482cb56b4c4c7c7381457a37199d291577cc1 WatchSource:0}: Error finding container 0969ce5db50e75c60124f660301482cb56b4c4c7c7381457a37199d291577cc1: Status 404 returned error can't find the container with id 0969ce5db50e75c60124f660301482cb56b4c4c7c7381457a37199d291577cc1
Sep 07 11:58:36.371917 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.371890    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"]
Sep 07 11:58:36.372823 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:36.372796    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f51a311_2ff7_47f6_8487_e1225b8f8119.slice/crio-8cfa7206aaa85fd2212bb9e5e768210ab0f05fb611cc3eac9b3745a46c6cb5c3 WatchSource:0}: Error finding container 8cfa7206aaa85fd2212bb9e5e768210ab0f05fb611cc3eac9b3745a46c6cb5c3: Status 404 returned error can't find the container with id 8cfa7206aaa85fd2212bb9e5e768210ab0f05fb611cc3eac9b3745a46c6cb5c3
Sep 07 11:58:36.984844 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.984805    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerID="52a52edeccb4dba9248c5639eb804f2fc08f084019615efa3107e2d0a52d9c06" exitCode=0
Sep 07 11:58:36.985385 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.984885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n" event={"ID":"1f51a311-2ff7-47f6-8487-e1225b8f8119","Type":"ContainerDied","Data":"52a52edeccb4dba9248c5639eb804f2fc08f084019615efa3107e2d0a52d9c06"}
Sep 07 11:58:36.985385 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.984965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n" event={"ID":"1f51a311-2ff7-47f6-8487-e1225b8f8119","Type":"ContainerStarted","Data":"8cfa7206aaa85fd2212bb9e5e768210ab0f05fb611cc3eac9b3745a46c6cb5c3"}
Sep 07 11:58:36.986739 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.986709    2560 generic.go:356] "Generic (PLEG): container finished" podID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerID="c3b9b5b3ae355c2ad231938800a9ff157af70d72763198167c559027503ac94d" exitCode=0
Sep 07 11:58:36.986835 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.986794    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw" event={"ID":"757a4b56-ec63-46b4-ae19-a15dd6b28f08","Type":"ContainerDied","Data":"c3b9b5b3ae355c2ad231938800a9ff157af70d72763198167c559027503ac94d"}
Sep 07 11:58:36.986892 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.986839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw" event={"ID":"757a4b56-ec63-46b4-ae19-a15dd6b28f08","Type":"ContainerStarted","Data":"0969ce5db50e75c60124f660301482cb56b4c4c7c7381457a37199d291577cc1"}
Sep 07 11:58:36.988631 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.988608    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7930627-1dab-4292-a632-6a0b1914d197" containerID="e62336aa38952f27c4e7b422506f74e4939625ab6aa2369952e88b0003ef8b84" exitCode=0
Sep 07 11:58:36.988728 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.988708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4" event={"ID":"e7930627-1dab-4292-a632-6a0b1914d197","Type":"ContainerDied","Data":"e62336aa38952f27c4e7b422506f74e4939625ab6aa2369952e88b0003ef8b84"}
Sep 07 11:58:36.988791 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.988776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4" event={"ID":"e7930627-1dab-4292-a632-6a0b1914d197","Type":"ContainerStarted","Data":"17b1bcd2256513fd29806595c1caa3220f76f8dbcfe26244ac4c69630566275f"}
Sep 07 11:58:36.990433 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.990383    2560 generic.go:356] "Generic (PLEG): container finished" podID="89671075-c970-4acf-b1ff-5babd2423f55" containerID="e5b9103efea60958e83f8da2f1fca2e0ec8c6b113623a52242b854ef39df9175" exitCode=0
Sep 07 11:58:36.990513 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.990439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq" event={"ID":"89671075-c970-4acf-b1ff-5babd2423f55","Type":"ContainerDied","Data":"e5b9103efea60958e83f8da2f1fca2e0ec8c6b113623a52242b854ef39df9175"}
Sep 07 11:58:36.990513 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:36.990479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq" event={"ID":"89671075-c970-4acf-b1ff-5babd2423f55","Type":"ContainerStarted","Data":"fe3bdfd1197ce6907db5740a61f5c4f2c510db28634c57d21325c72f3c3727e5"}
Sep 07 11:58:38.000993 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:38.000956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq" event={"ID":"89671075-c970-4acf-b1ff-5babd2423f55","Type":"ContainerStarted","Data":"fec5e0d9a87b257f94e9a245c960bcd451a457bc0b7e8f215302d5b5c3a8f2de"}
Sep 07 11:58:38.003148 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:38.003119    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerID="8cf75f37c43e7633fcd1bf9a01c04a7067b3677334859d33946aeb2a359c6cca" exitCode=0
Sep 07 11:58:38.003249 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:38.003226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n" event={"ID":"1f51a311-2ff7-47f6-8487-e1225b8f8119","Type":"ContainerDied","Data":"8cf75f37c43e7633fcd1bf9a01c04a7067b3677334859d33946aeb2a359c6cca"}
Sep 07 11:58:38.005723 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:38.005567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw" event={"ID":"757a4b56-ec63-46b4-ae19-a15dd6b28f08","Type":"ContainerStarted","Data":"acb49831fc9c6827cf3259947e99e8b1471c19604d4d56095e14395a08860daf"}
Sep 07 11:58:38.007978 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:38.007949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4" event={"ID":"e7930627-1dab-4292-a632-6a0b1914d197","Type":"ContainerStarted","Data":"762db3b1c032cc24c061ad6a62f3638e3833d2569886467fca3147f5cc6937b9"}
Sep 07 11:58:39.015443 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.015408    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7930627-1dab-4292-a632-6a0b1914d197" containerID="762db3b1c032cc24c061ad6a62f3638e3833d2569886467fca3147f5cc6937b9" exitCode=0
Sep 07 11:58:39.015443 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.015435    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7930627-1dab-4292-a632-6a0b1914d197" containerID="f64d7011db9609fffc1e4b9d63b6440a0695ffc362bd2f6e89a0fa83732d6b7d" exitCode=0
Sep 07 11:58:39.015908 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.015498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4" event={"ID":"e7930627-1dab-4292-a632-6a0b1914d197","Type":"ContainerDied","Data":"762db3b1c032cc24c061ad6a62f3638e3833d2569886467fca3147f5cc6937b9"}
Sep 07 11:58:39.015908 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.015552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4" event={"ID":"e7930627-1dab-4292-a632-6a0b1914d197","Type":"ContainerDied","Data":"f64d7011db9609fffc1e4b9d63b6440a0695ffc362bd2f6e89a0fa83732d6b7d"}
Sep 07 11:58:39.017307 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.017283    2560 generic.go:356] "Generic (PLEG): container finished" podID="89671075-c970-4acf-b1ff-5babd2423f55" containerID="fec5e0d9a87b257f94e9a245c960bcd451a457bc0b7e8f215302d5b5c3a8f2de" exitCode=0
Sep 07 11:58:39.017421 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.017371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq" event={"ID":"89671075-c970-4acf-b1ff-5babd2423f55","Type":"ContainerDied","Data":"fec5e0d9a87b257f94e9a245c960bcd451a457bc0b7e8f215302d5b5c3a8f2de"}
Sep 07 11:58:39.019847 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.019821    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerID="4b7333b765f68ca59ae8a076e79a9c38014e686bd4a5bff03c50553abfcbeb96" exitCode=0
Sep 07 11:58:39.019948 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.019898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n" event={"ID":"1f51a311-2ff7-47f6-8487-e1225b8f8119","Type":"ContainerDied","Data":"4b7333b765f68ca59ae8a076e79a9c38014e686bd4a5bff03c50553abfcbeb96"}
Sep 07 11:58:39.021729 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.021707    2560 generic.go:356] "Generic (PLEG): container finished" podID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerID="acb49831fc9c6827cf3259947e99e8b1471c19604d4d56095e14395a08860daf" exitCode=0
Sep 07 11:58:39.021822 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:39.021751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw" event={"ID":"757a4b56-ec63-46b4-ae19-a15dd6b28f08","Type":"ContainerDied","Data":"acb49831fc9c6827cf3259947e99e8b1471c19604d4d56095e14395a08860daf"}
Sep 07 11:58:40.034370 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.034314    2560 generic.go:356] "Generic (PLEG): container finished" podID="89671075-c970-4acf-b1ff-5babd2423f55" containerID="2cf8dd1b28765755807b20fbb7afd495f5e35720e479e51fe28b10a652845742" exitCode=0
Sep 07 11:58:40.034799 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.034395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq" event={"ID":"89671075-c970-4acf-b1ff-5babd2423f55","Type":"ContainerDied","Data":"2cf8dd1b28765755807b20fbb7afd495f5e35720e479e51fe28b10a652845742"}
Sep 07 11:58:40.036707 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.036683    2560 generic.go:356] "Generic (PLEG): container finished" podID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerID="ae0a8b5ff84b120d173e29a9931f41f908efee702021f381f66caa269f58135f" exitCode=0
Sep 07 11:58:40.036816 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.036747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw" event={"ID":"757a4b56-ec63-46b4-ae19-a15dd6b28f08","Type":"ContainerDied","Data":"ae0a8b5ff84b120d173e29a9931f41f908efee702021f381f66caa269f58135f"}
Sep 07 11:58:40.178962 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.178937    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:40.208501 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.208472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:40.291219 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291125    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w25rz\" (UniqueName: \"kubernetes.io/projected/e7930627-1dab-4292-a632-6a0b1914d197-kube-api-access-w25rz\") pod \"e7930627-1dab-4292-a632-6a0b1914d197\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") "
Sep 07 11:58:40.291219 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291198    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-bundle\") pod \"e7930627-1dab-4292-a632-6a0b1914d197\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") "
Sep 07 11:58:40.291219 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-util\") pod \"1f51a311-2ff7-47f6-8487-e1225b8f8119\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") "
Sep 07 11:58:40.291555 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-util\") pod \"e7930627-1dab-4292-a632-6a0b1914d197\" (UID: \"e7930627-1dab-4292-a632-6a0b1914d197\") "
Sep 07 11:58:40.291555 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291277    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmf5g\" (UniqueName: \"kubernetes.io/projected/1f51a311-2ff7-47f6-8487-e1225b8f8119-kube-api-access-gmf5g\") pod \"1f51a311-2ff7-47f6-8487-e1225b8f8119\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") "
Sep 07 11:58:40.291555 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-bundle\") pod \"1f51a311-2ff7-47f6-8487-e1225b8f8119\" (UID: \"1f51a311-2ff7-47f6-8487-e1225b8f8119\") "
Sep 07 11:58:40.291840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-bundle" (OuterVolumeSpecName: "bundle") pod "e7930627-1dab-4292-a632-6a0b1914d197" (UID: "e7930627-1dab-4292-a632-6a0b1914d197"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:40.291988 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.291934    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-bundle" (OuterVolumeSpecName: "bundle") pod "1f51a311-2ff7-47f6-8487-e1225b8f8119" (UID: "1f51a311-2ff7-47f6-8487-e1225b8f8119"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:40.293431 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.293398    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7930627-1dab-4292-a632-6a0b1914d197-kube-api-access-w25rz" (OuterVolumeSpecName: "kube-api-access-w25rz") pod "e7930627-1dab-4292-a632-6a0b1914d197" (UID: "e7930627-1dab-4292-a632-6a0b1914d197"). InnerVolumeSpecName "kube-api-access-w25rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:58:40.293832 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.293801    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f51a311-2ff7-47f6-8487-e1225b8f8119-kube-api-access-gmf5g" (OuterVolumeSpecName: "kube-api-access-gmf5g") pod "1f51a311-2ff7-47f6-8487-e1225b8f8119" (UID: "1f51a311-2ff7-47f6-8487-e1225b8f8119"). InnerVolumeSpecName "kube-api-access-gmf5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:58:40.297194 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.297169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-util" (OuterVolumeSpecName: "util") pod "e7930627-1dab-4292-a632-6a0b1914d197" (UID: "e7930627-1dab-4292-a632-6a0b1914d197"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:40.297803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.297776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-util" (OuterVolumeSpecName: "util") pod "1f51a311-2ff7-47f6-8487-e1225b8f8119" (UID: "1f51a311-2ff7-47f6-8487-e1225b8f8119"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:40.392745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.392690    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w25rz\" (UniqueName: \"kubernetes.io/projected/e7930627-1dab-4292-a632-6a0b1914d197-kube-api-access-w25rz\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:40.392745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.392738    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:40.392745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.392749    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:40.392745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.392756    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7930627-1dab-4292-a632-6a0b1914d197-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:40.392745 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.392763    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmf5g\" (UniqueName: \"kubernetes.io/projected/1f51a311-2ff7-47f6-8487-e1225b8f8119-kube-api-access-gmf5g\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:40.393050 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:40.392772    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f51a311-2ff7-47f6-8487-e1225b8f8119-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:41.044255 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.044222    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n"
Sep 07 11:58:41.044698 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.044226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcnk2n" event={"ID":"1f51a311-2ff7-47f6-8487-e1225b8f8119","Type":"ContainerDied","Data":"8cfa7206aaa85fd2212bb9e5e768210ab0f05fb611cc3eac9b3745a46c6cb5c3"}
Sep 07 11:58:41.044698 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.044377    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cfa7206aaa85fd2212bb9e5e768210ab0f05fb611cc3eac9b3745a46c6cb5c3"
Sep 07 11:58:41.046216 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.046191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4" event={"ID":"e7930627-1dab-4292-a632-6a0b1914d197","Type":"ContainerDied","Data":"17b1bcd2256513fd29806595c1caa3220f76f8dbcfe26244ac4c69630566275f"}
Sep 07 11:58:41.046364 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.046227    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9cfw4"
Sep 07 11:58:41.046364 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.046234    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17b1bcd2256513fd29806595c1caa3220f76f8dbcfe26244ac4c69630566275f"
Sep 07 11:58:41.208237 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.208210    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:41.210214 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.210196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:41.299979 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.299892    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-util\") pod \"89671075-c970-4acf-b1ff-5babd2423f55\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") "
Sep 07 11:58:41.299979 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.299958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-bundle\") pod \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") "
Sep 07 11:58:41.300199 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.299996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-util\") pod \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") "
Sep 07 11:58:41.300199 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.300049    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-bundle\") pod \"89671075-c970-4acf-b1ff-5babd2423f55\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") "
Sep 07 11:58:41.300199 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.300092    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxd7z\" (UniqueName: \"kubernetes.io/projected/757a4b56-ec63-46b4-ae19-a15dd6b28f08-kube-api-access-hxd7z\") pod \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\" (UID: \"757a4b56-ec63-46b4-ae19-a15dd6b28f08\") "
Sep 07 11:58:41.300199 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.300122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qnsq\" (UniqueName: \"kubernetes.io/projected/89671075-c970-4acf-b1ff-5babd2423f55-kube-api-access-2qnsq\") pod \"89671075-c970-4acf-b1ff-5babd2423f55\" (UID: \"89671075-c970-4acf-b1ff-5babd2423f55\") "
Sep 07 11:58:41.300588 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.300556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-bundle" (OuterVolumeSpecName: "bundle") pod "89671075-c970-4acf-b1ff-5babd2423f55" (UID: "89671075-c970-4acf-b1ff-5babd2423f55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:41.300790 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.300758    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-bundle" (OuterVolumeSpecName: "bundle") pod "757a4b56-ec63-46b4-ae19-a15dd6b28f08" (UID: "757a4b56-ec63-46b4-ae19-a15dd6b28f08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:41.302286 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.302261    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/757a4b56-ec63-46b4-ae19-a15dd6b28f08-kube-api-access-hxd7z" (OuterVolumeSpecName: "kube-api-access-hxd7z") pod "757a4b56-ec63-46b4-ae19-a15dd6b28f08" (UID: "757a4b56-ec63-46b4-ae19-a15dd6b28f08"). InnerVolumeSpecName "kube-api-access-hxd7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:58:41.302452 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.302336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89671075-c970-4acf-b1ff-5babd2423f55-kube-api-access-2qnsq" (OuterVolumeSpecName: "kube-api-access-2qnsq") pod "89671075-c970-4acf-b1ff-5babd2423f55" (UID: "89671075-c970-4acf-b1ff-5babd2423f55"). InnerVolumeSpecName "kube-api-access-2qnsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:58:41.308868 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.308823    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-util" (OuterVolumeSpecName: "util") pod "89671075-c970-4acf-b1ff-5babd2423f55" (UID: "89671075-c970-4acf-b1ff-5babd2423f55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:41.309478 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.309460    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-util" (OuterVolumeSpecName: "util") pod "757a4b56-ec63-46b4-ae19-a15dd6b28f08" (UID: "757a4b56-ec63-46b4-ae19-a15dd6b28f08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:58:41.400906 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.400871    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:41.400906 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.400902    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:41.400906 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.400911    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/757a4b56-ec63-46b4-ae19-a15dd6b28f08-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:41.400906 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.400919    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89671075-c970-4acf-b1ff-5babd2423f55-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:41.401274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.400928    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxd7z\" (UniqueName: \"kubernetes.io/projected/757a4b56-ec63-46b4-ae19-a15dd6b28f08-kube-api-access-hxd7z\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:41.401274 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:41.400938    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qnsq\" (UniqueName: \"kubernetes.io/projected/89671075-c970-4acf-b1ff-5babd2423f55-kube-api-access-2qnsq\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:58:42.053446 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:42.053413    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw"
Sep 07 11:58:42.053845 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:42.053443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gxlvw" event={"ID":"757a4b56-ec63-46b4-ae19-a15dd6b28f08","Type":"ContainerDied","Data":"0969ce5db50e75c60124f660301482cb56b4c4c7c7381457a37199d291577cc1"}
Sep 07 11:58:42.053845 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:42.053502    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0969ce5db50e75c60124f660301482cb56b4c4c7c7381457a37199d291577cc1"
Sep 07 11:58:42.055781 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:42.055737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq" event={"ID":"89671075-c970-4acf-b1ff-5babd2423f55","Type":"ContainerDied","Data":"fe3bdfd1197ce6907db5740a61f5c4f2c510db28634c57d21325c72f3c3727e5"}
Sep 07 11:58:42.055781 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:42.055780    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wtvpq"
Sep 07 11:58:42.055979 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:42.055791    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe3bdfd1197ce6907db5740a61f5c4f2c510db28634c57d21325c72f3c3727e5"
Sep 07 11:58:48.715608 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715572    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"]
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715902    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="util"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715915    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="util"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715921    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="extract"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715928    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="extract"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715938    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="pull"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715943    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="pull"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715949    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="util"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715955    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="util"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715965    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="util"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715970    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="util"
Sep 07 11:58:48.715975 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715978    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="util"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715983    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="util"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715989    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="pull"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.715994    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="pull"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716001    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="pull"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716006    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="pull"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716016    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="pull"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716021    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="pull"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716026    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716031    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716038    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716043    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716049    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716055    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716107    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7930627-1dab-4292-a632-6a0b1914d197" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716115    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f51a311-2ff7-47f6-8487-e1225b8f8119" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716121    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="89671075-c970-4acf-b1ff-5babd2423f55" containerName="extract"
Sep 07 11:58:48.716377 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.716129    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="757a4b56-ec63-46b4-ae19-a15dd6b28f08" containerName="extract"
Sep 07 11:58:48.720454 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.720424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:48.722941 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.722916    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 11:58:48.723036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.722916    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 11:58:48.723036 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.723010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2dg9j\""
Sep 07 11:58:48.730961 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.730937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"]
Sep 07 11:58:48.864475 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.864435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxcqv\" (UniqueName: \"kubernetes.io/projected/137fa38b-3a25-41b8-8475-8db85754389a-kube-api-access-rxcqv\") pod \"kuadrant-operator-controller-manager-58fc56757c-b5568\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:48.864475 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.864477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137fa38b-3a25-41b8-8475-8db85754389a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-b5568\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:48.965687 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.965600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxcqv\" (UniqueName: \"kubernetes.io/projected/137fa38b-3a25-41b8-8475-8db85754389a-kube-api-access-rxcqv\") pod \"kuadrant-operator-controller-manager-58fc56757c-b5568\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:48.965687 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.965642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137fa38b-3a25-41b8-8475-8db85754389a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-b5568\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:48.966086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.966066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137fa38b-3a25-41b8-8475-8db85754389a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-b5568\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:48.976645 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:48.976622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxcqv\" (UniqueName: \"kubernetes.io/projected/137fa38b-3a25-41b8-8475-8db85754389a-kube-api-access-rxcqv\") pod \"kuadrant-operator-controller-manager-58fc56757c-b5568\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:49.031686 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:49.031651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:49.309858 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:49.308506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"]
Sep 07 11:58:49.312113 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:49.312082    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137fa38b_3a25_41b8_8475_8db85754389a.slice/crio-e3a369d2141a5a2969db4c34a4381a53b6799bdab55b6c0112f8c847339725a2 WatchSource:0}: Error finding container e3a369d2141a5a2969db4c34a4381a53b6799bdab55b6c0112f8c847339725a2: Status 404 returned error can't find the container with id e3a369d2141a5a2969db4c34a4381a53b6799bdab55b6c0112f8c847339725a2
Sep 07 11:58:50.105105 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.105054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568" event={"ID":"137fa38b-3a25-41b8-8475-8db85754389a","Type":"ContainerStarted","Data":"e3a369d2141a5a2969db4c34a4381a53b6799bdab55b6c0112f8c847339725a2"}
Sep 07 11:58:50.723252 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.723172    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"]
Sep 07 11:58:50.727253 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.727225    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:58:50.730317 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.729881    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kr6pr\""
Sep 07 11:58:50.740299 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.740271    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"]
Sep 07 11:58:50.782946 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.782904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9b9\" (UniqueName: \"kubernetes.io/projected/fec0b0da-7378-47bd-b542-a726ac19455d-kube-api-access-df9b9\") pod \"limitador-operator-controller-manager-6c549b6d85-bxbbq\" (UID: \"fec0b0da-7378-47bd-b542-a726ac19455d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:58:50.884544 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.884500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df9b9\" (UniqueName: \"kubernetes.io/projected/fec0b0da-7378-47bd-b542-a726ac19455d-kube-api-access-df9b9\") pod \"limitador-operator-controller-manager-6c549b6d85-bxbbq\" (UID: \"fec0b0da-7378-47bd-b542-a726ac19455d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:58:50.896653 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:50.896590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9b9\" (UniqueName: \"kubernetes.io/projected/fec0b0da-7378-47bd-b542-a726ac19455d-kube-api-access-df9b9\") pod \"limitador-operator-controller-manager-6c549b6d85-bxbbq\" (UID: \"fec0b0da-7378-47bd-b542-a726ac19455d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:58:51.043425 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:51.043303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:58:51.341886 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:51.341805    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"]
Sep 07 11:58:52.948042 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:52.947999    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-247b6"]
Sep 07 11:58:52.951972 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:52.951945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:58:52.954991 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:52.954967    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 07 11:58:52.955136 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:52.954968    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zclv4\""
Sep 07 11:58:52.965195 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:52.965168    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-247b6"]
Sep 07 11:58:53.103946 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:53.103905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzr4\" (UniqueName: \"kubernetes.io/projected/9dc39ce9-2ba3-4287-a5a4-99e5a936599e-kube-api-access-ckzr4\") pod \"dns-operator-controller-manager-5985564776-247b6\" (UID: \"9dc39ce9-2ba3-4287-a5a4-99e5a936599e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:58:53.205071 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:53.204972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzr4\" (UniqueName: \"kubernetes.io/projected/9dc39ce9-2ba3-4287-a5a4-99e5a936599e-kube-api-access-ckzr4\") pod \"dns-operator-controller-manager-5985564776-247b6\" (UID: \"9dc39ce9-2ba3-4287-a5a4-99e5a936599e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:58:53.213575 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:53.213527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzr4\" (UniqueName: \"kubernetes.io/projected/9dc39ce9-2ba3-4287-a5a4-99e5a936599e-kube-api-access-ckzr4\") pod \"dns-operator-controller-manager-5985564776-247b6\" (UID: \"9dc39ce9-2ba3-4287-a5a4-99e5a936599e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:58:53.265107 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:53.265070    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:58:53.292663 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:53.292615    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec0b0da_7378_47bd_b542_a726ac19455d.slice/crio-a03319d6ce3f9b8ce3f208dd9cb3f67d0341cc63fdf67ffa24adfb1a30790735 WatchSource:0}: Error finding container a03319d6ce3f9b8ce3f208dd9cb3f67d0341cc63fdf67ffa24adfb1a30790735: Status 404 returned error can't find the container with id a03319d6ce3f9b8ce3f208dd9cb3f67d0341cc63fdf67ffa24adfb1a30790735
Sep 07 11:58:53.577023 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:53.576994    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-247b6"]
Sep 07 11:58:53.578849 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:53.578821    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc39ce9_2ba3_4287_a5a4_99e5a936599e.slice/crio-ea5f947f37ab3685ce17bb1ce1a096349a66e87ab7ff873178d822fc135d61d7 WatchSource:0}: Error finding container ea5f947f37ab3685ce17bb1ce1a096349a66e87ab7ff873178d822fc135d61d7: Status 404 returned error can't find the container with id ea5f947f37ab3685ce17bb1ce1a096349a66e87ab7ff873178d822fc135d61d7
Sep 07 11:58:54.163768 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:54.163728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568" event={"ID":"137fa38b-3a25-41b8-8475-8db85754389a","Type":"ContainerStarted","Data":"fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5"}
Sep 07 11:58:54.164270 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:54.163817    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:58:54.165281 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:54.165250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6" event={"ID":"9dc39ce9-2ba3-4287-a5a4-99e5a936599e","Type":"ContainerStarted","Data":"ea5f947f37ab3685ce17bb1ce1a096349a66e87ab7ff873178d822fc135d61d7"}
Sep 07 11:58:54.166953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:54.166926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq" event={"ID":"fec0b0da-7378-47bd-b542-a726ac19455d","Type":"ContainerStarted","Data":"a03319d6ce3f9b8ce3f208dd9cb3f67d0341cc63fdf67ffa24adfb1a30790735"}
Sep 07 11:58:54.192714 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:54.192655    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568" podStartSLOduration=2.121014866 podStartE2EDuration="6.19263672s" totalImagesPullingTime="4.071621854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:58:54.188156627 +0000 UTC m=+709.325907937" watchObservedRunningTime="2026-09-07 11:58:54.19263672 +0000 UTC m=+709.330388085"
Sep 07 11:58:55.174645 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:55.174598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq" event={"ID":"fec0b0da-7378-47bd-b542-a726ac19455d","Type":"ContainerStarted","Data":"caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6"}
Sep 07 11:58:55.191684 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:55.191619    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq" podStartSLOduration=3.803125783 podStartE2EDuration="5.191600201s" totalImagesPullingTime="1.388474418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:58:55.191232251 +0000 UTC m=+710.328983563" watchObservedRunningTime="2026-09-07 11:58:55.191600201 +0000 UTC m=+710.329351514"
Sep 07 11:58:55.917751 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:55.917713    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-jnhtv"]
Sep 07 11:58:55.921275 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:55.921254    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:58:55.924077 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:55.924053    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pghbq\""
Sep 07 11:58:55.942853 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:55.942818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-jnhtv"]
Sep 07 11:58:56.032493 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.032457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4lv5\" (UniqueName: \"kubernetes.io/projected/6a747e2b-6040-4feb-a546-4529d5257788-kube-api-access-d4lv5\") pod \"authorino-operator-68d88948d8-jnhtv\" (UID: \"6a747e2b-6040-4feb-a546-4529d5257788\") " pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:58:56.133218 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.133173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4lv5\" (UniqueName: \"kubernetes.io/projected/6a747e2b-6040-4feb-a546-4529d5257788-kube-api-access-d4lv5\") pod \"authorino-operator-68d88948d8-jnhtv\" (UID: \"6a747e2b-6040-4feb-a546-4529d5257788\") " pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:58:56.141784 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.141748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4lv5\" (UniqueName: \"kubernetes.io/projected/6a747e2b-6040-4feb-a546-4529d5257788-kube-api-access-d4lv5\") pod \"authorino-operator-68d88948d8-jnhtv\" (UID: \"6a747e2b-6040-4feb-a546-4529d5257788\") " pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:58:56.182320 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.182223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6" event={"ID":"9dc39ce9-2ba3-4287-a5a4-99e5a936599e","Type":"ContainerStarted","Data":"6a74b5808d967ea17733c05685169903b632206dd62ec5a8bf81b76e4ceeac29"}
Sep 07 11:58:56.182789 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.182572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:58:56.182789 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.182616    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:58:56.200552 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.200497    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6" podStartSLOduration=2.397049857 podStartE2EDuration="4.200481275s" totalImagesPullingTime="1.803431418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:58:56.198039516 +0000 UTC m=+711.335790831" watchObservedRunningTime="2026-09-07 11:58:56.200481275 +0000 UTC m=+711.338232587"
Sep 07 11:58:56.231650 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.231607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:58:56.380812 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.380775    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"]
Sep 07 11:58:56.385404 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.385380    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.387878 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.387856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 07 11:58:56.388254 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.388236    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 07 11:58:56.388621 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.388607    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f8jzb\""
Sep 07 11:58:56.394550 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.394523    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"]
Sep 07 11:58:56.507376 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.507349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-jnhtv"]
Sep 07 11:58:56.509066 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:56.509039    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a747e2b_6040_4feb_a546_4529d5257788.slice/crio-b981873433f163e3d7efc0ddc1165e13e834f5017696092bc9548d74aa49734e WatchSource:0}: Error finding container b981873433f163e3d7efc0ddc1165e13e834f5017696092bc9548d74aa49734e: Status 404 returned error can't find the container with id b981873433f163e3d7efc0ddc1165e13e834f5017696092bc9548d74aa49734e
Sep 07 11:58:56.536510 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.536480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.536677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.536529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v445\" (UniqueName: \"kubernetes.io/projected/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-kube-api-access-7v445\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.536677 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.536624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.637651 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.637616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v445\" (UniqueName: \"kubernetes.io/projected/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-kube-api-access-7v445\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.637841 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.637678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.637841 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.637715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.637841 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:58:56.637800    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 07 11:58:56.637964 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:58:56.637854    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-plugin-serving-cert podName:ed0af58a-879d-4d9d-a0aa-279d1f0f193c nodeName:}" failed. No retries permitted until 2026-09-07 11:58:57.137839137 +0000 UTC m=+712.275590425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-b26pp" (UID: "ed0af58a-879d-4d9d-a0aa-279d1f0f193c") : secret "plugin-serving-cert" not found
Sep 07 11:58:56.638326 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.638306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:56.648020 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:56.647992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v445\" (UniqueName: \"kubernetes.io/projected/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-kube-api-access-7v445\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:57.143766 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:57.143731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:57.146133 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:57.146108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed0af58a-879d-4d9d-a0aa-279d1f0f193c-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-b26pp\" (UID: \"ed0af58a-879d-4d9d-a0aa-279d1f0f193c\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:57.189361 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:57.189307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv" event={"ID":"6a747e2b-6040-4feb-a546-4529d5257788","Type":"ContainerStarted","Data":"b981873433f163e3d7efc0ddc1165e13e834f5017696092bc9548d74aa49734e"}
Sep 07 11:58:57.295493 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:57.295457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"
Sep 07 11:58:57.576171 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:57.576136    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp"]
Sep 07 11:58:57.577699 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:58:57.577669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded0af58a_879d_4d9d_a0aa_279d1f0f193c.slice/crio-25c91342c30b4ccc8b2156339e6ce695561ed557523ee8a97341839aa5c4f8a5 WatchSource:0}: Error finding container 25c91342c30b4ccc8b2156339e6ce695561ed557523ee8a97341839aa5c4f8a5: Status 404 returned error can't find the container with id 25c91342c30b4ccc8b2156339e6ce695561ed557523ee8a97341839aa5c4f8a5
Sep 07 11:58:58.197325 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:58.197221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv" event={"ID":"6a747e2b-6040-4feb-a546-4529d5257788","Type":"ContainerStarted","Data":"7c2eda1d1b8cc5ea810d18aa475ffff1a9bea4ceda02f1e1d6f4c15b9491a31e"}
Sep 07 11:58:58.197764 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:58.197369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:58:58.198619 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:58.198597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp" event={"ID":"ed0af58a-879d-4d9d-a0aa-279d1f0f193c","Type":"ContainerStarted","Data":"25c91342c30b4ccc8b2156339e6ce695561ed557523ee8a97341839aa5c4f8a5"}
Sep 07 11:58:58.215135 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:58:58.215087    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv" podStartSLOduration=1.813873224 podStartE2EDuration="3.215070862s" totalImagesPullingTime="1.401197638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:58:58.213314651 +0000 UTC m=+713.351065962" watchObservedRunningTime="2026-09-07 11:58:58.215070862 +0000 UTC m=+713.352822246"
Sep 07 11:59:03.231186 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:03.231138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp" event={"ID":"ed0af58a-879d-4d9d-a0aa-279d1f0f193c","Type":"ContainerStarted","Data":"84d23913ae959490180e73f51f819ee1dd8f7023d162fecc11c347b6b54f7b35"}
Sep 07 11:59:03.246839 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:03.246781    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-b26pp" podStartSLOduration=2.143077001 podStartE2EDuration="7.246764603s" totalImagesPullingTime="5.103687602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:59:03.245157336 +0000 UTC m=+718.382908677" watchObservedRunningTime="2026-09-07 11:59:03.246764603 +0000 UTC m=+718.384515913"
Sep 07 11:59:05.177498 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:05.177463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:59:07.182988 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.182951    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"]
Sep 07 11:59:07.187899 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.187881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.191759 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.191734    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:59:07.191891 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.191793    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-247b6"
Sep 07 11:59:07.201763 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.201740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"]
Sep 07 11:59:07.276774 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.276736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"]
Sep 07 11:59:07.277220 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.277185    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568" podUID="137fa38b-3a25-41b8-8475-8db85754389a" containerName="manager" containerID="cri-o://fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5" gracePeriod=2
Sep 07 11:59:07.284261 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.284213    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"137fa38b-3a25-41b8-8475-8db85754389a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-b5568\": pods \"kuadrant-operator-controller-manager-58fc56757c-b5568\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:59:07.285954 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.285928    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"]
Sep 07 11:59:07.299718 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.299694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"]
Sep 07 11:59:07.300134 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.300102    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-nsmbq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968"
Sep 07 11:59:07.304039 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.304015    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"]
Sep 07 11:59:07.304629 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.304612    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137fa38b-3a25-41b8-8475-8db85754389a" containerName="manager"
Sep 07 11:59:07.304688 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.304633    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="137fa38b-3a25-41b8-8475-8db85754389a" containerName="manager"
Sep 07 11:59:07.304738 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.304727    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="137fa38b-3a25-41b8-8475-8db85754389a" containerName="manager"
Sep 07 11:59:07.312698 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.312471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.314320 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.314291    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"]
Sep 07 11:59:07.315652 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.315186    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-b5568\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="137fa38b-3a25-41b8-8475-8db85754389a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:59:07.323603 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.323576    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"]
Sep 07 11:59:07.325915 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.325887    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"]
Sep 07 11:59:07.329594 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.329573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.329868 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.329846    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"]
Sep 07 11:59:07.330030 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.330006    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq" podUID="fec0b0da-7378-47bd-b542-a726ac19455d" containerName="manager" containerID="cri-o://caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6" gracePeriod=2
Sep 07 11:59:07.339999 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.339950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b107ba7a-b08d-4e5d-8926-6b39ceba5968-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.340247 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.340150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsmbq\" (UniqueName: \"kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.342627 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.342502    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-b5568\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="137fa38b-3a25-41b8-8475-8db85754389a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:59:07.346227 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.346199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"]
Sep 07 11:59:07.348840 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.348780    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"]
Sep 07 11:59:07.360276 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.360250    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968" path="/var/lib/kubelet/pods/b107ba7a-b08d-4e5d-8926-6b39ceba5968/volumes"
Sep 07 11:59:07.360423 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.360409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"]
Sep 07 11:59:07.360740 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.360729    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec0b0da-7378-47bd-b542-a726ac19455d" containerName="manager"
Sep 07 11:59:07.360778 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.360743    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec0b0da-7378-47bd-b542-a726ac19455d" containerName="manager"
Sep 07 11:59:07.360826 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.360817    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec0b0da-7378-47bd-b542-a726ac19455d" containerName="manager"
Sep 07 11:59:07.366198 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.366176    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:07.367040 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.367009    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-bxbbq\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="fec0b0da-7378-47bd-b542-a726ac19455d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:59:07.374694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.374668    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"]
Sep 07 11:59:07.441447 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b107ba7a-b08d-4e5d-8926-6b39ceba5968-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.441447 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrr9w\" (UniqueName: \"kubernetes.io/projected/26425915-7d58-46dd-9ef0-4544427a173c-kube-api-access-jrr9w\") pod \"kuadrant-operator-controller-manager-58fc56757c-xrwxg\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.441585 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/956a6fff-e6dc-46cd-8f32-ea033d88072e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p4hg8\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.441585 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tznx6\" (UniqueName: \"kubernetes.io/projected/956a6fff-e6dc-46cd-8f32-ea033d88072e-kube-api-access-tznx6\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p4hg8\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.441585 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmbq\" (UniqueName: \"kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.441730 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26425915-7d58-46dd-9ef0-4544427a173c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xrwxg\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.441907 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.441879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b107ba7a-b08d-4e5d-8926-6b39ceba5968-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.446479 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.446452    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nsmbq for pod kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks: failed to fetch token: pod "kuadrant-operator-controller-manager-5b65f94d4c-kbsks" not found
Sep 07 11:59:07.446622 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.446542    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq podName:b107ba7a-b08d-4e5d-8926-6b39ceba5968 nodeName:}" failed. No retries permitted until 2026-09-07 11:59:07.946517341 +0000 UTC m=+723.084268631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nsmbq" (UniqueName: "kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq") pod "kuadrant-operator-controller-manager-5b65f94d4c-kbsks" (UID: "b107ba7a-b08d-4e5d-8926-6b39ceba5968") : failed to fetch token: pod "kuadrant-operator-controller-manager-5b65f94d4c-kbsks" not found
Sep 07 11:59:07.542680 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.542645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tznx6\" (UniqueName: \"kubernetes.io/projected/956a6fff-e6dc-46cd-8f32-ea033d88072e-kube-api-access-tznx6\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p4hg8\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.542883 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.542731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26425915-7d58-46dd-9ef0-4544427a173c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xrwxg\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.542883 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.542785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrr9w\" (UniqueName: \"kubernetes.io/projected/26425915-7d58-46dd-9ef0-4544427a173c-kube-api-access-jrr9w\") pod \"kuadrant-operator-controller-manager-58fc56757c-xrwxg\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.542883 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.542829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/956a6fff-e6dc-46cd-8f32-ea033d88072e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p4hg8\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.542883 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.542864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb64m\" (UniqueName: \"kubernetes.io/projected/e1bdb821-c0ef-4dff-9bc4-fd04407660db-kube-api-access-pb64m\") pod \"limitador-operator-controller-manager-6c549b6d85-8nb2k\" (UID: \"e1bdb821-c0ef-4dff-9bc4-fd04407660db\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:07.543188 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.543164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26425915-7d58-46dd-9ef0-4544427a173c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-xrwxg\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.543265 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.543244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/956a6fff-e6dc-46cd-8f32-ea033d88072e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p4hg8\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.555804 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.555777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tznx6\" (UniqueName: \"kubernetes.io/projected/956a6fff-e6dc-46cd-8f32-ea033d88072e-kube-api-access-tznx6\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p4hg8\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.555932 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.555907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrr9w\" (UniqueName: \"kubernetes.io/projected/26425915-7d58-46dd-9ef0-4544427a173c-kube-api-access-jrr9w\") pod \"kuadrant-operator-controller-manager-58fc56757c-xrwxg\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.576657 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.576633    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:59:07.578672 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.578654    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:59:07.644258 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.644224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb64m\" (UniqueName: \"kubernetes.io/projected/e1bdb821-c0ef-4dff-9bc4-fd04407660db-kube-api-access-pb64m\") pod \"limitador-operator-controller-manager-6c549b6d85-8nb2k\" (UID: \"e1bdb821-c0ef-4dff-9bc4-fd04407660db\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:07.655717 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.655690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb64m\" (UniqueName: \"kubernetes.io/projected/e1bdb821-c0ef-4dff-9bc4-fd04407660db-kube-api-access-pb64m\") pod \"limitador-operator-controller-manager-6c549b6d85-8nb2k\" (UID: \"e1bdb821-c0ef-4dff-9bc4-fd04407660db\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:07.716209 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.716116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:07.723266 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.723245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:07.728589 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.728565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:07.745542 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.745508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df9b9\" (UniqueName: \"kubernetes.io/projected/fec0b0da-7378-47bd-b542-a726ac19455d-kube-api-access-df9b9\") pod \"fec0b0da-7378-47bd-b542-a726ac19455d\" (UID: \"fec0b0da-7378-47bd-b542-a726ac19455d\") "
Sep 07 11:59:07.745688 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.745568    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137fa38b-3a25-41b8-8475-8db85754389a-extensions-socket-volume\") pod \"137fa38b-3a25-41b8-8475-8db85754389a\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") "
Sep 07 11:59:07.745688 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.745625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxcqv\" (UniqueName: \"kubernetes.io/projected/137fa38b-3a25-41b8-8475-8db85754389a-kube-api-access-rxcqv\") pod \"137fa38b-3a25-41b8-8475-8db85754389a\" (UID: \"137fa38b-3a25-41b8-8475-8db85754389a\") "
Sep 07 11:59:07.746413 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.746381    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137fa38b-3a25-41b8-8475-8db85754389a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "137fa38b-3a25-41b8-8475-8db85754389a" (UID: "137fa38b-3a25-41b8-8475-8db85754389a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:59:07.748428 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.748394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137fa38b-3a25-41b8-8475-8db85754389a-kube-api-access-rxcqv" (OuterVolumeSpecName: "kube-api-access-rxcqv") pod "137fa38b-3a25-41b8-8475-8db85754389a" (UID: "137fa38b-3a25-41b8-8475-8db85754389a"). InnerVolumeSpecName "kube-api-access-rxcqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:59:07.748563 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.748438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec0b0da-7378-47bd-b542-a726ac19455d-kube-api-access-df9b9" (OuterVolumeSpecName: "kube-api-access-df9b9") pod "fec0b0da-7378-47bd-b542-a726ac19455d" (UID: "fec0b0da-7378-47bd-b542-a726ac19455d"). InnerVolumeSpecName "kube-api-access-df9b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:59:07.847009 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.846974    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df9b9\" (UniqueName: \"kubernetes.io/projected/fec0b0da-7378-47bd-b542-a726ac19455d-kube-api-access-df9b9\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:07.847009 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.847004    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/137fa38b-3a25-41b8-8475-8db85754389a-extensions-socket-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:07.847009 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.847014    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxcqv\" (UniqueName: \"kubernetes.io/projected/137fa38b-3a25-41b8-8475-8db85754389a-kube-api-access-rxcqv\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:07.947985 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:07.947943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmbq\" (UniqueName: \"kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:07.950980 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.950959    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nsmbq for pod kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks: failed to fetch token: pod "kuadrant-operator-controller-manager-5b65f94d4c-kbsks" not found
Sep 07 11:59:07.951035 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:07.951023    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq podName:b107ba7a-b08d-4e5d-8926-6b39ceba5968 nodeName:}" failed. No retries permitted until 2026-09-07 11:59:08.951007726 +0000 UTC m=+724.088759014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nsmbq" (UniqueName: "kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq") pod "kuadrant-operator-controller-manager-5b65f94d4c-kbsks" (UID: "b107ba7a-b08d-4e5d-8926-6b39ceba5968") : failed to fetch token: pod "kuadrant-operator-controller-manager-5b65f94d4c-kbsks" not found
Sep 07 11:59:08.003921 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.003888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"]
Sep 07 11:59:08.006186 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:59:08.006156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26425915_7d58_46dd_9ef0_4544427a173c.slice/crio-e5ad06be984df577f9d7ace4b9cbc761bbb037c40b544b44d13c1f607c092fdb WatchSource:0}: Error finding container e5ad06be984df577f9d7ace4b9cbc761bbb037c40b544b44d13c1f607c092fdb: Status 404 returned error can't find the container with id e5ad06be984df577f9d7ace4b9cbc761bbb037c40b544b44d13c1f607c092fdb
Sep 07 11:59:08.019554 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.019525    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"]
Sep 07 11:59:08.022289 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:59:08.022264    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956a6fff_e6dc_46cd_8f32_ea033d88072e.slice/crio-4ac913a112e7541843aac7a9b1bb051a6d55cd63e4ea183f3a99d254da8de123 WatchSource:0}: Error finding container 4ac913a112e7541843aac7a9b1bb051a6d55cd63e4ea183f3a99d254da8de123: Status 404 returned error can't find the container with id 4ac913a112e7541843aac7a9b1bb051a6d55cd63e4ea183f3a99d254da8de123
Sep 07 11:59:08.026976 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.026918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"]
Sep 07 11:59:08.028572 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:59:08.028552    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bdb821_c0ef_4dff_9bc4_fd04407660db.slice/crio-40ca53e2055a488fed7fd30ab7d32bb2a147640cbc5ace6c6cb09b984a045f8b WatchSource:0}: Error finding container 40ca53e2055a488fed7fd30ab7d32bb2a147640cbc5ace6c6cb09b984a045f8b: Status 404 returned error can't find the container with id 40ca53e2055a488fed7fd30ab7d32bb2a147640cbc5ace6c6cb09b984a045f8b
Sep 07 11:59:08.266694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.266591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k" event={"ID":"e1bdb821-c0ef-4dff-9bc4-fd04407660db","Type":"ContainerStarted","Data":"5dcf8380e119fa6189c45f8ca17923ce7d11988792a4fb1df8a66db41de5444f"}
Sep 07 11:59:08.266694 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.266655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k" event={"ID":"e1bdb821-c0ef-4dff-9bc4-fd04407660db","Type":"ContainerStarted","Data":"40ca53e2055a488fed7fd30ab7d32bb2a147640cbc5ace6c6cb09b984a045f8b"}
Sep 07 11:59:08.267113 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.266741    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:08.268392 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.268366    2560 generic.go:356] "Generic (PLEG): container finished" podID="137fa38b-3a25-41b8-8475-8db85754389a" containerID="fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5" exitCode=0
Sep 07 11:59:08.268513 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.268463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b5568"
Sep 07 11:59:08.268513 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.268487    2560 scope.go:117] "RemoveContainer" containerID="fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5"
Sep 07 11:59:08.270728 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.270692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8" event={"ID":"956a6fff-e6dc-46cd-8f32-ea033d88072e","Type":"ContainerStarted","Data":"a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11"}
Sep 07 11:59:08.271093 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.270747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8" event={"ID":"956a6fff-e6dc-46cd-8f32-ea033d88072e","Type":"ContainerStarted","Data":"4ac913a112e7541843aac7a9b1bb051a6d55cd63e4ea183f3a99d254da8de123"}
Sep 07 11:59:08.271093 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.270897    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:08.272612 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.272591    2560 generic.go:356] "Generic (PLEG): container finished" podID="fec0b0da-7378-47bd-b542-a726ac19455d" containerID="caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6" exitCode=0
Sep 07 11:59:08.272721 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.272649    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bxbbq"
Sep 07 11:59:08.274765 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.274740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg" event={"ID":"26425915-7d58-46dd-9ef0-4544427a173c","Type":"ContainerStarted","Data":"5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad"}
Sep 07 11:59:08.274879 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.274791    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg" event={"ID":"26425915-7d58-46dd-9ef0-4544427a173c","Type":"ContainerStarted","Data":"e5ad06be984df577f9d7ace4b9cbc761bbb037c40b544b44d13c1f607c092fdb"}
Sep 07 11:59:08.274879 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.274833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:08.274999 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.274835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:08.281041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.280585    2560 scope.go:117] "RemoveContainer" containerID="fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5"
Sep 07 11:59:08.281041 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:08.280930    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5\": container with ID starting with fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5 not found: ID does not exist" containerID="fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5"
Sep 07 11:59:08.281041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.280971    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5"} err="failed to get container status \"fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5\": rpc error: code = NotFound desc = could not find container \"fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5\": container with ID starting with fa80f92011b5eee3169536b6e8959cf6966dccf9f5f71b095a3d7cc3901ac4e5 not found: ID does not exist"
Sep 07 11:59:08.281041 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.280992    2560 scope.go:117] "RemoveContainer" containerID="caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6"
Sep 07 11:59:08.283150 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.283126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:08.289543 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.289520    2560 scope.go:117] "RemoveContainer" containerID="caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6"
Sep 07 11:59:08.289863 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:08.289842    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6\": container with ID starting with caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6 not found: ID does not exist" containerID="caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6"
Sep 07 11:59:08.289953 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.289868    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6"} err="failed to get container status \"caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6\": rpc error: code = NotFound desc = could not find container \"caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6\": container with ID starting with caf8cd66ee83d83a9fa060f0994b3ef8938b5a13f9470ceb9bafdf34c9851eb6 not found: ID does not exist"
Sep 07 11:59:08.293200 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.293159    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k" podStartSLOduration=1.293147267 podStartE2EDuration="1.293147267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:59:08.291205525 +0000 UTC m=+723.428956839" watchObservedRunningTime="2026-09-07 11:59:08.293147267 +0000 UTC m=+723.430898627"
Sep 07 11:59:08.310225 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.310178    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg" podStartSLOduration=1.310163446 podStartE2EDuration="1.310163446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:59:08.308211151 +0000 UTC m=+723.445962474" watchObservedRunningTime="2026-09-07 11:59:08.310163446 +0000 UTC m=+723.447914757"
Sep 07 11:59:08.326004 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.325953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8" podStartSLOduration=1.325925984 podStartE2EDuration="1.325925984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:59:08.325691621 +0000 UTC m=+723.463442946" watchObservedRunningTime="2026-09-07 11:59:08.325925984 +0000 UTC m=+723.463677295"
Sep 07 11:59:08.327653 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:08.327625    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:08.453227 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.453187    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b107ba7a-b08d-4e5d-8926-6b39ceba5968-extensions-socket-volume\") pod \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\" (UID: \"b107ba7a-b08d-4e5d-8926-6b39ceba5968\") "
Sep 07 11:59:08.453468 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.453453    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsmbq\" (UniqueName: \"kubernetes.io/projected/b107ba7a-b08d-4e5d-8926-6b39ceba5968-kube-api-access-nsmbq\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:08.453549 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.453471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b107ba7a-b08d-4e5d-8926-6b39ceba5968-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b107ba7a-b08d-4e5d-8926-6b39ceba5968" (UID: "b107ba7a-b08d-4e5d-8926-6b39ceba5968"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:59:08.554111 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:08.554022    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b107ba7a-b08d-4e5d-8926-6b39ceba5968-extensions-socket-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:09.208305 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:09.208275    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-jnhtv"
Sep 07 11:59:09.229820 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:09.229786    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:09.283295 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:09.283263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:09.286061 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:09.286029    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:09.291671 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:09.291642    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-kbsks\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kbsks"
Sep 07 11:59:09.365200 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:09.365167    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="137fa38b-3a25-41b8-8475-8db85754389a" path="/var/lib/kubelet/pods/137fa38b-3a25-41b8-8475-8db85754389a/volumes"
Sep 07 11:59:09.365511 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:09.365497    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b107ba7a-b08d-4e5d-8926-6b39ceba5968" path="/var/lib/kubelet/pods/b107ba7a-b08d-4e5d-8926-6b39ceba5968/volumes"
Sep 07 11:59:09.365692 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:09.365681    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec0b0da-7378-47bd-b542-a726ac19455d" path="/var/lib/kubelet/pods/fec0b0da-7378-47bd-b542-a726ac19455d/volumes"
Sep 07 11:59:19.285465 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.285421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8nb2k"
Sep 07 11:59:19.285920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.285620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 11:59:19.285920 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.285676    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:19.403028 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.402993    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"]
Sep 07 11:59:19.403211 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.403188    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg" podUID="26425915-7d58-46dd-9ef0-4544427a173c" containerName="manager" containerID="cri-o://5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad" gracePeriod=10
Sep 07 11:59:19.670101 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.670074    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:19.751398 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.751352    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26425915-7d58-46dd-9ef0-4544427a173c-extensions-socket-volume\") pod \"26425915-7d58-46dd-9ef0-4544427a173c\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") "
Sep 07 11:59:19.751576 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.751434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrr9w\" (UniqueName: \"kubernetes.io/projected/26425915-7d58-46dd-9ef0-4544427a173c-kube-api-access-jrr9w\") pod \"26425915-7d58-46dd-9ef0-4544427a173c\" (UID: \"26425915-7d58-46dd-9ef0-4544427a173c\") "
Sep 07 11:59:19.751754 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.751730    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26425915-7d58-46dd-9ef0-4544427a173c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "26425915-7d58-46dd-9ef0-4544427a173c" (UID: "26425915-7d58-46dd-9ef0-4544427a173c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 11:59:19.753459 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.753437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26425915-7d58-46dd-9ef0-4544427a173c-kube-api-access-jrr9w" (OuterVolumeSpecName: "kube-api-access-jrr9w") pod "26425915-7d58-46dd-9ef0-4544427a173c" (UID: "26425915-7d58-46dd-9ef0-4544427a173c"). InnerVolumeSpecName "kube-api-access-jrr9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:59:19.852471 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.852387    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrr9w\" (UniqueName: \"kubernetes.io/projected/26425915-7d58-46dd-9ef0-4544427a173c-kube-api-access-jrr9w\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:19.852471 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:19.852414    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26425915-7d58-46dd-9ef0-4544427a173c-extensions-socket-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:20.345622 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.345582    2560 generic.go:356] "Generic (PLEG): container finished" podID="26425915-7d58-46dd-9ef0-4544427a173c" containerID="5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad" exitCode=0
Sep 07 11:59:20.345622 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.345624    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"
Sep 07 11:59:20.346094 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.345671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg" event={"ID":"26425915-7d58-46dd-9ef0-4544427a173c","Type":"ContainerDied","Data":"5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad"}
Sep 07 11:59:20.346094 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.345719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg" event={"ID":"26425915-7d58-46dd-9ef0-4544427a173c","Type":"ContainerDied","Data":"e5ad06be984df577f9d7ace4b9cbc761bbb037c40b544b44d13c1f607c092fdb"}
Sep 07 11:59:20.346094 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.345743    2560 scope.go:117] "RemoveContainer" containerID="5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad"
Sep 07 11:59:20.355782 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.355764    2560 scope.go:117] "RemoveContainer" containerID="5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad"
Sep 07 11:59:20.356041 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:20.356024    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad\": container with ID starting with 5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad not found: ID does not exist" containerID="5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad"
Sep 07 11:59:20.356086 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.356050    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad"} err="failed to get container status \"5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad\": rpc error: code = NotFound desc = could not find container \"5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad\": container with ID starting with 5050afb948a2d1571cd18b7f73b76cf5ae6d81c6b8efecdd4f2cdc9083088cad not found: ID does not exist"
Sep 07 11:59:20.371951 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.371916    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"]
Sep 07 11:59:20.376999 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:20.376972    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-xrwxg"]
Sep 07 11:59:21.358747 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:21.358712    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26425915-7d58-46dd-9ef0-4544427a173c" path="/var/lib/kubelet/pods/26425915-7d58-46dd-9ef0-4544427a173c/volumes"
Sep 07 11:59:37.776103 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.776063    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:37.776590 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.776451    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26425915-7d58-46dd-9ef0-4544427a173c" containerName="manager"
Sep 07 11:59:37.776590 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.776462    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="26425915-7d58-46dd-9ef0-4544427a173c" containerName="manager"
Sep 07 11:59:37.776590 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.776530    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="26425915-7d58-46dd-9ef0-4544427a173c" containerName="manager"
Sep 07 11:59:37.792205 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.792174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:37.792390 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.792269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:37.794907 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.794875    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 11:59:37.867595 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.867555    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:37.910292 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.910251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvbd\" (UniqueName: \"kubernetes.io/projected/ed618604-99c4-4459-a168-b7700ac166c4-kube-api-access-pwvbd\") pod \"limitador-limitador-859c4d96d6-6dzbh\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:37.910470 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:37.910417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed618604-99c4-4459-a168-b7700ac166c4-config-file\") pod \"limitador-limitador-859c4d96d6-6dzbh\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:38.011740 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.011700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvbd\" (UniqueName: \"kubernetes.io/projected/ed618604-99c4-4459-a168-b7700ac166c4-kube-api-access-pwvbd\") pod \"limitador-limitador-859c4d96d6-6dzbh\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:38.011913 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.011800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed618604-99c4-4459-a168-b7700ac166c4-config-file\") pod \"limitador-limitador-859c4d96d6-6dzbh\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:38.012402 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.012383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed618604-99c4-4459-a168-b7700ac166c4-config-file\") pod \"limitador-limitador-859c4d96d6-6dzbh\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:38.019816 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.019790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvbd\" (UniqueName: \"kubernetes.io/projected/ed618604-99c4-4459-a168-b7700ac166c4-kube-api-access-pwvbd\") pod \"limitador-limitador-859c4d96d6-6dzbh\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:38.102943 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.102909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:38.377780 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.377059    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:38.454307 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.454266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh" event={"ID":"ed618604-99c4-4459-a168-b7700ac166c4","Type":"ContainerStarted","Data":"cfb150f5ff8b57388615468fa75e5d09516bde01cd377f8e37e26cb73d9ecf27"}
Sep 07 11:59:38.619535 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.619502    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-6ksrx"]
Sep 07 11:59:38.624314 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.624247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 11:59:38.626904 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.626883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gfsh7\""
Sep 07 11:59:38.630945 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.630876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-6ksrx"]
Sep 07 11:59:38.720093 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.720051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkk7f\" (UniqueName: \"kubernetes.io/projected/893caffe-977d-4634-b64d-eee93f3d0366-kube-api-access-fkk7f\") pod \"authorino-c548b5d7d-6ksrx\" (UID: \"893caffe-977d-4634-b64d-eee93f3d0366\") " pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 11:59:38.821190 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.821147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkk7f\" (UniqueName: \"kubernetes.io/projected/893caffe-977d-4634-b64d-eee93f3d0366-kube-api-access-fkk7f\") pod \"authorino-c548b5d7d-6ksrx\" (UID: \"893caffe-977d-4634-b64d-eee93f3d0366\") " pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 11:59:38.828722 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.828694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkk7f\" (UniqueName: \"kubernetes.io/projected/893caffe-977d-4634-b64d-eee93f3d0366-kube-api-access-fkk7f\") pod \"authorino-c548b5d7d-6ksrx\" (UID: \"893caffe-977d-4634-b64d-eee93f3d0366\") " pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 11:59:38.935524 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:38.935430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 11:59:39.204169 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:39.204143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-6ksrx"]
Sep 07 11:59:39.205595 ip-10-0-138-55 kubenswrapper[2560]: W0907 11:59:39.205560    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893caffe_977d_4634_b64d_eee93f3d0366.slice/crio-63a3bc989f020c5c39ce3d1e300cb97478042bcfe5608b40c3544e2ed7787310 WatchSource:0}: Error finding container 63a3bc989f020c5c39ce3d1e300cb97478042bcfe5608b40c3544e2ed7787310: Status 404 returned error can't find the container with id 63a3bc989f020c5c39ce3d1e300cb97478042bcfe5608b40c3544e2ed7787310
Sep 07 11:59:39.462944 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:39.462851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-6ksrx" event={"ID":"893caffe-977d-4634-b64d-eee93f3d0366","Type":"ContainerStarted","Data":"63a3bc989f020c5c39ce3d1e300cb97478042bcfe5608b40c3544e2ed7787310"}
Sep 07 11:59:40.474198 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:40.474159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh" event={"ID":"ed618604-99c4-4459-a168-b7700ac166c4","Type":"ContainerStarted","Data":"dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df"}
Sep 07 11:59:40.474815 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:40.474392    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:40.491707 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:40.491652    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh" podStartSLOduration=2.176948655 podStartE2EDuration="3.491631451s" totalImagesPullingTime="1.314682796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:59:40.490332792 +0000 UTC m=+755.628084106" watchObservedRunningTime="2026-09-07 11:59:40.491631451 +0000 UTC m=+755.629382763"
Sep 07 11:59:41.480928 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:41.480888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-6ksrx" event={"ID":"893caffe-977d-4634-b64d-eee93f3d0366","Type":"ContainerStarted","Data":"2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6"}
Sep 07 11:59:41.496301 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:41.496251    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-6ksrx" podStartSLOduration=1.392835619 podStartE2EDuration="3.496234435s" totalImagesPullingTime="2.103398816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 11:59:41.493938111 +0000 UTC m=+756.631689413" watchObservedRunningTime="2026-09-07 11:59:41.496234435 +0000 UTC m=+756.633985796"
Sep 07 11:59:51.481991 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:51.481956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:52.969701 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:52.969648    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:52.970209 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:52.969849    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh" podUID="ed618604-99c4-4459-a168-b7700ac166c4" containerName="limitador" containerID="cri-o://dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df" gracePeriod=30
Sep 07 11:59:53.523973 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.523949    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:53.551020 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.550946    2560 generic.go:356] "Generic (PLEG): container finished" podID="ed618604-99c4-4459-a168-b7700ac166c4" containerID="dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df" exitCode=0
Sep 07 11:59:53.551020 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.551002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"
Sep 07 11:59:53.551190 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.550998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh" event={"ID":"ed618604-99c4-4459-a168-b7700ac166c4","Type":"ContainerDied","Data":"dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df"}
Sep 07 11:59:53.551190 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.551122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6dzbh" event={"ID":"ed618604-99c4-4459-a168-b7700ac166c4","Type":"ContainerDied","Data":"cfb150f5ff8b57388615468fa75e5d09516bde01cd377f8e37e26cb73d9ecf27"}
Sep 07 11:59:53.551190 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.551145    2560 scope.go:117] "RemoveContainer" containerID="dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df"
Sep 07 11:59:53.559875 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.559858    2560 scope.go:117] "RemoveContainer" containerID="dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df"
Sep 07 11:59:53.560155 ip-10-0-138-55 kubenswrapper[2560]: E0907 11:59:53.560138    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df\": container with ID starting with dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df not found: ID does not exist" containerID="dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df"
Sep 07 11:59:53.560205 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.560162    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df"} err="failed to get container status \"dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df\": rpc error: code = NotFound desc = could not find container \"dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df\": container with ID starting with dfca2d50c2c8b2cbce04b825da7e5fff46d5b8410a9ee87f86f9a2aa5bcc91df not found: ID does not exist"
Sep 07 11:59:53.650833 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.650799    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwvbd\" (UniqueName: \"kubernetes.io/projected/ed618604-99c4-4459-a168-b7700ac166c4-kube-api-access-pwvbd\") pod \"ed618604-99c4-4459-a168-b7700ac166c4\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") "
Sep 07 11:59:53.651029 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.650854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed618604-99c4-4459-a168-b7700ac166c4-config-file\") pod \"ed618604-99c4-4459-a168-b7700ac166c4\" (UID: \"ed618604-99c4-4459-a168-b7700ac166c4\") "
Sep 07 11:59:53.651252 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.651222    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed618604-99c4-4459-a168-b7700ac166c4-config-file" (OuterVolumeSpecName: "config-file") pod "ed618604-99c4-4459-a168-b7700ac166c4" (UID: "ed618604-99c4-4459-a168-b7700ac166c4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 11:59:53.652990 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.652965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed618604-99c4-4459-a168-b7700ac166c4-kube-api-access-pwvbd" (OuterVolumeSpecName: "kube-api-access-pwvbd") pod "ed618604-99c4-4459-a168-b7700ac166c4" (UID: "ed618604-99c4-4459-a168-b7700ac166c4"). InnerVolumeSpecName "kube-api-access-pwvbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 11:59:53.751770 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.751732    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwvbd\" (UniqueName: \"kubernetes.io/projected/ed618604-99c4-4459-a168-b7700ac166c4-kube-api-access-pwvbd\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:53.751770 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.751763    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed618604-99c4-4459-a168-b7700ac166c4-config-file\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 11:59:53.872763 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.872729    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:53.876852 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:53.876824    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6dzbh"]
Sep 07 11:59:55.361870 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:55.361831    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed618604-99c4-4459-a168-b7700ac166c4" path="/var/lib/kubelet/pods/ed618604-99c4-4459-a168-b7700ac166c4/volumes"
Sep 07 11:59:59.441061 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.441028    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"]
Sep 07 11:59:59.441423 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.441415    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed618604-99c4-4459-a168-b7700ac166c4" containerName="limitador"
Sep 07 11:59:59.441486 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.441427    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed618604-99c4-4459-a168-b7700ac166c4" containerName="limitador"
Sep 07 11:59:59.441520 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.441486    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed618604-99c4-4459-a168-b7700ac166c4" containerName="limitador"
Sep 07 11:59:59.445803 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.445779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.448598 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.448570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 11:59:59.448725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.448570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 11:59:59.448725 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.448621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 07 11:59:59.450165 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.450147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-kqndv\""
Sep 07 11:59:59.453453 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.453431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"]
Sep 07 11:59:59.505159 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.505127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/610b7e87-bd6f-4403-ae83-b92320a0d6e6-data\") pod \"postgres-69fb4594cf-66zk9\" (UID: \"610b7e87-bd6f-4403-ae83-b92320a0d6e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.505391 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.505192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgx5w\" (UniqueName: \"kubernetes.io/projected/610b7e87-bd6f-4403-ae83-b92320a0d6e6-kube-api-access-hgx5w\") pod \"postgres-69fb4594cf-66zk9\" (UID: \"610b7e87-bd6f-4403-ae83-b92320a0d6e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.606066 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.606033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/610b7e87-bd6f-4403-ae83-b92320a0d6e6-data\") pod \"postgres-69fb4594cf-66zk9\" (UID: \"610b7e87-bd6f-4403-ae83-b92320a0d6e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.606254 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.606083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgx5w\" (UniqueName: \"kubernetes.io/projected/610b7e87-bd6f-4403-ae83-b92320a0d6e6-kube-api-access-hgx5w\") pod \"postgres-69fb4594cf-66zk9\" (UID: \"610b7e87-bd6f-4403-ae83-b92320a0d6e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.606430 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.606410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/610b7e87-bd6f-4403-ae83-b92320a0d6e6-data\") pod \"postgres-69fb4594cf-66zk9\" (UID: \"610b7e87-bd6f-4403-ae83-b92320a0d6e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.622932 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.622899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgx5w\" (UniqueName: \"kubernetes.io/projected/610b7e87-bd6f-4403-ae83-b92320a0d6e6-kube-api-access-hgx5w\") pod \"postgres-69fb4594cf-66zk9\" (UID: \"610b7e87-bd6f-4403-ae83-b92320a0d6e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 11:59:59.757568 ip-10-0-138-55 kubenswrapper[2560]: I0907 11:59:59.757478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 12:00:00.028029 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:00.028001    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"]
Sep 07 12:00:00.029318 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:00:00.029293    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610b7e87_bd6f_4403_ae83_b92320a0d6e6.slice/crio-bc5d4072601cc6c60a433bfe3dea9b7d6b76954de07577e6c0c3f5e0b4516d4b WatchSource:0}: Error finding container bc5d4072601cc6c60a433bfe3dea9b7d6b76954de07577e6c0c3f5e0b4516d4b: Status 404 returned error can't find the container with id bc5d4072601cc6c60a433bfe3dea9b7d6b76954de07577e6c0c3f5e0b4516d4b
Sep 07 12:00:00.601687 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:00.601647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9" event={"ID":"610b7e87-bd6f-4403-ae83-b92320a0d6e6","Type":"ContainerStarted","Data":"bc5d4072601cc6c60a433bfe3dea9b7d6b76954de07577e6c0c3f5e0b4516d4b"}
Sep 07 12:00:05.639939 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:05.639894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9" event={"ID":"610b7e87-bd6f-4403-ae83-b92320a0d6e6","Type":"ContainerStarted","Data":"822983e73655d943df0d2e5623c1eecd333287884fa132311ad6dc7705240f18"}
Sep 07 12:00:05.640365 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:05.639966    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 12:00:05.655272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:05.655221    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9" podStartSLOduration=1.9031708470000002 podStartE2EDuration="6.655204843s" totalImagesPullingTime="4.752033996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 11:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:00:05.652511275 +0000 UTC m=+780.790262591" watchObservedRunningTime="2026-09-07 12:00:05.655204843 +0000 UTC m=+780.792956155"
Sep 07 12:00:11.673784 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:11.673753    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-66zk9"
Sep 07 12:00:12.183986 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.183946    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-676pn"]
Sep 07 12:00:12.190813 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.190783    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:12.193171 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.193141    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-676pn"]
Sep 07 12:00:12.223658 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.223619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smp5m\" (UniqueName: \"kubernetes.io/projected/086c3eaf-ff13-456d-9047-f05e66924280-kube-api-access-smp5m\") pod \"authorino-5dc7ccb5f-676pn\" (UID: \"086c3eaf-ff13-456d-9047-f05e66924280\") " pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:12.283618 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.283581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-676pn"]
Sep 07 12:00:12.283868 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:12.283847    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-smp5m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-676pn" podUID="086c3eaf-ff13-456d-9047-f05e66924280"
Sep 07 12:00:12.304646 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.304608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-jkkp9"]
Sep 07 12:00:12.308565 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.308543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.311144 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.311111    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 12:00:12.313906 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.313883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-jkkp9"]
Sep 07 12:00:12.324475 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.324452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smp5m\" (UniqueName: \"kubernetes.io/projected/086c3eaf-ff13-456d-9047-f05e66924280-kube-api-access-smp5m\") pod \"authorino-5dc7ccb5f-676pn\" (UID: \"086c3eaf-ff13-456d-9047-f05e66924280\") " pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:12.332449 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.332422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smp5m\" (UniqueName: \"kubernetes.io/projected/086c3eaf-ff13-456d-9047-f05e66924280-kube-api-access-smp5m\") pod \"authorino-5dc7ccb5f-676pn\" (UID: \"086c3eaf-ff13-456d-9047-f05e66924280\") " pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:12.420007 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.419968    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-jkkp9"]
Sep 07 12:00:12.420242 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:12.420223    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8r4gf tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-jkkp9" podUID="1fcbb6da-b519-46d5-99cf-6cf29fd17a7f"
Sep 07 12:00:12.425634 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.425600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r4gf\" (UniqueName: \"kubernetes.io/projected/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-kube-api-access-8r4gf\") pod \"authorino-687bd45585-jkkp9\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") " pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.425755 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.425644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-tls-cert\") pod \"authorino-687bd45585-jkkp9\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") " pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.438849 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.438775    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-699d7bb664-6p8tb"]
Sep 07 12:00:12.442654 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.442631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.447010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.446986    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-699d7bb664-6p8tb"]
Sep 07 12:00:12.526157 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.526128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688pl\" (UniqueName: \"kubernetes.io/projected/8813b933-5a7e-4458-bae7-5765e8c9ac8c-kube-api-access-688pl\") pod \"authorino-699d7bb664-6p8tb\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") " pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.526372 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.526242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r4gf\" (UniqueName: \"kubernetes.io/projected/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-kube-api-access-8r4gf\") pod \"authorino-687bd45585-jkkp9\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") " pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.526372 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.526273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8813b933-5a7e-4458-bae7-5765e8c9ac8c-tls-cert\") pod \"authorino-699d7bb664-6p8tb\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") " pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.526372 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.526302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-tls-cert\") pod \"authorino-687bd45585-jkkp9\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") " pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.528658 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.528635    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-tls-cert\") pod \"authorino-687bd45585-jkkp9\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") " pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.533745 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.533721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r4gf\" (UniqueName: \"kubernetes.io/projected/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-kube-api-access-8r4gf\") pod \"authorino-687bd45585-jkkp9\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") " pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.627126 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.627079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8813b933-5a7e-4458-bae7-5765e8c9ac8c-tls-cert\") pod \"authorino-699d7bb664-6p8tb\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") " pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.627307 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.627173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688pl\" (UniqueName: \"kubernetes.io/projected/8813b933-5a7e-4458-bae7-5765e8c9ac8c-kube-api-access-688pl\") pod \"authorino-699d7bb664-6p8tb\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") " pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.629628 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.629605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8813b933-5a7e-4458-bae7-5765e8c9ac8c-tls-cert\") pod \"authorino-699d7bb664-6p8tb\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") " pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.635374 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.635320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-688pl\" (UniqueName: \"kubernetes.io/projected/8813b933-5a7e-4458-bae7-5765e8c9ac8c-kube-api-access-688pl\") pod \"authorino-699d7bb664-6p8tb\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") " pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.677834 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.677804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.678204 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.677805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:12.686460 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.686433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:12.690221 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.690145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:12.728560 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.728522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smp5m\" (UniqueName: \"kubernetes.io/projected/086c3eaf-ff13-456d-9047-f05e66924280-kube-api-access-smp5m\") pod \"086c3eaf-ff13-456d-9047-f05e66924280\" (UID: \"086c3eaf-ff13-456d-9047-f05e66924280\") "
Sep 07 12:00:12.728725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.728582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r4gf\" (UniqueName: \"kubernetes.io/projected/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-kube-api-access-8r4gf\") pod \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") "
Sep 07 12:00:12.728725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.728691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-tls-cert\") pod \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\" (UID: \"1fcbb6da-b519-46d5-99cf-6cf29fd17a7f\") "
Sep 07 12:00:12.730757 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.730725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1fcbb6da-b519-46d5-99cf-6cf29fd17a7f" (UID: "1fcbb6da-b519-46d5-99cf-6cf29fd17a7f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:00:12.730757 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.730748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/086c3eaf-ff13-456d-9047-f05e66924280-kube-api-access-smp5m" (OuterVolumeSpecName: "kube-api-access-smp5m") pod "086c3eaf-ff13-456d-9047-f05e66924280" (UID: "086c3eaf-ff13-456d-9047-f05e66924280"). InnerVolumeSpecName "kube-api-access-smp5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:00:12.730915 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.730759    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-kube-api-access-8r4gf" (OuterVolumeSpecName: "kube-api-access-8r4gf") pod "1fcbb6da-b519-46d5-99cf-6cf29fd17a7f" (UID: "1fcbb6da-b519-46d5-99cf-6cf29fd17a7f"). InnerVolumeSpecName "kube-api-access-8r4gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:00:12.752794 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.752766    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:00:12.830068 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.830025    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smp5m\" (UniqueName: \"kubernetes.io/projected/086c3eaf-ff13-456d-9047-f05e66924280-kube-api-access-smp5m\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:00:12.830211 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.830074    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r4gf\" (UniqueName: \"kubernetes.io/projected/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-kube-api-access-8r4gf\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:00:12.830211 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:12.830092    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f-tls-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:00:13.020473 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.020446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-699d7bb664-6p8tb"]
Sep 07 12:00:13.021301 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:00:13.021274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8813b933_5a7e_4458_bae7_5765e8c9ac8c.slice/crio-7ef62559e16110b477213b0fb6e76e0ddc1cbb5fb0a6ea9c318418ee94861c8f WatchSource:0}: Error finding container 7ef62559e16110b477213b0fb6e76e0ddc1cbb5fb0a6ea9c318418ee94861c8f: Status 404 returned error can't find the container with id 7ef62559e16110b477213b0fb6e76e0ddc1cbb5fb0a6ea9c318418ee94861c8f
Sep 07 12:00:13.684549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.684509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699d7bb664-6p8tb" event={"ID":"8813b933-5a7e-4458-bae7-5765e8c9ac8c","Type":"ContainerStarted","Data":"7ef62559e16110b477213b0fb6e76e0ddc1cbb5fb0a6ea9c318418ee94861c8f"}
Sep 07 12:00:13.684927 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.684558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-jkkp9"
Sep 07 12:00:13.684927 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.684559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-676pn"
Sep 07 12:00:13.710726 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.710699    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-jkkp9"]
Sep 07 12:00:13.713786 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.713754    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-jkkp9"]
Sep 07 12:00:13.730546 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.730515    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-676pn"]
Sep 07 12:00:13.732593 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:13.732567    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-676pn"]
Sep 07 12:00:15.361051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:15.361010    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="086c3eaf-ff13-456d-9047-f05e66924280" path="/var/lib/kubelet/pods/086c3eaf-ff13-456d-9047-f05e66924280/volumes"
Sep 07 12:00:15.361399 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:15.361381    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fcbb6da-b519-46d5-99cf-6cf29fd17a7f" path="/var/lib/kubelet/pods/1fcbb6da-b519-46d5-99cf-6cf29fd17a7f/volumes"
Sep 07 12:00:15.697205 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:15.697114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699d7bb664-6p8tb" event={"ID":"8813b933-5a7e-4458-bae7-5765e8c9ac8c","Type":"ContainerStarted","Data":"eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5"}
Sep 07 12:00:15.711885 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:15.711834    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-699d7bb664-6p8tb" podStartSLOduration=1.375248619 podStartE2EDuration="3.711818689s" totalImagesPullingTime="2.33657007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:00:15.709186259 +0000 UTC m=+790.846937571" watchObservedRunningTime="2026-09-07 12:00:15.711818689 +0000 UTC m=+790.849570000"
Sep 07 12:00:15.730412 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:15.730381    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-6ksrx"]
Sep 07 12:00:15.730609 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:15.730582    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-6ksrx" podUID="893caffe-977d-4634-b64d-eee93f3d0366" containerName="authorino" containerID="cri-o://2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6" gracePeriod=30
Sep 07 12:00:16.024467 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.024435    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 12:00:16.164396 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.164325    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkk7f\" (UniqueName: \"kubernetes.io/projected/893caffe-977d-4634-b64d-eee93f3d0366-kube-api-access-fkk7f\") pod \"893caffe-977d-4634-b64d-eee93f3d0366\" (UID: \"893caffe-977d-4634-b64d-eee93f3d0366\") "
Sep 07 12:00:16.166363 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.166322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893caffe-977d-4634-b64d-eee93f3d0366-kube-api-access-fkk7f" (OuterVolumeSpecName: "kube-api-access-fkk7f") pod "893caffe-977d-4634-b64d-eee93f3d0366" (UID: "893caffe-977d-4634-b64d-eee93f3d0366"). InnerVolumeSpecName "kube-api-access-fkk7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:00:16.265352 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.265258    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkk7f\" (UniqueName: \"kubernetes.io/projected/893caffe-977d-4634-b64d-eee93f3d0366-kube-api-access-fkk7f\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:00:16.703997 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.703960    2560 generic.go:356] "Generic (PLEG): container finished" podID="893caffe-977d-4634-b64d-eee93f3d0366" containerID="2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6" exitCode=0
Sep 07 12:00:16.704457 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.704002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-6ksrx"
Sep 07 12:00:16.704457 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.704044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-6ksrx" event={"ID":"893caffe-977d-4634-b64d-eee93f3d0366","Type":"ContainerDied","Data":"2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6"}
Sep 07 12:00:16.704457 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.704089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-6ksrx" event={"ID":"893caffe-977d-4634-b64d-eee93f3d0366","Type":"ContainerDied","Data":"63a3bc989f020c5c39ce3d1e300cb97478042bcfe5608b40c3544e2ed7787310"}
Sep 07 12:00:16.704457 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.704105    2560 scope.go:117] "RemoveContainer" containerID="2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6"
Sep 07 12:00:16.713463 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.713446    2560 scope.go:117] "RemoveContainer" containerID="2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6"
Sep 07 12:00:16.713719 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:16.713700    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6\": container with ID starting with 2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6 not found: ID does not exist" containerID="2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6"
Sep 07 12:00:16.713792 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.713734    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6"} err="failed to get container status \"2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6\": rpc error: code = NotFound desc = could not find container \"2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6\": container with ID starting with 2177f544d026e75e36906385c8da819b40d95994f86e4348511d1bd7641b66a6 not found: ID does not exist"
Sep 07 12:00:16.729456 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.729252    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-6ksrx"]
Sep 07 12:00:16.730861 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:16.730839    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-6ksrx"]
Sep 07 12:00:17.359733 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:17.359696    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893caffe-977d-4634-b64d-eee93f3d0366" path="/var/lib/kubelet/pods/893caffe-977d-4634-b64d-eee93f3d0366/volumes"
Sep 07 12:00:20.607635 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.607597    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c8f7b977-xrprp"]
Sep 07 12:00:20.608051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.607971    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893caffe-977d-4634-b64d-eee93f3d0366" containerName="authorino"
Sep 07 12:00:20.608051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.607984    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="893caffe-977d-4634-b64d-eee93f3d0366" containerName="authorino"
Sep 07 12:00:20.608180 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.608083    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="893caffe-977d-4634-b64d-eee93f3d0366" containerName="authorino"
Sep 07 12:00:20.616093 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.616063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.618205 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.618173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-xrprp"]
Sep 07 12:00:20.618609 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.618586    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 12:00:20.618818 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.618601    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zmfq\""
Sep 07 12:00:20.618921 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.618601    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 12:00:20.618995 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.618601    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 12:00:20.701811 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.701771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.701995 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.701840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6ns\" (UniqueName: \"kubernetes.io/projected/68415ef1-7cb7-47e7-b012-a838616d14fc-kube-api-access-9g6ns\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.701995 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.701857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.802309 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.802275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.802526 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.802354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6ns\" (UniqueName: \"kubernetes.io/projected/68415ef1-7cb7-47e7-b012-a838616d14fc-kube-api-access-9g6ns\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.802526 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.802383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:20.802526 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:20.802447    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 07 12:00:20.802526 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:20.802520    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert podName:68415ef1-7cb7-47e7-b012-a838616d14fc nodeName:}" failed. No retries permitted until 2026-09-07 12:00:21.302502882 +0000 UTC m=+796.440254176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert") pod "maas-controller-85c8f7b977-xrprp" (UID: "68415ef1-7cb7-47e7-b012-a838616d14fc") : secret "maas-controller-webhook-cert" not found
Sep 07 12:00:20.802741 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:20.802522    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 07 12:00:20.802741 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:20.802594    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs podName:68415ef1-7cb7-47e7-b012-a838616d14fc nodeName:}" failed. No retries permitted until 2026-09-07 12:00:21.302575572 +0000 UTC m=+796.440326879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs") pod "maas-controller-85c8f7b977-xrprp" (UID: "68415ef1-7cb7-47e7-b012-a838616d14fc") : secret "maas-controller-metrics-tls" not found
Sep 07 12:00:20.811505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:20.811475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6ns\" (UniqueName: \"kubernetes.io/projected/68415ef1-7cb7-47e7-b012-a838616d14fc-kube-api-access-9g6ns\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:21.307057 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:21.307012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:21.307255 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:21.307106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:21.309424 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:21.309389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:21.309586 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:21.309463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert\") pod \"maas-controller-85c8f7b977-xrprp\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") " pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:21.528153 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:21.528121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:21.801767 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:21.801741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-xrprp"]
Sep 07 12:00:21.803249 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:00:21.803218    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68415ef1_7cb7_47e7_b012_a838616d14fc.slice/crio-c5a336383bb6e07276993172a1f7fd78891879fb84e21676e0ed7fed76b6dfc3 WatchSource:0}: Error finding container c5a336383bb6e07276993172a1f7fd78891879fb84e21676e0ed7fed76b6dfc3: Status 404 returned error can't find the container with id c5a336383bb6e07276993172a1f7fd78891879fb84e21676e0ed7fed76b6dfc3
Sep 07 12:00:22.749169 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:22.749107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-xrprp" event={"ID":"68415ef1-7cb7-47e7-b012-a838616d14fc","Type":"ContainerStarted","Data":"c5a336383bb6e07276993172a1f7fd78891879fb84e21676e0ed7fed76b6dfc3"}
Sep 07 12:00:24.763188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:24.763147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-xrprp" event={"ID":"68415ef1-7cb7-47e7-b012-a838616d14fc","Type":"ContainerStarted","Data":"64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998"}
Sep 07 12:00:24.763608 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:24.763301    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:24.779815 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:24.779767    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c8f7b977-xrprp" podStartSLOduration=2.318562744 podStartE2EDuration="4.779754974s" totalImagesPullingTime="2.46119223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:00:24.778487087 +0000 UTC m=+799.916238501" watchObservedRunningTime="2026-09-07 12:00:24.779754974 +0000 UTC m=+799.917506285"
Sep 07 12:00:35.771875 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:35.771839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:00:59.182131 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.182083    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"]
Sep 07 12:00:59.190289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.190266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.193383 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.193333    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 12:00:59.193524 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.193332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 12:00:59.193524 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.193355    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p4vz9\""
Sep 07 12:00:59.195511 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.195484    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"]
Sep 07 12:00:59.244773 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.244733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-maas-api-tls\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.244773 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.244771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.245010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.244788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msktn\" (UniqueName: \"kubernetes.io/projected/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-kube-api-access-msktn\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.245010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.244879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-openshift-service-ca\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.346269 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.346231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-openshift-service-ca\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.346483 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.346332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-maas-api-tls\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.346483 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.346385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.346575 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:59.346480    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 07 12:00:59.346575 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.346514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msktn\" (UniqueName: \"kubernetes.io/projected/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-kube-api-access-msktn\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.346575 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:00:59.346553    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs podName:cdc6ed91-8b22-4b3a-a2ef-884d92fd578f nodeName:}" failed. No retries permitted until 2026-09-07 12:00:59.846532629 +0000 UTC m=+834.984283935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs") pod "maas-api-8cd4c9f7c-q2cf9" (UID: "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f") : secret "maas-api-metrics-tls" not found
Sep 07 12:00:59.347052 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.347029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-openshift-service-ca\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.348860 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.348839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-maas-api-tls\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.357241 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.357154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msktn\" (UniqueName: \"kubernetes.io/projected/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-kube-api-access-msktn\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.649265 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.649226    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"]
Sep 07 12:00:59.653643 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.653617    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.656082 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.656050    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8rkvz\""
Sep 07 12:00:59.656222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.656190    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 12:00:59.664841 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.664815    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"]
Sep 07 12:00:59.750633 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.750590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmx58\" (UniqueName: \"kubernetes.io/projected/25a67076-12d5-4178-9e36-05bef0704c2a-kube-api-access-rmx58\") pod \"payload-pre-processing-59fbc47bf8-krsvl\" (UID: \"25a67076-12d5-4178-9e36-05bef0704c2a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.750990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.750963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a67076-12d5-4178-9e36-05bef0704c2a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-krsvl\" (UID: \"25a67076-12d5-4178-9e36-05bef0704c2a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.852435 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.852400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a67076-12d5-4178-9e36-05bef0704c2a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-krsvl\" (UID: \"25a67076-12d5-4178-9e36-05bef0704c2a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.852641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.852473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.852641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.852503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmx58\" (UniqueName: \"kubernetes.io/projected/25a67076-12d5-4178-9e36-05bef0704c2a-kube-api-access-rmx58\") pod \"payload-pre-processing-59fbc47bf8-krsvl\" (UID: \"25a67076-12d5-4178-9e36-05bef0704c2a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.853397 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.853364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25a67076-12d5-4178-9e36-05bef0704c2a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-krsvl\" (UID: \"25a67076-12d5-4178-9e36-05bef0704c2a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.856070 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.856037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs\") pod \"maas-api-8cd4c9f7c-q2cf9\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") " pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:00:59.861153 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.861124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmx58\" (UniqueName: \"kubernetes.io/projected/25a67076-12d5-4178-9e36-05bef0704c2a-kube-api-access-rmx58\") pod \"payload-pre-processing-59fbc47bf8-krsvl\" (UID: \"25a67076-12d5-4178-9e36-05bef0704c2a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:00:59.969847 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:00:59.969496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:01:00.102273 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:00.102224    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:01:00.247612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:00.247577    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"]
Sep 07 12:01:00.249776 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:01:00.249661    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a67076_12d5_4178_9e36_05bef0704c2a.slice/crio-2278c6c4db5295d54784fcb41b903ffbde86c92320eee9d3cf703b2013550341 WatchSource:0}: Error finding container 2278c6c4db5295d54784fcb41b903ffbde86c92320eee9d3cf703b2013550341: Status 404 returned error can't find the container with id 2278c6c4db5295d54784fcb41b903ffbde86c92320eee9d3cf703b2013550341
Sep 07 12:01:00.383329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:00.383290    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"]
Sep 07 12:01:00.384224 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:01:00.384157    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc6ed91_8b22_4b3a_a2ef_884d92fd578f.slice/crio-05886b01e6fd34147d3b1da50ccb0e3a1b996961f73e09093db45bfee6a0bdd7 WatchSource:0}: Error finding container 05886b01e6fd34147d3b1da50ccb0e3a1b996961f73e09093db45bfee6a0bdd7: Status 404 returned error can't find the container with id 05886b01e6fd34147d3b1da50ccb0e3a1b996961f73e09093db45bfee6a0bdd7
Sep 07 12:01:00.973592 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:00.973543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl" event={"ID":"25a67076-12d5-4178-9e36-05bef0704c2a","Type":"ContainerStarted","Data":"2278c6c4db5295d54784fcb41b903ffbde86c92320eee9d3cf703b2013550341"}
Sep 07 12:01:00.974807 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:00.974776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9" event={"ID":"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f","Type":"ContainerStarted","Data":"05886b01e6fd34147d3b1da50ccb0e3a1b996961f73e09093db45bfee6a0bdd7"}
Sep 07 12:01:02.991411 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:02.991375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl" event={"ID":"25a67076-12d5-4178-9e36-05bef0704c2a","Type":"ContainerStarted","Data":"8d75b40b5538426821e432f3453c6db6d79d9d6ffc00a35a1aeb1f0d5d08c09c"}
Sep 07 12:01:02.991881 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:02.991438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:01:03.006462 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:03.006413    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl" podStartSLOduration=1.3924099810000001 podStartE2EDuration="4.006396869s" totalImagesPullingTime="2.613986888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:01:03.006067565 +0000 UTC m=+838.143818875" watchObservedRunningTime="2026-09-07 12:01:03.006396869 +0000 UTC m=+838.144148219"
Sep 07 12:01:03.998604 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:03.998516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9" event={"ID":"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f","Type":"ContainerStarted","Data":"2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf"}
Sep 07 12:01:04.032601 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:04.032542    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9" podStartSLOduration=1.8140637530000001 podStartE2EDuration="5.032522686s" totalImagesPullingTime="3.218458933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:01:04.030514651 +0000 UTC m=+839.168265984" watchObservedRunningTime="2026-09-07 12:01:04.032522686 +0000 UTC m=+839.170273997"
Sep 07 12:01:05.008070 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:05.008031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:01:11.019561 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:11.019529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:01:14.001522 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:14.001486    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-krsvl"
Sep 07 12:01:25.805067 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.805034    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"]
Sep 07 12:01:25.810126 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.810106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:25.814093 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.814057    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 07 12:01:25.814093 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.814079    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 12:01:25.814299 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.814106    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-59vv8\""
Sep 07 12:01:25.814299 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.814057    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 12:01:25.818378 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.818354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"]
Sep 07 12:01:25.904950 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.904911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c037955-5473-434d-aeb6-ea57d62eea36-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:25.904950 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.904948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8gp\" (UniqueName: \"kubernetes.io/projected/7c037955-5473-434d-aeb6-ea57d62eea36-kube-api-access-jq8gp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:25.905148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.904978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:25.905148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.905047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:25.905148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.905077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:25.905148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:25.905115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.006550 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.006725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.006725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.006725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c037955-5473-434d-aeb6-ea57d62eea36-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.006725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8gp\" (UniqueName: \"kubernetes.io/projected/7c037955-5473-434d-aeb6-ea57d62eea36-kube-api-access-jq8gp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.006725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.007019 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.006993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.007157 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.007033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.007157 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.007059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.008898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.008878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c037955-5473-434d-aeb6-ea57d62eea36-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.009203 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.009186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c037955-5473-434d-aeb6-ea57d62eea36-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.014329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.014308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8gp\" (UniqueName: \"kubernetes.io/projected/7c037955-5473-434d-aeb6-ea57d62eea36-kube-api-access-jq8gp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4\" (UID: \"7c037955-5473-434d-aeb6-ea57d62eea36\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.123408 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.123377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:26.400055 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:26.400027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"]
Sep 07 12:01:26.402165 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:01:26.402125    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c037955_5473_434d_aeb6_ea57d62eea36.slice/crio-de81e12da03c321886353dc19a133ab70547bcc1017461e51547ad09d728c88c WatchSource:0}: Error finding container de81e12da03c321886353dc19a133ab70547bcc1017461e51547ad09d728c88c: Status 404 returned error can't find the container with id de81e12da03c321886353dc19a133ab70547bcc1017461e51547ad09d728c88c
Sep 07 12:01:27.138373 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:27.138316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4" event={"ID":"7c037955-5473-434d-aeb6-ea57d62eea36","Type":"ContainerStarted","Data":"de81e12da03c321886353dc19a133ab70547bcc1017461e51547ad09d728c88c"}
Sep 07 12:01:28.145794 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:28.145750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4" event={"ID":"7c037955-5473-434d-aeb6-ea57d62eea36","Type":"ContainerStarted","Data":"3deb1aac2fae2eec4a65773870a60bb1f18157557e70b9eee3d660e021fcaa3d"}
Sep 07 12:01:28.164771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:28.164714    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4" podStartSLOduration=1.973598853 podStartE2EDuration="3.164699086s" totalImagesPullingTime="1.191100233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:01:28.16155183 +0000 UTC m=+863.299303159" watchObservedRunningTime="2026-09-07 12:01:28.164699086 +0000 UTC m=+863.302450398"
Sep 07 12:01:36.124048 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:36.124001    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:36.124525 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:36.124086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:36.136623 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:36.136597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:36.203214 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:36.203185    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4"
Sep 07 12:01:51.700183 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.700142    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"]
Sep 07 12:01:51.704704 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.704675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.707238 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.707209    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 07 12:01:51.714160 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.714130    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"]
Sep 07 12:01:51.721528 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.721498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.721684 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.721571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.721684 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.721627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fvbn\" (UniqueName: \"kubernetes.io/projected/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-kube-api-access-6fvbn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.721800 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.721683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.721800 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.721736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.721908 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.721809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822300 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822300 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822617 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822617 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822617 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fvbn\" (UniqueName: \"kubernetes.io/projected/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-kube-api-access-6fvbn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822617 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822818 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822818 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.822931 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.822825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.824679 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.824653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.824907 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.824887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:51.829864 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:51.829839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fvbn\" (UniqueName: \"kubernetes.io/projected/1dc5de84-1f8f-4670-8091-1bdeb09bff3d-kube-api-access-6fvbn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4\" (UID: \"1dc5de84-1f8f-4670-8091-1bdeb09bff3d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:52.016509 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:52.016404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:01:52.298680 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:52.298652    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"]
Sep 07 12:01:52.299789 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:01:52.299766    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc5de84_1f8f_4670_8091_1bdeb09bff3d.slice/crio-749f29f22cdd0e700740bd0a2b7be763a6e1c57be5c060962a9ea59e5075436c WatchSource:0}: Error finding container 749f29f22cdd0e700740bd0a2b7be763a6e1c57be5c060962a9ea59e5075436c: Status 404 returned error can't find the container with id 749f29f22cdd0e700740bd0a2b7be763a6e1c57be5c060962a9ea59e5075436c
Sep 07 12:01:53.298594 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:53.298559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4" event={"ID":"1dc5de84-1f8f-4670-8091-1bdeb09bff3d","Type":"ContainerStarted","Data":"907bfbf373fe9197ed5dae858197f2b8a090122e69d7f529cb0c4cec7608537c"}
Sep 07 12:01:53.299093 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:53.298611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4" event={"ID":"1dc5de84-1f8f-4670-8091-1bdeb09bff3d","Type":"ContainerStarted","Data":"749f29f22cdd0e700740bd0a2b7be763a6e1c57be5c060962a9ea59e5075436c"}
Sep 07 12:01:53.315041 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:01:53.314991    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4" podStartSLOduration=2.132049198 podStartE2EDuration="2.314974044s" totalImagesPullingTime="182.924846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:01:53.313806345 +0000 UTC m=+888.451557659" watchObservedRunningTime="2026-09-07 12:01:53.314974044 +0000 UTC m=+888.452725354"
Sep 07 12:02:02.017518 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:02:02.017473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:02:02.017945 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:02:02.017568    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:02:02.030837 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:02:02.030809    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:02:02.366606 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:02:02.366573    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4"
Sep 07 12:03:31.043484 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.043396    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-699d7bb664-6p8tb"]
Sep 07 12:03:31.043983 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.043641    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-699d7bb664-6p8tb" podUID="8813b933-5a7e-4458-bae7-5765e8c9ac8c" containerName="authorino" containerID="cri-o://eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5" gracePeriod=30
Sep 07 12:03:31.297980 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.297914    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:03:31.417590 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.417555    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-688pl\" (UniqueName: \"kubernetes.io/projected/8813b933-5a7e-4458-bae7-5765e8c9ac8c-kube-api-access-688pl\") pod \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") "
Sep 07 12:03:31.417775 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.417607    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8813b933-5a7e-4458-bae7-5765e8c9ac8c-tls-cert\") pod \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\" (UID: \"8813b933-5a7e-4458-bae7-5765e8c9ac8c\") "
Sep 07 12:03:31.419634 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.419603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8813b933-5a7e-4458-bae7-5765e8c9ac8c-kube-api-access-688pl" (OuterVolumeSpecName: "kube-api-access-688pl") pod "8813b933-5a7e-4458-bae7-5765e8c9ac8c" (UID: "8813b933-5a7e-4458-bae7-5765e8c9ac8c"). InnerVolumeSpecName "kube-api-access-688pl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:03:31.428382 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.428351    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8813b933-5a7e-4458-bae7-5765e8c9ac8c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8813b933-5a7e-4458-bae7-5765e8c9ac8c" (UID: "8813b933-5a7e-4458-bae7-5765e8c9ac8c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:03:31.518733 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.518699    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-688pl\" (UniqueName: \"kubernetes.io/projected/8813b933-5a7e-4458-bae7-5765e8c9ac8c-kube-api-access-688pl\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:03:31.518733 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.518734    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8813b933-5a7e-4458-bae7-5765e8c9ac8c-tls-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:03:31.869577 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.869534    2560 generic.go:356] "Generic (PLEG): container finished" podID="8813b933-5a7e-4458-bae7-5765e8c9ac8c" containerID="eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5" exitCode=0
Sep 07 12:03:31.869773 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.869590    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-699d7bb664-6p8tb"
Sep 07 12:03:31.869773 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.869612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699d7bb664-6p8tb" event={"ID":"8813b933-5a7e-4458-bae7-5765e8c9ac8c","Type":"ContainerDied","Data":"eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5"}
Sep 07 12:03:31.869773 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.869655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-699d7bb664-6p8tb" event={"ID":"8813b933-5a7e-4458-bae7-5765e8c9ac8c","Type":"ContainerDied","Data":"7ef62559e16110b477213b0fb6e76e0ddc1cbb5fb0a6ea9c318418ee94861c8f"}
Sep 07 12:03:31.869773 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.869673    2560 scope.go:117] "RemoveContainer" containerID="eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5"
Sep 07 12:03:31.879104 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.879083    2560 scope.go:117] "RemoveContainer" containerID="eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5"
Sep 07 12:03:31.879416 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:03:31.879393    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5\": container with ID starting with eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5 not found: ID does not exist" containerID="eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5"
Sep 07 12:03:31.879492 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.879423    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5"} err="failed to get container status \"eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5\": rpc error: code = NotFound desc = could not find container \"eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5\": container with ID starting with eb5e3cb357a93623d63d65b248a51e7cb1d98bfa3d24cdeb57d19a7031e83ec5 not found: ID does not exist"
Sep 07 12:03:31.890380 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.890357    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-699d7bb664-6p8tb"]
Sep 07 12:03:31.896011 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:31.895990    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-699d7bb664-6p8tb"]
Sep 07 12:03:33.359625 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:33.359589    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8813b933-5a7e-4458-bae7-5765e8c9ac8c" path="/var/lib/kubelet/pods/8813b933-5a7e-4458-bae7-5765e8c9ac8c/volumes"
Sep 07 12:03:49.948882 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.948833    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7506-140546698491440"]
Sep 07 12:03:49.949524 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.949503    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8813b933-5a7e-4458-bae7-5765e8c9ac8c" containerName="authorino"
Sep 07 12:03:49.949585 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.949527    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8813b933-5a7e-4458-bae7-5765e8c9ac8c" containerName="authorino"
Sep 07 12:03:49.949638 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.949626    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8813b933-5a7e-4458-bae7-5765e8c9ac8c" containerName="authorino"
Sep 07 12:03:49.953025 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.953009    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:49.955703 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.955671    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c7bf7\""
Sep 07 12:03:49.957491 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:49.957463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-140546698491440"]
Sep 07 12:03:50.084494 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.084453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9529\" (UniqueName: \"kubernetes.io/projected/bffef312-24b2-4168-8a98-5a1de3d46ddd-kube-api-access-c9529\") pod \"test-curl-7506-140546698491440\" (UID: \"bffef312-24b2-4168-8a98-5a1de3d46ddd\") " pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:50.185853 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.185816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9529\" (UniqueName: \"kubernetes.io/projected/bffef312-24b2-4168-8a98-5a1de3d46ddd-kube-api-access-c9529\") pod \"test-curl-7506-140546698491440\" (UID: \"bffef312-24b2-4168-8a98-5a1de3d46ddd\") " pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:50.194091 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.194054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9529\" (UniqueName: \"kubernetes.io/projected/bffef312-24b2-4168-8a98-5a1de3d46ddd-kube-api-access-c9529\") pod \"test-curl-7506-140546698491440\" (UID: \"bffef312-24b2-4168-8a98-5a1de3d46ddd\") " pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:50.265580 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.265494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:50.537593 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.537563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7506-140546698491440"]
Sep 07 12:03:50.538397 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:03:50.538370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbffef312_24b2_4168_8a98_5a1de3d46ddd.slice/crio-3e3dfb23fcedc436b7b798e378839a90eb2d7d787a8bdcba4a12d76b1aa7efb7 WatchSource:0}: Error finding container 3e3dfb23fcedc436b7b798e378839a90eb2d7d787a8bdcba4a12d76b1aa7efb7: Status 404 returned error can't find the container with id 3e3dfb23fcedc436b7b798e378839a90eb2d7d787a8bdcba4a12d76b1aa7efb7
Sep 07 12:03:50.539625 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.539606    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:03:50.993004 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:50.992967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-140546698491440" event={"ID":"bffef312-24b2-4168-8a98-5a1de3d46ddd","Type":"ContainerStarted","Data":"3e3dfb23fcedc436b7b798e378839a90eb2d7d787a8bdcba4a12d76b1aa7efb7"}
Sep 07 12:03:52.788728 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.788693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"]
Sep 07 12:03:52.792709 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.792681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:52.795075 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.795042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c7d751-serving-cert\""
Sep 07 12:03:52.804003 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.803979    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"]
Sep 07 12:03:52.912245 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.912201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-maas-api-tls\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:52.912788 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.912272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb71a24-ecdd-4222-9cc8-f395e33b054f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:52.912788 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.912462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk986\" (UniqueName: \"kubernetes.io/projected/0cb71a24-ecdd-4222-9cc8-f395e33b054f-kube-api-access-tk986\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:52.912788 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:52.912559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-metrics-certs\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.007164 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.007131    2560 generic.go:356] "Generic (PLEG): container finished" podID="bffef312-24b2-4168-8a98-5a1de3d46ddd" containerID="768810a1caee3364240da9e38c326ef5b88c538c55e4c19b0daf5f68f22e7392" exitCode=0
Sep 07 12:03:53.007327 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.007215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7506-140546698491440" event={"ID":"bffef312-24b2-4168-8a98-5a1de3d46ddd","Type":"ContainerDied","Data":"768810a1caee3364240da9e38c326ef5b88c538c55e4c19b0daf5f68f22e7392"}
Sep 07 12:03:53.013484 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.013453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb71a24-ecdd-4222-9cc8-f395e33b054f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.013598 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.013511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk986\" (UniqueName: \"kubernetes.io/projected/0cb71a24-ecdd-4222-9cc8-f395e33b054f-kube-api-access-tk986\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.013598 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.013558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-metrics-certs\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.013683 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.013596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-maas-api-tls\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.014148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.014126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb71a24-ecdd-4222-9cc8-f395e33b054f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.016310 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.016291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-maas-api-tls\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.016419 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.016334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-metrics-certs\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.022686 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.022667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk986\" (UniqueName: \"kubernetes.io/projected/0cb71a24-ecdd-4222-9cc8-f395e33b054f-kube-api-access-tk986\") pod \"maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.106597 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.106575    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:53.389389 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:53.388127    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"]
Sep 07 12:03:53.392084 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:03:53.392057    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb71a24_ecdd_4222_9cc8_f395e33b054f.slice/crio-ede3eb26428ecc857a900a1451386e7106e68b4a3f9dbe152b3d3524cf5b9c0d WatchSource:0}: Error finding container ede3eb26428ecc857a900a1451386e7106e68b4a3f9dbe152b3d3524cf5b9c0d: Status 404 returned error can't find the container with id ede3eb26428ecc857a900a1451386e7106e68b4a3f9dbe152b3d3524cf5b9c0d
Sep 07 12:03:54.014982 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.014947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n" event={"ID":"0cb71a24-ecdd-4222-9cc8-f395e33b054f","Type":"ContainerStarted","Data":"ede3eb26428ecc857a900a1451386e7106e68b4a3f9dbe152b3d3524cf5b9c0d"}
Sep 07 12:03:54.167055 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.167027    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:54.195130 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.195104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7506-140546698491440_bffef312-24b2-4168-8a98-5a1de3d46ddd/test-curl-7506-140546698491440/0.log"
Sep 07 12:03:54.215712 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.215684    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7506-140546698491440"]
Sep 07 12:03:54.218473 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.218452    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7506-140546698491440"]
Sep 07 12:03:54.225124 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.225101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9529\" (UniqueName: \"kubernetes.io/projected/bffef312-24b2-4168-8a98-5a1de3d46ddd-kube-api-access-c9529\") pod \"bffef312-24b2-4168-8a98-5a1de3d46ddd\" (UID: \"bffef312-24b2-4168-8a98-5a1de3d46ddd\") "
Sep 07 12:03:54.227466 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.227433    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bffef312-24b2-4168-8a98-5a1de3d46ddd-kube-api-access-c9529" (OuterVolumeSpecName: "kube-api-access-c9529") pod "bffef312-24b2-4168-8a98-5a1de3d46ddd" (UID: "bffef312-24b2-4168-8a98-5a1de3d46ddd"). InnerVolumeSpecName "kube-api-access-c9529". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:03:54.326150 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:54.326117    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9529\" (UniqueName: \"kubernetes.io/projected/bffef312-24b2-4168-8a98-5a1de3d46ddd-kube-api-access-c9529\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:03:55.023936 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:55.023899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n" event={"ID":"0cb71a24-ecdd-4222-9cc8-f395e33b054f","Type":"ContainerStarted","Data":"9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373"}
Sep 07 12:03:55.024433 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:55.024106    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:03:55.025257 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:55.025238    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e3dfb23fcedc436b7b798e378839a90eb2d7d787a8bdcba4a12d76b1aa7efb7"
Sep 07 12:03:55.025327 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:55.025282    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:55.041041 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:55.040990    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n" podStartSLOduration=2.435526567 podStartE2EDuration="3.040976388s" totalImagesPullingTime="605.449821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:03:55.040023638 +0000 UTC m=+1010.177774951" watchObservedRunningTime="2026-09-07 12:03:55.040976388 +0000 UTC m=+1010.178727698"
Sep 07 12:03:55.041915 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:03:55.041876    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7506-140546698491440\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="bffef312-24b2-4168-8a98-5a1de3d46ddd" pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:55.363939 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:03:55.361606    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7506-140546698491440\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="bffef312-24b2-4168-8a98-5a1de3d46ddd" pod="opendatahub/test-curl-7506-140546698491440"
Sep 07 12:03:55.366881 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:03:55.366848    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bffef312-24b2-4168-8a98-5a1de3d46ddd" path="/var/lib/kubelet/pods/bffef312-24b2-4168-8a98-5a1de3d46ddd/volumes"
Sep 07 12:04:00.304363 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.304305    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"]
Sep 07 12:04:00.305002 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.304975    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bffef312-24b2-4168-8a98-5a1de3d46ddd" containerName="test-curl-7506-140546698491440"
Sep 07 12:04:00.305002 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.305000    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bffef312-24b2-4168-8a98-5a1de3d46ddd" containerName="test-curl-7506-140546698491440"
Sep 07 12:04:00.305207 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.305112    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bffef312-24b2-4168-8a98-5a1de3d46ddd" containerName="test-curl-7506-140546698491440"
Sep 07 12:04:00.310052 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.310028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.312883 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.312856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d8796b1b-serving-cert\""
Sep 07 12:04:00.316102 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.315888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"]
Sep 07 12:04:00.383477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.383443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswnv\" (UniqueName: \"kubernetes.io/projected/48aa2402-fa72-43a9-aac0-961671bd7699-kube-api-access-dswnv\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.383477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.383481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-metrics-certs\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.383741 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.383518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa2402-fa72-43a9-aac0-961671bd7699-openshift-service-ca\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.383741 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.383663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.484678 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.484645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.484889 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.484765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dswnv\" (UniqueName: \"kubernetes.io/projected/48aa2402-fa72-43a9-aac0-961671bd7699-kube-api-access-dswnv\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.484889 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.484790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-metrics-certs\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.484889 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:00.484797    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-serving-cert: secret "maas-api-e2e-ait-d8796b1b-serving-cert" not found
Sep 07 12:04:00.484889 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.484823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa2402-fa72-43a9-aac0-961671bd7699-openshift-service-ca\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.484889 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:00.484884    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls podName:48aa2402-fa72-43a9-aac0-961671bd7699 nodeName:}" failed. No retries permitted until 2026-09-07 12:04:00.984863189 +0000 UTC m=+1016.122614497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls") pod "maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" (UID: "48aa2402-fa72-43a9-aac0-961671bd7699") : secret "maas-api-e2e-ait-d8796b1b-serving-cert" not found
Sep 07 12:04:00.485666 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.485648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa2402-fa72-43a9-aac0-961671bd7699-openshift-service-ca\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.487469 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.487450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-metrics-certs\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.494661 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.494639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswnv\" (UniqueName: \"kubernetes.io/projected/48aa2402-fa72-43a9-aac0-961671bd7699-kube-api-access-dswnv\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.940747 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.940701    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"]
Sep 07 12:04:00.944123 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.944106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:00.946577 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.946546    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d8796b1b\""
Sep 07 12:04:00.946709 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.946576    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d8796b1b-dockercfg-4td74\""
Sep 07 12:04:00.955667 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.955637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"]
Sep 07 12:04:00.961688 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.961661    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"]
Sep 07 12:04:00.965621 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.965600    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:00.977064 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.977039    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"]
Sep 07 12:04:00.990029 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.990004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:00.992490 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:00.992463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls\") pod \"maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:01.036551 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.036519    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:04:01.091588 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.091543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-plugins-config-volume\") pod \"payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") " pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.091803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.091609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkxdd\" (UniqueName: \"kubernetes.io/projected/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-kube-api-access-vkxdd\") pod \"payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") " pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.091803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.091701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.091803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.091758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzpvf\" (UniqueName: \"kubernetes.io/projected/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-kube-api-access-lzpvf\") pod \"payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.193393 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.193284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-plugins-config-volume\") pod \"payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") " pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.193393 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.193336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkxdd\" (UniqueName: \"kubernetes.io/projected/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-kube-api-access-vkxdd\") pod \"payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") " pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.193632 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.193408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.193632 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.193428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzpvf\" (UniqueName: \"kubernetes.io/projected/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-kube-api-access-lzpvf\") pod \"payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.194051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.194029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-plugins-config-volume\") pod \"payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") " pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.194182 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.194163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.204981 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.204953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzpvf\" (UniqueName: \"kubernetes.io/projected/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-kube-api-access-lzpvf\") pod \"payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.205122 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.204989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkxdd\" (UniqueName: \"kubernetes.io/projected/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-kube-api-access-vkxdd\") pod \"payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") " pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.223898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.223873    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:01.259483 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.259448    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:01.279098 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.279064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:01.498282 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.498252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"]
Sep 07 12:04:01.499410 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:01.499384    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48aa2402_fa72_43a9_aac0_961671bd7699.slice/crio-1dbc425d4105908c386725b3fda4402e3fd67a9dcc04b2ed559599c66c51090b WatchSource:0}: Error finding container 1dbc425d4105908c386725b3fda4402e3fd67a9dcc04b2ed559599c66c51090b: Status 404 returned error can't find the container with id 1dbc425d4105908c386725b3fda4402e3fd67a9dcc04b2ed559599c66c51090b
Sep 07 12:04:01.548859 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.548780    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"]
Sep 07 12:04:01.549088 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:01.549036    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa6ad2f_5bde_4dab_9bae_68184bf4e400.slice/crio-0f8e07fa4be7503c5fa803fc3acc6206f81ed7e41f30a88ea09bca87afaecfa6 WatchSource:0}: Error finding container 0f8e07fa4be7503c5fa803fc3acc6206f81ed7e41f30a88ea09bca87afaecfa6: Status 404 returned error can't find the container with id 0f8e07fa4be7503c5fa803fc3acc6206f81ed7e41f30a88ea09bca87afaecfa6
Sep 07 12:04:01.573829 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:01.573798    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f6417c_1b21_41b2_a8fd_fc1fcf7b20e6.slice/crio-5894a637d0b1a7cb4601cb040a4753122264b3681cc8e670e915eb491db25030 WatchSource:0}: Error finding container 5894a637d0b1a7cb4601cb040a4753122264b3681cc8e670e915eb491db25030: Status 404 returned error can't find the container with id 5894a637d0b1a7cb4601cb040a4753122264b3681cc8e670e915eb491db25030
Sep 07 12:04:01.574274 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:01.574250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"]
Sep 07 12:04:02.075694 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.075650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" event={"ID":"48aa2402-fa72-43a9-aac0-961671bd7699","Type":"ContainerStarted","Data":"de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb"}
Sep 07 12:04:02.075882 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.075709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" event={"ID":"48aa2402-fa72-43a9-aac0-961671bd7699","Type":"ContainerStarted","Data":"1dbc425d4105908c386725b3fda4402e3fd67a9dcc04b2ed559599c66c51090b"}
Sep 07 12:04:02.075882 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.075858    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:02.077493 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.077462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl" event={"ID":"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6","Type":"ContainerStarted","Data":"d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25"}
Sep 07 12:04:02.077621 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.077519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl" event={"ID":"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6","Type":"ContainerStarted","Data":"5894a637d0b1a7cb4601cb040a4753122264b3681cc8e670e915eb491db25030"}
Sep 07 12:04:02.077621 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.077549    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:02.079193 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.079162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw" event={"ID":"4aa6ad2f-5bde-4dab-9bae-68184bf4e400","Type":"ContainerStarted","Data":"9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297"}
Sep 07 12:04:02.079300 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.079206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:02.079300 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.079226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw" event={"ID":"4aa6ad2f-5bde-4dab-9bae-68184bf4e400","Type":"ContainerStarted","Data":"0f8e07fa4be7503c5fa803fc3acc6206f81ed7e41f30a88ea09bca87afaecfa6"}
Sep 07 12:04:02.091709 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.091453    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" podStartSLOduration=1.690473669 podStartE2EDuration="2.091438106s" totalImagesPullingTime="400.964437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:02.090648386 +0000 UTC m=+1017.228399699" watchObservedRunningTime="2026-09-07 12:04:02.091438106 +0000 UTC m=+1017.229189424"
Sep 07 12:04:02.107379 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.107325    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl" podStartSLOduration=2.107311908 podStartE2EDuration="2.107311908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:02.104893452 +0000 UTC m=+1017.242644789" watchObservedRunningTime="2026-09-07 12:04:02.107311908 +0000 UTC m=+1017.245063228"
Sep 07 12:04:02.123477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:02.123426    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw" podStartSLOduration=2.123407902 podStartE2EDuration="2.123407902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:02.12132401 +0000 UTC m=+1017.259075322" watchObservedRunningTime="2026-09-07 12:04:02.123407902 +0000 UTC m=+1017.261159217"
Sep 07 12:04:05.602328 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.602298    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"]
Sep 07 12:04:05.606471 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.606352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.609017 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.608853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-ebf845-dockercfg-gw6cn\""
Sep 07 12:04:05.609017 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.608898    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-ebf845\""
Sep 07 12:04:05.614456 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.614426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"]
Sep 07 12:04:05.739004 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.738973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7tcw\" (UniqueName: \"kubernetes.io/projected/533d5b9b-c3dc-441e-8828-ba91c4434f27-kube-api-access-p7tcw\") pod \"payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") " pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.739151 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.739101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533d5b9b-c3dc-441e-8828-ba91c4434f27-plugins-config-volume\") pod \"payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") " pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.840218 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.840181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533d5b9b-c3dc-441e-8828-ba91c4434f27-plugins-config-volume\") pod \"payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") " pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.840400 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.840294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7tcw\" (UniqueName: \"kubernetes.io/projected/533d5b9b-c3dc-441e-8828-ba91c4434f27-kube-api-access-p7tcw\") pod \"payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") " pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.840915 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.840893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533d5b9b-c3dc-441e-8828-ba91c4434f27-plugins-config-volume\") pod \"payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") " pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.853359 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.853313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7tcw\" (UniqueName: \"kubernetes.io/projected/533d5b9b-c3dc-441e-8828-ba91c4434f27-kube-api-access-p7tcw\") pod \"payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") " pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:05.919002 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:05.918966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:06.192840 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:06.192798    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"]
Sep 07 12:04:06.194690 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:06.194661    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533d5b9b_c3dc_441e_8828_ba91c4434f27.slice/crio-45f9df48908904dbb4260adf8b0710616391a4211758581ebaeeceefedf0c54f WatchSource:0}: Error finding container 45f9df48908904dbb4260adf8b0710616391a4211758581ebaeeceefedf0c54f: Status 404 returned error can't find the container with id 45f9df48908904dbb4260adf8b0710616391a4211758581ebaeeceefedf0c54f
Sep 07 12:04:07.116632 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:07.116596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll" event={"ID":"533d5b9b-c3dc-441e-8828-ba91c4434f27","Type":"ContainerStarted","Data":"331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290"}
Sep 07 12:04:07.117050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:07.116657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll" event={"ID":"533d5b9b-c3dc-441e-8828-ba91c4434f27","Type":"ContainerStarted","Data":"45f9df48908904dbb4260adf8b0710616391a4211758581ebaeeceefedf0c54f"}
Sep 07 12:04:07.117050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:07.116695    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:07.133100 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:07.133047    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll" podStartSLOduration=2.133030877 podStartE2EDuration="2.133030877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:07.131976423 +0000 UTC m=+1022.269727747" watchObservedRunningTime="2026-09-07 12:04:07.133030877 +0000 UTC m=+1022.270782187"
Sep 07 12:04:08.091963 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:08.091933    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:13.088435 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:13.088398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:13.088856 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:13.088491    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:18.126498 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:18.126464    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:04:24.915198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:24.915147    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"]
Sep 07 12:04:24.922801 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:24.922741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:24.925954 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:24.925926    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-af50c7\""
Sep 07 12:04:24.926444 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:24.926424    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-af50c7-dockercfg-72lf2\""
Sep 07 12:04:24.927005 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:24.926986    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"]
Sep 07 12:04:25.033943 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.033897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d671525-2616-412b-b453-e7b32fa935ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.034119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.033968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79k6c\" (UniqueName: \"kubernetes.io/projected/7d671525-2616-412b-b453-e7b32fa935ae-kube-api-access-79k6c\") pod \"payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.135192 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.135144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d671525-2616-412b-b453-e7b32fa935ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.135439 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.135210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79k6c\" (UniqueName: \"kubernetes.io/projected/7d671525-2616-412b-b453-e7b32fa935ae-kube-api-access-79k6c\") pod \"payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.135887 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.135864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d671525-2616-412b-b453-e7b32fa935ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.142489 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.142468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79k6c\" (UniqueName: \"kubernetes.io/projected/7d671525-2616-412b-b453-e7b32fa935ae-kube-api-access-79k6c\") pod \"payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.234932 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.234850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:25.511231 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:25.511204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"]
Sep 07 12:04:25.513568 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:25.513529    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d671525_2616_412b_b453_e7b32fa935ae.slice/crio-39165d36cc32d98435a93679ec07c20eb04abd866aea08584b46c22bc95db845 WatchSource:0}: Error finding container 39165d36cc32d98435a93679ec07c20eb04abd866aea08584b46c22bc95db845: Status 404 returned error can't find the container with id 39165d36cc32d98435a93679ec07c20eb04abd866aea08584b46c22bc95db845
Sep 07 12:04:26.240124 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:26.240079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg" event={"ID":"7d671525-2616-412b-b453-e7b32fa935ae","Type":"ContainerStarted","Data":"c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c"}
Sep 07 12:04:26.240606 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:26.240152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:26.240606 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:26.240178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg" event={"ID":"7d671525-2616-412b-b453-e7b32fa935ae","Type":"ContainerStarted","Data":"39165d36cc32d98435a93679ec07c20eb04abd866aea08584b46c22bc95db845"}
Sep 07 12:04:26.257715 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:26.257659    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg" podStartSLOduration=2.257643294 podStartE2EDuration="2.257643294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:26.255032677 +0000 UTC m=+1041.392783993" watchObservedRunningTime="2026-09-07 12:04:26.257643294 +0000 UTC m=+1041.395394604"
Sep 07 12:04:37.249798 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:37.249765    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:04:41.317718 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.317676    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"]
Sep 07 12:04:41.318219 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.317926    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" podUID="48aa2402-fa72-43a9-aac0-961671bd7699" containerName="maas-api" containerID="cri-o://de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb" gracePeriod=30
Sep 07 12:04:41.381864 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.381827    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"]
Sep 07 12:04:41.382330 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.382298    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl" podUID="72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" containerName="payload-processing" containerID="cri-o://d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25" gracePeriod=30
Sep 07 12:04:41.386385 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.386335    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"]
Sep 07 12:04:41.386792 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.386766    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw" podUID="4aa6ad2f-5bde-4dab-9bae-68184bf4e400" containerName="payload-pre-processing" containerID="cri-o://9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297" gracePeriod=30
Sep 07 12:04:41.674894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.674745    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:41.725803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.725767    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:41.729430 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.729404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:41.799829 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.799792    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkxdd\" (UniqueName: \"kubernetes.io/projected/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-kube-api-access-vkxdd\") pod \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") "
Sep 07 12:04:41.800028 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.799893    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-plugins-config-volume\") pod \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\" (UID: \"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6\") "
Sep 07 12:04:41.800251 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.800227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" (UID: "72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:04:41.801930 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.801907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-kube-api-access-vkxdd" (OuterVolumeSpecName: "kube-api-access-vkxdd") pod "72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" (UID: "72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6"). InnerVolumeSpecName "kube-api-access-vkxdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:04:41.901212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzpvf\" (UniqueName: \"kubernetes.io/projected/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-kube-api-access-lzpvf\") pod \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") "
Sep 07 12:04:41.901451 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls\") pod \"48aa2402-fa72-43a9-aac0-961671bd7699\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") "
Sep 07 12:04:41.901451 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901384    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-metrics-certs\") pod \"48aa2402-fa72-43a9-aac0-961671bd7699\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") "
Sep 07 12:04:41.901451 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901436    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dswnv\" (UniqueName: \"kubernetes.io/projected/48aa2402-fa72-43a9-aac0-961671bd7699-kube-api-access-dswnv\") pod \"48aa2402-fa72-43a9-aac0-961671bd7699\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") "
Sep 07 12:04:41.901627 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901471    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa2402-fa72-43a9-aac0-961671bd7699-openshift-service-ca\") pod \"48aa2402-fa72-43a9-aac0-961671bd7699\" (UID: \"48aa2402-fa72-43a9-aac0-961671bd7699\") "
Sep 07 12:04:41.901627 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901513    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-plugins-config-volume\") pod \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\" (UID: \"4aa6ad2f-5bde-4dab-9bae-68184bf4e400\") "
Sep 07 12:04:41.901849 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901827    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkxdd\" (UniqueName: \"kubernetes.io/projected/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-kube-api-access-vkxdd\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:41.901928 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901855    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:41.901928 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901895    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48aa2402-fa72-43a9-aac0-961671bd7699-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48aa2402-fa72-43a9-aac0-961671bd7699" (UID: "48aa2402-fa72-43a9-aac0-961671bd7699"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:04:41.902041 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.901999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4aa6ad2f-5bde-4dab-9bae-68184bf4e400" (UID: "4aa6ad2f-5bde-4dab-9bae-68184bf4e400"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:04:41.903391 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.903369    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-kube-api-access-lzpvf" (OuterVolumeSpecName: "kube-api-access-lzpvf") pod "4aa6ad2f-5bde-4dab-9bae-68184bf4e400" (UID: "4aa6ad2f-5bde-4dab-9bae-68184bf4e400"). InnerVolumeSpecName "kube-api-access-lzpvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:04:41.903566 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.903550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "48aa2402-fa72-43a9-aac0-961671bd7699" (UID: "48aa2402-fa72-43a9-aac0-961671bd7699"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:04:41.903835 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.903816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48aa2402-fa72-43a9-aac0-961671bd7699" (UID: "48aa2402-fa72-43a9-aac0-961671bd7699"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:04:41.903893 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:41.903826    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48aa2402-fa72-43a9-aac0-961671bd7699-kube-api-access-dswnv" (OuterVolumeSpecName: "kube-api-access-dswnv") pod "48aa2402-fa72-43a9-aac0-961671bd7699" (UID: "48aa2402-fa72-43a9-aac0-961671bd7699"). InnerVolumeSpecName "kube-api-access-dswnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:04:42.003007 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.002952    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzpvf\" (UniqueName: \"kubernetes.io/projected/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-kube-api-access-lzpvf\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:42.003007 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.003002    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:42.003007 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.003011    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48aa2402-fa72-43a9-aac0-961671bd7699-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:42.003007 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.003019    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dswnv\" (UniqueName: \"kubernetes.io/projected/48aa2402-fa72-43a9-aac0-961671bd7699-kube-api-access-dswnv\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:42.003007 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.003028    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48aa2402-fa72-43a9-aac0-961671bd7699-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:42.003328 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.003037    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aa6ad2f-5bde-4dab-9bae-68184bf4e400-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:04:42.342505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.342474    2560 generic.go:356] "Generic (PLEG): container finished" podID="4aa6ad2f-5bde-4dab-9bae-68184bf4e400" containerID="9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297" exitCode=0
Sep 07 12:04:42.342898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.342533    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"
Sep 07 12:04:42.342898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.342554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw" event={"ID":"4aa6ad2f-5bde-4dab-9bae-68184bf4e400","Type":"ContainerDied","Data":"9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297"}
Sep 07 12:04:42.342898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.342619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw" event={"ID":"4aa6ad2f-5bde-4dab-9bae-68184bf4e400","Type":"ContainerDied","Data":"0f8e07fa4be7503c5fa803fc3acc6206f81ed7e41f30a88ea09bca87afaecfa6"}
Sep 07 12:04:42.342898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.342636    2560 scope.go:117] "RemoveContainer" containerID="9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297"
Sep 07 12:04:42.351361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.348233    2560 generic.go:356] "Generic (PLEG): container finished" podID="48aa2402-fa72-43a9-aac0-961671bd7699" containerID="de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb" exitCode=0
Sep 07 12:04:42.351361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.348370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" event={"ID":"48aa2402-fa72-43a9-aac0-961671bd7699","Type":"ContainerDied","Data":"de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb"}
Sep 07 12:04:42.351361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.348420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn" event={"ID":"48aa2402-fa72-43a9-aac0-961671bd7699","Type":"ContainerDied","Data":"1dbc425d4105908c386725b3fda4402e3fd67a9dcc04b2ed559599c66c51090b"}
Sep 07 12:04:42.351361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.349150    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"
Sep 07 12:04:42.354552 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.354261    2560 generic.go:356] "Generic (PLEG): container finished" podID="72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" containerID="d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25" exitCode=0
Sep 07 12:04:42.354552 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.354447    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"
Sep 07 12:04:42.354552 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.354479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl" event={"ID":"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6","Type":"ContainerDied","Data":"d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25"}
Sep 07 12:04:42.354552 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.354529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl" event={"ID":"72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6","Type":"ContainerDied","Data":"5894a637d0b1a7cb4601cb040a4753122264b3681cc8e670e915eb491db25030"}
Sep 07 12:04:42.358419 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.358398    2560 scope.go:117] "RemoveContainer" containerID="9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297"
Sep 07 12:04:42.358779 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:42.358748    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297\": container with ID starting with 9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297 not found: ID does not exist" containerID="9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297"
Sep 07 12:04:42.358907 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.358789    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297"} err="failed to get container status \"9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297\": rpc error: code = NotFound desc = could not find container \"9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297\": container with ID starting with 9e3a9d785ab9dba2a4458ea6e074c6fd4eb902fbca7fb64f7d2f308d77d97297 not found: ID does not exist"
Sep 07 12:04:42.358907 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.358814    2560 scope.go:117] "RemoveContainer" containerID="de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb"
Sep 07 12:04:42.370502 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.370476    2560 scope.go:117] "RemoveContainer" containerID="de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb"
Sep 07 12:04:42.370857 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:42.370835    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb\": container with ID starting with de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb not found: ID does not exist" containerID="de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb"
Sep 07 12:04:42.370952 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.370862    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb"} err="failed to get container status \"de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb\": rpc error: code = NotFound desc = could not find container \"de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb\": container with ID starting with de271f082c3fcb8b18f2dd0f62861e1bc6d9156e540151a506e986ef98e59bfb not found: ID does not exist"
Sep 07 12:04:42.370952 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.370922    2560 scope.go:117] "RemoveContainer" containerID="d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25"
Sep 07 12:04:42.374812 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.374789    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"]
Sep 07 12:04:42.377790 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.377769    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d8796b1b-c688fd45d-kcwpw"]
Sep 07 12:04:42.380405 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.380385    2560 scope.go:117] "RemoveContainer" containerID="d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25"
Sep 07 12:04:42.380737 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:42.380716    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25\": container with ID starting with d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25 not found: ID does not exist" containerID="d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25"
Sep 07 12:04:42.380782 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.380745    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25"} err="failed to get container status \"d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25\": rpc error: code = NotFound desc = could not find container \"d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25\": container with ID starting with d15141bcc8f57524ff1a25f9afca826fda63cc001eb02b76a9ca91d4e5354f25 not found: ID does not exist"
Sep 07 12:04:42.390631 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.390604    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"]
Sep 07 12:04:42.393106 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.393085    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d8796b1b-575fb95fd5-4s5zn"]
Sep 07 12:04:42.408777 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.408744    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"]
Sep 07 12:04:42.419018 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.418976    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d8796b1b-75476f8f7-66jxl"]
Sep 07 12:04:42.580173 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.580133    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"]
Sep 07 12:04:42.581198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581170    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa6ad2f-5bde-4dab-9bae-68184bf4e400" containerName="payload-pre-processing"
Sep 07 12:04:42.581198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581196    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa6ad2f-5bde-4dab-9bae-68184bf4e400" containerName="payload-pre-processing"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581219    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" containerName="payload-processing"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581226    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" containerName="payload-processing"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581233    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48aa2402-fa72-43a9-aac0-961671bd7699" containerName="maas-api"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581241    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="48aa2402-fa72-43a9-aac0-961671bd7699" containerName="maas-api"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581316    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" containerName="payload-processing"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581326    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="48aa2402-fa72-43a9-aac0-961671bd7699" containerName="maas-api"
Sep 07 12:04:42.581472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.581333    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aa6ad2f-5bde-4dab-9bae-68184bf4e400" containerName="payload-pre-processing"
Sep 07 12:04:42.586068 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.586042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.588636 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.588571    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 12:04:42.588749 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.588581    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-efc88f2d-gw-openshift-default-dockercfg-zjl4l\""
Sep 07 12:04:42.595081 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.595056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"]
Sep 07 12:04:42.710508 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzbb\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-kube-api-access-zxzbb\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710677 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-credential-socket\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710677 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/350ba8f7-7000-4858-b36c-da7acc973ac7-istiod-ca-cert\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710677 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-envoy\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710789 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-data\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710789 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-certs\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710789 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-token\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710789 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-podinfo\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.710911 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.710844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-socket\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.811688 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.811651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzbb\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-kube-api-access-zxzbb\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.811870 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.811708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-credential-socket\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.811870 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.811826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/350ba8f7-7000-4858-b36c-da7acc973ac7-istiod-ca-cert\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.811963 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.811880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-envoy\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.811963 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.811939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-data\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812086 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.811967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-certs\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812086 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-token\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812086 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-podinfo\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812086 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-credential-socket\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-socket\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-data\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812449 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-certs\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812499 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-socket\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.812574 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.812556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/350ba8f7-7000-4858-b36c-da7acc973ac7-istiod-ca-cert\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.814176 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.814154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-envoy\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.814423 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.814405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-podinfo\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.820158 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.820135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-token\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.820602 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.820580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzbb\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-kube-api-access-zxzbb\") pod \"e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") " pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:42.898264 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:42.898227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:43.196114 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:43.196082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"]
Sep 07 12:04:43.197562 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:43.197540    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350ba8f7_7000_4858_b36c_da7acc973ac7.slice/crio-1db5f43fdf8196c2606c49e19811e572d4e315b13ccf6feaf91da6490568825e WatchSource:0}: Error finding container 1db5f43fdf8196c2606c49e19811e572d4e315b13ccf6feaf91da6490568825e: Status 404 returned error can't find the container with id 1db5f43fdf8196c2606c49e19811e572d4e315b13ccf6feaf91da6490568825e
Sep 07 12:04:43.360978 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:43.360941    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48aa2402-fa72-43a9-aac0-961671bd7699" path="/var/lib/kubelet/pods/48aa2402-fa72-43a9-aac0-961671bd7699/volumes"
Sep 07 12:04:43.365363 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:43.361881    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa6ad2f-5bde-4dab-9bae-68184bf4e400" path="/var/lib/kubelet/pods/4aa6ad2f-5bde-4dab-9bae-68184bf4e400/volumes"
Sep 07 12:04:43.365363 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:43.362564    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6" path="/var/lib/kubelet/pods/72f6417c-1b21-41b2-a8fd-fc1fcf7b20e6/volumes"
Sep 07 12:04:43.371268 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:43.371227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" event={"ID":"350ba8f7-7000-4858-b36c-da7acc973ac7","Type":"ContainerStarted","Data":"1db5f43fdf8196c2606c49e19811e572d4e315b13ccf6feaf91da6490568825e"}
Sep 07 12:04:45.696546 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:45.696506    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 12:04:45.696826 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:45.696581    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 12:04:45.696826 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:45.696612    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 12:04:46.396871 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:46.396833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" event={"ID":"350ba8f7-7000-4858-b36c-da7acc973ac7","Type":"ContainerStarted","Data":"9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"}
Sep 07 12:04:46.416520 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:46.416462    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podStartSLOduration=1.9198630140000001 podStartE2EDuration="4.416446923s" totalImagesPullingTime="2.496583909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:46.414059007 +0000 UTC m=+1061.551810320" watchObservedRunningTime="2026-09-07 12:04:46.416446923 +0000 UTC m=+1061.554198245"
Sep 07 12:04:46.898688 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:46.898649    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:46.905149 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:46.905125    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:47.403830 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:47.403799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:47.405053 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:47.405034    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:04:48.106370 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.106318    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"]
Sep 07 12:04:48.110826 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.110795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.113254 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.113231    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-efc88f2d-serving-cert\""
Sep 07 12:04:48.122849 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.122821    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"]
Sep 07 12:04:48.162299 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.162260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-metrics-certs\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.162475 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.162336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.162475 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.162386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160612a2-172a-4fa5-881c-f1dac8c6993c-openshift-service-ca\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.162475 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.162414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cjd2\" (UniqueName: \"kubernetes.io/projected/160612a2-172a-4fa5-881c-f1dac8c6993c-kube-api-access-6cjd2\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.263810 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.263773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-metrics-certs\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.263997 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.263871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.263997 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.263900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160612a2-172a-4fa5-881c-f1dac8c6993c-openshift-service-ca\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.263997 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.263937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjd2\" (UniqueName: \"kubernetes.io/projected/160612a2-172a-4fa5-881c-f1dac8c6993c-kube-api-access-6cjd2\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.264166 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:48.264012    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-serving-cert: secret "maas-api-e2e-migrate-efc88f2d-serving-cert" not found
Sep 07 12:04:48.264166 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:04:48.264082    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls podName:160612a2-172a-4fa5-881c-f1dac8c6993c nodeName:}" failed. No retries permitted until 2026-09-07 12:04:48.764064768 +0000 UTC m=+1063.901816057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls") pod "maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" (UID: "160612a2-172a-4fa5-881c-f1dac8c6993c") : secret "maas-api-e2e-migrate-efc88f2d-serving-cert" not found
Sep 07 12:04:48.264619 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.264600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160612a2-172a-4fa5-881c-f1dac8c6993c-openshift-service-ca\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.266305 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.266282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-metrics-certs\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.272016 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.271995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cjd2\" (UniqueName: \"kubernetes.io/projected/160612a2-172a-4fa5-881c-f1dac8c6993c-kube-api-access-6cjd2\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.768476 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.768432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.770927 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.770895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls\") pod \"maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:48.808647 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.808616    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"]
Sep 07 12:04:48.812666 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.812639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:48.815369 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.815335    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-efc88f2d\""
Sep 07 12:04:48.815496 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.815391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-efc88f2d-dockercfg-fw2qr\""
Sep 07 12:04:48.822384 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.822357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"]
Sep 07 12:04:48.869391 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.869334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4jcr\" (UniqueName: \"kubernetes.io/projected/de366a9c-b321-4e78-a0fe-871b1380d76c-kube-api-access-d4jcr\") pod \"payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:48.869639 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.869462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de366a9c-b321-4e78-a0fe-871b1380d76c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:48.970756 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.970719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4jcr\" (UniqueName: \"kubernetes.io/projected/de366a9c-b321-4e78-a0fe-871b1380d76c-kube-api-access-d4jcr\") pod \"payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:48.970947 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.970798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de366a9c-b321-4e78-a0fe-871b1380d76c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:48.971569 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.971545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de366a9c-b321-4e78-a0fe-871b1380d76c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:48.979487 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:48.979459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4jcr\" (UniqueName: \"kubernetes.io/projected/de366a9c-b321-4e78-a0fe-871b1380d76c-kube-api-access-d4jcr\") pod \"payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:49.022369 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:49.022244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:49.124795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:49.124760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:49.314558 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:49.314532    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"]
Sep 07 12:04:49.316379 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:49.316326    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160612a2_172a_4fa5_881c_f1dac8c6993c.slice/crio-52cebd52a2fe0e9b01e713544f0c97d8882c9caad75c08f6403feb7e5e2fb305 WatchSource:0}: Error finding container 52cebd52a2fe0e9b01e713544f0c97d8882c9caad75c08f6403feb7e5e2fb305: Status 404 returned error can't find the container with id 52cebd52a2fe0e9b01e713544f0c97d8882c9caad75c08f6403feb7e5e2fb305
Sep 07 12:04:49.397553 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:49.397520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"]
Sep 07 12:04:49.398210 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:04:49.398186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde366a9c_b321_4e78_a0fe_871b1380d76c.slice/crio-a5b0bd2feb15142c9423d6106f19836cc9dcf493ae75ebd41b20f0ed328aa781 WatchSource:0}: Error finding container a5b0bd2feb15142c9423d6106f19836cc9dcf493ae75ebd41b20f0ed328aa781: Status 404 returned error can't find the container with id a5b0bd2feb15142c9423d6106f19836cc9dcf493ae75ebd41b20f0ed328aa781
Sep 07 12:04:49.418095 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:49.418060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" event={"ID":"160612a2-172a-4fa5-881c-f1dac8c6993c","Type":"ContainerStarted","Data":"52cebd52a2fe0e9b01e713544f0c97d8882c9caad75c08f6403feb7e5e2fb305"}
Sep 07 12:04:49.419420 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:49.419382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8" event={"ID":"de366a9c-b321-4e78-a0fe-871b1380d76c","Type":"ContainerStarted","Data":"a5b0bd2feb15142c9423d6106f19836cc9dcf493ae75ebd41b20f0ed328aa781"}
Sep 07 12:04:50.427394 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:50.427325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8" event={"ID":"de366a9c-b321-4e78-a0fe-871b1380d76c","Type":"ContainerStarted","Data":"c4f8a0c4cedb22eb639eadab87bbee97a9c1b9ae41a5707b151106d27692cf99"}
Sep 07 12:04:50.427888 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:50.427518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:04:50.446480 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:50.446417    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8" podStartSLOduration=2.446395128 podStartE2EDuration="2.446395128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:50.442565083 +0000 UTC m=+1065.580316396" watchObservedRunningTime="2026-09-07 12:04:50.446395128 +0000 UTC m=+1065.584146440"
Sep 07 12:04:51.434719 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:51.434678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" event={"ID":"160612a2-172a-4fa5-881c-f1dac8c6993c","Type":"ContainerStarted","Data":"dc41c91303315b80707f5c2542f5cf1569d5331fa5d4c40bcf13fa3b727ae684"}
Sep 07 12:04:51.435099 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:51.434834    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:04:51.454152 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:51.454093    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" podStartSLOduration=2.040340045 podStartE2EDuration="3.454072434s" totalImagesPullingTime="1.413732389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:04:51.450694341 +0000 UTC m=+1066.588445674" watchObservedRunningTime="2026-09-07 12:04:51.454072434 +0000 UTC m=+1066.591823758"
Sep 07 12:04:57.458668 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:04:57.458633    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:05:01.437960 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:01.437927    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:05:03.446536 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:03.446490    2560 patch_prober.go:28] interesting pod/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 12:05:03.447001 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:03.446580    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 12:05:04.531139 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:04.531101    2560 generic.go:356] "Generic (PLEG): container finished" podID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerID="9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626" exitCode=0
Sep 07 12:05:04.531682 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:04.531171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" event={"ID":"350ba8f7-7000-4858-b36c-da7acc973ac7","Type":"ContainerDied","Data":"9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"}
Sep 07 12:05:04.531758 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:04.531716    2560 scope.go:117] "RemoveContainer" containerID="9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"
Sep 07 12:05:04.533811 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:04.533780    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 12:05:04.533893 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:04.533850    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 12:05:04.533931 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:04.533892    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 12:05:05.539162 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:05.539124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" event={"ID":"350ba8f7-7000-4858-b36c-da7acc973ac7","Type":"ContainerStarted","Data":"917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8"}
Sep 07 12:05:05.898856 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:05.898813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:05:05.899099 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:05.899080    2560 patch_prober.go:28] interesting pod/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 12:05:05.899148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:05.899123    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 12:05:06.899051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:06.899012    2560 patch_prober.go:28] interesting pod/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 12:05:06.899472 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:06.899076    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 12:05:07.898827 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:07.898780    2560 patch_prober.go:28] interesting pod/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 12:05:07.899014 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:07.898846    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 12:05:08.899315 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:08.899271    2560 patch_prober.go:28] interesting pod/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 12:05:08.899828 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:08.899334    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 12:05:09.898770 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:09.898734    2560 patch_prober.go:28] interesting pod/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 07 12:05:09.898942 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:09.898803    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 07 12:05:10.983838 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:10.983806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:05:10.984262 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:10.984190    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:05:10.984928 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:10.984910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:05:19.454517 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.453986    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"]
Sep 07 12:05:19.455410 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.455373    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" podUID="160612a2-172a-4fa5-881c-f1dac8c6993c" containerName="maas-api" containerID="cri-o://dc41c91303315b80707f5c2542f5cf1569d5331fa5d4c40bcf13fa3b727ae684" gracePeriod=30
Sep 07 12:05:19.516452 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.516416    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"]
Sep 07 12:05:19.516673 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.516641    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8" podUID="de366a9c-b321-4e78-a0fe-871b1380d76c" containerName="payload-pre-processing" containerID="cri-o://c4f8a0c4cedb22eb639eadab87bbee97a9c1b9ae41a5707b151106d27692cf99" gracePeriod=30
Sep 07 12:05:19.645361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.645155    2560 generic.go:356] "Generic (PLEG): container finished" podID="160612a2-172a-4fa5-881c-f1dac8c6993c" containerID="dc41c91303315b80707f5c2542f5cf1569d5331fa5d4c40bcf13fa3b727ae684" exitCode=0
Sep 07 12:05:19.645361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.645272    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" event={"ID":"160612a2-172a-4fa5-881c-f1dac8c6993c","Type":"ContainerDied","Data":"dc41c91303315b80707f5c2542f5cf1569d5331fa5d4c40bcf13fa3b727ae684"}
Sep 07 12:05:19.647944 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.647760    2560 generic.go:356] "Generic (PLEG): container finished" podID="de366a9c-b321-4e78-a0fe-871b1380d76c" containerID="c4f8a0c4cedb22eb639eadab87bbee97a9c1b9ae41a5707b151106d27692cf99" exitCode=0
Sep 07 12:05:19.647944 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.647874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8" event={"ID":"de366a9c-b321-4e78-a0fe-871b1380d76c","Type":"ContainerDied","Data":"c4f8a0c4cedb22eb639eadab87bbee97a9c1b9ae41a5707b151106d27692cf99"}
Sep 07 12:05:19.790015 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.789721    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:05:19.796505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.795180    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"]
Sep 07 12:05:19.796505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.795452    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy" containerID="cri-o://917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8" gracePeriod=30
Sep 07 12:05:19.832079 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.832054    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:05:19.902072 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902039    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160612a2-172a-4fa5-881c-f1dac8c6993c-openshift-service-ca\") pod \"160612a2-172a-4fa5-881c-f1dac8c6993c\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") "
Sep 07 12:05:19.902244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902090    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4jcr\" (UniqueName: \"kubernetes.io/projected/de366a9c-b321-4e78-a0fe-871b1380d76c-kube-api-access-d4jcr\") pod \"de366a9c-b321-4e78-a0fe-871b1380d76c\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") "
Sep 07 12:05:19.902244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902114    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-metrics-certs\") pod \"160612a2-172a-4fa5-881c-f1dac8c6993c\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") "
Sep 07 12:05:19.902244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls\") pod \"160612a2-172a-4fa5-881c-f1dac8c6993c\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") "
Sep 07 12:05:19.902244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cjd2\" (UniqueName: \"kubernetes.io/projected/160612a2-172a-4fa5-881c-f1dac8c6993c-kube-api-access-6cjd2\") pod \"160612a2-172a-4fa5-881c-f1dac8c6993c\" (UID: \"160612a2-172a-4fa5-881c-f1dac8c6993c\") "
Sep 07 12:05:19.902517 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902258    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de366a9c-b321-4e78-a0fe-871b1380d76c-plugins-config-volume\") pod \"de366a9c-b321-4e78-a0fe-871b1380d76c\" (UID: \"de366a9c-b321-4e78-a0fe-871b1380d76c\") "
Sep 07 12:05:19.902517 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902477    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160612a2-172a-4fa5-881c-f1dac8c6993c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "160612a2-172a-4fa5-881c-f1dac8c6993c" (UID: "160612a2-172a-4fa5-881c-f1dac8c6993c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:05:19.902691 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902661    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160612a2-172a-4fa5-881c-f1dac8c6993c-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:19.902827 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.902697    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de366a9c-b321-4e78-a0fe-871b1380d76c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de366a9c-b321-4e78-a0fe-871b1380d76c" (UID: "de366a9c-b321-4e78-a0fe-871b1380d76c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:05:19.904536 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.904515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "160612a2-172a-4fa5-881c-f1dac8c6993c" (UID: "160612a2-172a-4fa5-881c-f1dac8c6993c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:05:19.904536 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.904523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de366a9c-b321-4e78-a0fe-871b1380d76c-kube-api-access-d4jcr" (OuterVolumeSpecName: "kube-api-access-d4jcr") pod "de366a9c-b321-4e78-a0fe-871b1380d76c" (UID: "de366a9c-b321-4e78-a0fe-871b1380d76c"). InnerVolumeSpecName "kube-api-access-d4jcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:19.904654 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.904551    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160612a2-172a-4fa5-881c-f1dac8c6993c-kube-api-access-6cjd2" (OuterVolumeSpecName: "kube-api-access-6cjd2") pod "160612a2-172a-4fa5-881c-f1dac8c6993c" (UID: "160612a2-172a-4fa5-881c-f1dac8c6993c"). InnerVolumeSpecName "kube-api-access-6cjd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:19.904654 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:19.904607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "160612a2-172a-4fa5-881c-f1dac8c6993c" (UID: "160612a2-172a-4fa5-881c-f1dac8c6993c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:05:20.003448 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.003365    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:20.003448 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.003395    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cjd2\" (UniqueName: \"kubernetes.io/projected/160612a2-172a-4fa5-881c-f1dac8c6993c-kube-api-access-6cjd2\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:20.003448 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.003406    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de366a9c-b321-4e78-a0fe-871b1380d76c-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:20.003448 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.003417    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4jcr\" (UniqueName: \"kubernetes.io/projected/de366a9c-b321-4e78-a0fe-871b1380d76c-kube-api-access-d4jcr\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:20.003448 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.003426    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160612a2-172a-4fa5-881c-f1dac8c6993c-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:20.656722 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.656691    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"
Sep 07 12:05:20.657285 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.656735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8" event={"ID":"de366a9c-b321-4e78-a0fe-871b1380d76c","Type":"ContainerDied","Data":"a5b0bd2feb15142c9423d6106f19836cc9dcf493ae75ebd41b20f0ed328aa781"}
Sep 07 12:05:20.657285 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.656794    2560 scope.go:117] "RemoveContainer" containerID="c4f8a0c4cedb22eb639eadab87bbee97a9c1b9ae41a5707b151106d27692cf99"
Sep 07 12:05:20.658395 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.658375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb" event={"ID":"160612a2-172a-4fa5-881c-f1dac8c6993c","Type":"ContainerDied","Data":"52cebd52a2fe0e9b01e713544f0c97d8882c9caad75c08f6403feb7e5e2fb305"}
Sep 07 12:05:20.658535 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.658517    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"
Sep 07 12:05:20.667364 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.667333    2560 scope.go:117] "RemoveContainer" containerID="dc41c91303315b80707f5c2542f5cf1569d5331fa5d4c40bcf13fa3b727ae684"
Sep 07 12:05:20.691798 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.691760    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"]
Sep 07 12:05:20.695335 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.695311    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efc88f2d-6d64fff75c-x6sxb"]
Sep 07 12:05:20.706169 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.706142    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"]
Sep 07 12:05:20.709100 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:20.709079    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-efc88f2d-6c7dd45f9d-jdcw8"]
Sep 07 12:05:21.360193 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:21.360154    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160612a2-172a-4fa5-881c-f1dac8c6993c" path="/var/lib/kubelet/pods/160612a2-172a-4fa5-881c-f1dac8c6993c/volumes"
Sep 07 12:05:21.360586 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:21.360570    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de366a9c-b321-4e78-a0fe-871b1380d76c" path="/var/lib/kubelet/pods/de366a9c-b321-4e78-a0fe-871b1380d76c/volumes"
Sep 07 12:05:23.811212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.811161    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"]
Sep 07 12:05:23.811940 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.811913    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de366a9c-b321-4e78-a0fe-871b1380d76c" containerName="payload-pre-processing"
Sep 07 12:05:23.812038 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.811944    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de366a9c-b321-4e78-a0fe-871b1380d76c" containerName="payload-pre-processing"
Sep 07 12:05:23.812038 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.811957    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160612a2-172a-4fa5-881c-f1dac8c6993c" containerName="maas-api"
Sep 07 12:05:23.812038 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.811967    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="160612a2-172a-4fa5-881c-f1dac8c6993c" containerName="maas-api"
Sep 07 12:05:23.812210 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.812146    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de366a9c-b321-4e78-a0fe-871b1380d76c" containerName="payload-pre-processing"
Sep 07 12:05:23.812210 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.812160    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="160612a2-172a-4fa5-881c-f1dac8c6993c" containerName="maas-api"
Sep 07 12:05:23.816059 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.816035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.818612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.818588    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c9822a85-serving-cert\""
Sep 07 12:05:23.824276 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.824250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"]
Sep 07 12:05:23.838195 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.838168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2427d3ca-ae73-48c6-872d-7a22505d3a5f-openshift-service-ca\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.838352 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.838286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.838422 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.838366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-metrics-certs\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.838487 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.838437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpmmj\" (UniqueName: \"kubernetes.io/projected/2427d3ca-ae73-48c6-872d-7a22505d3a5f-kube-api-access-fpmmj\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.940031 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.939999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.940180 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.940043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-metrics-certs\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.940180 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.940091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmmj\" (UniqueName: \"kubernetes.io/projected/2427d3ca-ae73-48c6-872d-7a22505d3a5f-kube-api-access-fpmmj\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.940180 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.940150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2427d3ca-ae73-48c6-872d-7a22505d3a5f-openshift-service-ca\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.940302 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:23.940151    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-serving-cert: secret "maas-api-e2e-ait-c9822a85-serving-cert" not found
Sep 07 12:05:23.940302 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:23.940289    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls podName:2427d3ca-ae73-48c6-872d-7a22505d3a5f nodeName:}" failed. No retries permitted until 2026-09-07 12:05:24.440269675 +0000 UTC m=+1099.578020976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls") pod "maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" (UID: "2427d3ca-ae73-48c6-872d-7a22505d3a5f") : secret "maas-api-e2e-ait-c9822a85-serving-cert" not found
Sep 07 12:05:23.940903 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.940878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2427d3ca-ae73-48c6-872d-7a22505d3a5f-openshift-service-ca\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.942503 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.942485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-metrics-certs\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:23.953062 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:23.953032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpmmj\" (UniqueName: \"kubernetes.io/projected/2427d3ca-ae73-48c6-872d-7a22505d3a5f-kube-api-access-fpmmj\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:24.445936 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.445897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:24.448457 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.448428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls\") pod \"maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:24.583752 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.583716    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"]
Sep 07 12:05:24.587659 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.587639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.590101 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.590075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c9822a85\""
Sep 07 12:05:24.590222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.590183    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c9822a85-dockercfg-hrt5b\""
Sep 07 12:05:24.597260 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.597238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"]
Sep 07 12:05:24.648561 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.648392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2frpm\" (UniqueName: \"kubernetes.io/projected/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-kube-api-access-2frpm\") pod \"payload-processing-e2e-ait-c9822a85-784f46695-mmfhd\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") " pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.648561 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.648455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-plugins-config-volume\") pod \"payload-processing-e2e-ait-c9822a85-784f46695-mmfhd\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") " pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.729596 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.729526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:24.749335 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.749301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-plugins-config-volume\") pod \"payload-processing-e2e-ait-c9822a85-784f46695-mmfhd\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") " pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.749521 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.749500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2frpm\" (UniqueName: \"kubernetes.io/projected/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-kube-api-access-2frpm\") pod \"payload-processing-e2e-ait-c9822a85-784f46695-mmfhd\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") " pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.750619 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.750594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-plugins-config-volume\") pod \"payload-processing-e2e-ait-c9822a85-784f46695-mmfhd\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") " pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.758882 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.758856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2frpm\" (UniqueName: \"kubernetes.io/projected/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-kube-api-access-2frpm\") pod \"payload-processing-e2e-ait-c9822a85-784f46695-mmfhd\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") " pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:24.899248 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:24.899217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:25.017641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.017587    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"]
Sep 07 12:05:25.021130 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:05:25.021072    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2427d3ca_ae73_48c6_872d_7a22505d3a5f.slice/crio-a56719bb26eccf0867d5149b5d7ddf251027dd7461e779a9037fd2bde8d56a7b WatchSource:0}: Error finding container a56719bb26eccf0867d5149b5d7ddf251027dd7461e779a9037fd2bde8d56a7b: Status 404 returned error can't find the container with id a56719bb26eccf0867d5149b5d7ddf251027dd7461e779a9037fd2bde8d56a7b
Sep 07 12:05:25.099188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.099163    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:05:25.153487 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/350ba8f7-7000-4858-b36c-da7acc973ac7-istiod-ca-cert\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153655 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153503    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzbb\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-kube-api-access-zxzbb\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153655 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153549    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-certs\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153655 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-data\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153655 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153593    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-socket\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153655 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153635    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-envoy\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153937 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-podinfo\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153937 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153710    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-token\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153937 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153762    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-credential-socket\") pod \"350ba8f7-7000-4858-b36c-da7acc973ac7\" (UID: \"350ba8f7-7000-4858-b36c-da7acc973ac7\") "
Sep 07 12:05:25.153937 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/350ba8f7-7000-4858-b36c-da7acc973ac7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:05:25.153937 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.153889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:05:25.154289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.154082    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.154289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.154101    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/350ba8f7-7000-4858-b36c-da7acc973ac7-istiod-ca-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.154289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.154234    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:05:25.154289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.154268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:05:25.154584 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.154324    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-data" (OuterVolumeSpecName: "istio-data") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:05:25.155960 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.155932    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:05:25.156052 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.155958    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 12:05:25.156052 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.155939    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-kube-api-access-zxzbb" (OuterVolumeSpecName: "kube-api-access-zxzbb") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "kube-api-access-zxzbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:25.156174 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.156158    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-token" (OuterVolumeSpecName: "istio-token") pod "350ba8f7-7000-4858-b36c-da7acc973ac7" (UID: "350ba8f7-7000-4858-b36c-da7acc973ac7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:25.182490 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.182461    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"]
Sep 07 12:05:25.183279 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:05:25.183254    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae5b9d6_fa18_4e1b_9287_d066a8f0f9a5.slice/crio-49e13ec536022d04e3b7e49516b3fd6283de01b6a080cf024e2e79b337772237 WatchSource:0}: Error finding container 49e13ec536022d04e3b7e49516b3fd6283de01b6a080cf024e2e79b337772237: Status 404 returned error can't find the container with id 49e13ec536022d04e3b7e49516b3fd6283de01b6a080cf024e2e79b337772237
Sep 07 12:05:25.255172 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255131    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-data\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.255172 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255163    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-workload-socket\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.255354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255179    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-envoy\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.255354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255192    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-podinfo\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.255354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255205    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-istio-token\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.255354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255218    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/350ba8f7-7000-4858-b36c-da7acc973ac7-credential-socket\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.255354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.255232    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzbb\" (UniqueName: \"kubernetes.io/projected/350ba8f7-7000-4858-b36c-da7acc973ac7-kube-api-access-zxzbb\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:25.696284 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.696194    2560 generic.go:356] "Generic (PLEG): container finished" podID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerID="917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8" exitCode=0
Sep 07 12:05:25.696284 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.696251    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"
Sep 07 12:05:25.696284 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.696271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" event={"ID":"350ba8f7-7000-4858-b36c-da7acc973ac7","Type":"ContainerDied","Data":"917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8"}
Sep 07 12:05:25.696560 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.696331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd" event={"ID":"350ba8f7-7000-4858-b36c-da7acc973ac7","Type":"ContainerDied","Data":"1db5f43fdf8196c2606c49e19811e572d4e315b13ccf6feaf91da6490568825e"}
Sep 07 12:05:25.696560 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.696374    2560 scope.go:117] "RemoveContainer" containerID="917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8"
Sep 07 12:05:25.698514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.698174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd" event={"ID":"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5","Type":"ContainerStarted","Data":"a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd"}
Sep 07 12:05:25.698514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.698226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd" event={"ID":"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5","Type":"ContainerStarted","Data":"49e13ec536022d04e3b7e49516b3fd6283de01b6a080cf024e2e79b337772237"}
Sep 07 12:05:25.698514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.698258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:25.699805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.699778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" event={"ID":"2427d3ca-ae73-48c6-872d-7a22505d3a5f","Type":"ContainerStarted","Data":"a56719bb26eccf0867d5149b5d7ddf251027dd7461e779a9037fd2bde8d56a7b"}
Sep 07 12:05:25.708439 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.708412    2560 scope.go:117] "RemoveContainer" containerID="9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"
Sep 07 12:05:25.715482 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.715457    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"]
Sep 07 12:05:25.719616 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.719568    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-efc88f2d-gw-openshift-default-567b6d4f84-chqxd"]
Sep 07 12:05:25.719688 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.719675    2560 scope.go:117] "RemoveContainer" containerID="917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8"
Sep 07 12:05:25.720012 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:25.719990    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8\": container with ID starting with 917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8 not found: ID does not exist" containerID="917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8"
Sep 07 12:05:25.720099 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.720018    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8"} err="failed to get container status \"917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8\": rpc error: code = NotFound desc = could not find container \"917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8\": container with ID starting with 917e10e40f0d50435e9b2336f9e3b58a6fca7c88cef159d0155e6bd541e032d8 not found: ID does not exist"
Sep 07 12:05:25.720099 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.720036    2560 scope.go:117] "RemoveContainer" containerID="9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"
Sep 07 12:05:25.720280 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:25.720261    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626\": container with ID starting with 9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626 not found: ID does not exist" containerID="9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"
Sep 07 12:05:25.720358 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.720283    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626"} err="failed to get container status \"9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626\": rpc error: code = NotFound desc = could not find container \"9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626\": container with ID starting with 9574212fcc78619bd500d5016738b2aa3241af0588ff76c3c694fa3e8acc5626 not found: ID does not exist"
Sep 07 12:05:25.731499 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:25.730222    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd" podStartSLOduration=1.730203524 podStartE2EDuration="1.730203524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:05:25.726668083 +0000 UTC m=+1100.864419395" watchObservedRunningTime="2026-09-07 12:05:25.730203524 +0000 UTC m=+1100.867954850"
Sep 07 12:05:26.709043 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:26.709011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" event={"ID":"2427d3ca-ae73-48c6-872d-7a22505d3a5f","Type":"ContainerStarted","Data":"f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0"}
Sep 07 12:05:26.709473 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:26.709164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:26.727124 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:26.727077    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" podStartSLOduration=3.041731325 podStartE2EDuration="3.72706335s" totalImagesPullingTime="685.332025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:05:26.724895127 +0000 UTC m=+1101.862646448" watchObservedRunningTime="2026-09-07 12:05:26.72706335 +0000 UTC m=+1101.864814660"
Sep 07 12:05:27.360521 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:27.360477    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" path="/var/lib/kubelet/pods/350ba8f7-7000-4858-b36c-da7acc973ac7/volumes"
Sep 07 12:05:32.721637 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:32.721604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:36.711390 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:36.711331    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:54.354759 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.354721    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"]
Sep 07 12:05:54.355287 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.354928    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" podUID="2427d3ca-ae73-48c6-872d-7a22505d3a5f" containerName="maas-api" containerID="cri-o://f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0" gracePeriod=30
Sep 07 12:05:54.392786 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.392743    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"]
Sep 07 12:05:54.393018 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.392983    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd" podUID="bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" containerName="payload-processing" containerID="cri-o://a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd" gracePeriod=30
Sep 07 12:05:54.669047 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.669021    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:54.697270 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.697245    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:54.838414 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.838369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-plugins-config-volume\") pod \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") "
Sep 07 12:05:54.838624 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.838440    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpmmj\" (UniqueName: \"kubernetes.io/projected/2427d3ca-ae73-48c6-872d-7a22505d3a5f-kube-api-access-fpmmj\") pod \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") "
Sep 07 12:05:54.838624 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.838533    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls\") pod \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") "
Sep 07 12:05:54.838624 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.838566    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2427d3ca-ae73-48c6-872d-7a22505d3a5f-openshift-service-ca\") pod \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") "
Sep 07 12:05:54.838624 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.838595    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-metrics-certs\") pod \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\" (UID: \"2427d3ca-ae73-48c6-872d-7a22505d3a5f\") "
Sep 07 12:05:54.838848 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.838675    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2frpm\" (UniqueName: \"kubernetes.io/projected/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-kube-api-access-2frpm\") pod \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\" (UID: \"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5\") "
Sep 07 12:05:54.840269 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.840231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2427d3ca-ae73-48c6-872d-7a22505d3a5f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2427d3ca-ae73-48c6-872d-7a22505d3a5f" (UID: "2427d3ca-ae73-48c6-872d-7a22505d3a5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:05:54.841040 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.841006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" (UID: "bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:05:54.841689 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.841654    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-kube-api-access-2frpm" (OuterVolumeSpecName: "kube-api-access-2frpm") pod "bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" (UID: "bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5"). InnerVolumeSpecName "kube-api-access-2frpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:54.841872 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.841845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2427d3ca-ae73-48c6-872d-7a22505d3a5f" (UID: "2427d3ca-ae73-48c6-872d-7a22505d3a5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:05:54.842191 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.842162    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2427d3ca-ae73-48c6-872d-7a22505d3a5f-kube-api-access-fpmmj" (OuterVolumeSpecName: "kube-api-access-fpmmj") pod "2427d3ca-ae73-48c6-872d-7a22505d3a5f" (UID: "2427d3ca-ae73-48c6-872d-7a22505d3a5f"). InnerVolumeSpecName "kube-api-access-fpmmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:54.842285 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.842187    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2427d3ca-ae73-48c6-872d-7a22505d3a5f" (UID: "2427d3ca-ae73-48c6-872d-7a22505d3a5f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:05:54.892549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.892453    2560 generic.go:356] "Generic (PLEG): container finished" podID="bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" containerID="a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd" exitCode=0
Sep 07 12:05:54.892549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.892508    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"
Sep 07 12:05:54.892549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.892532    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd" event={"ID":"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5","Type":"ContainerDied","Data":"a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd"}
Sep 07 12:05:54.892899 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.892619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd" event={"ID":"bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5","Type":"ContainerDied","Data":"49e13ec536022d04e3b7e49516b3fd6283de01b6a080cf024e2e79b337772237"}
Sep 07 12:05:54.892899 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.892654    2560 scope.go:117] "RemoveContainer" containerID="a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd"
Sep 07 12:05:54.894103 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.894084    2560 generic.go:356] "Generic (PLEG): container finished" podID="2427d3ca-ae73-48c6-872d-7a22505d3a5f" containerID="f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0" exitCode=0
Sep 07 12:05:54.894222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.894115    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" event={"ID":"2427d3ca-ae73-48c6-872d-7a22505d3a5f","Type":"ContainerDied","Data":"f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0"}
Sep 07 12:05:54.894222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.894140    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"
Sep 07 12:05:54.894222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.894170    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z" event={"ID":"2427d3ca-ae73-48c6-872d-7a22505d3a5f","Type":"ContainerDied","Data":"a56719bb26eccf0867d5149b5d7ddf251027dd7461e779a9037fd2bde8d56a7b"}
Sep 07 12:05:54.907509 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.907486    2560 scope.go:117] "RemoveContainer" containerID="a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd"
Sep 07 12:05:54.907857 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:54.907830    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd\": container with ID starting with a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd not found: ID does not exist" containerID="a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd"
Sep 07 12:05:54.907951 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.907862    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd"} err="failed to get container status \"a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd\": rpc error: code = NotFound desc = could not find container \"a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd\": container with ID starting with a6d286b382ffc4ffb2f155ebecf80cdb804fbaf2f2f197cc1e34d52961ebb3cd not found: ID does not exist"
Sep 07 12:05:54.907951 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.907878    2560 scope.go:117] "RemoveContainer" containerID="f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0"
Sep 07 12:05:54.918426 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.918407    2560 scope.go:117] "RemoveContainer" containerID="f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0"
Sep 07 12:05:54.918756 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:54.918737    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0\": container with ID starting with f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0 not found: ID does not exist" containerID="f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0"
Sep 07 12:05:54.918814 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.918765    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0"} err="failed to get container status \"f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0\": rpc error: code = NotFound desc = could not find container \"f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0\": container with ID starting with f3fdadbfc849649f071efa3c28a928af863e1d2f3112abfc0f9ff1bab1b2cac0 not found: ID does not exist"
Sep 07 12:05:54.921446 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.921428    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"]
Sep 07 12:05:54.926663 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.926646    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9822a85-784f46695-mmfhd"]
Sep 07 12:05:54.937778 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.937757    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"]
Sep 07 12:05:54.939864 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.939842    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2frpm\" (UniqueName: \"kubernetes.io/projected/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-kube-api-access-2frpm\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:54.939864 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.939864    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:54.940015 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.939875    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpmmj\" (UniqueName: \"kubernetes.io/projected/2427d3ca-ae73-48c6-872d-7a22505d3a5f-kube-api-access-fpmmj\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:54.940015 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.939884    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:54.940015 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.939893    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2427d3ca-ae73-48c6-872d-7a22505d3a5f-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:54.940015 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.939901    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2427d3ca-ae73-48c6-872d-7a22505d3a5f-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:54.944015 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:54.943994    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c9822a85-7bf4cf8b5b-rlh8z"]
Sep 07 12:05:55.359953 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:55.359912    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2427d3ca-ae73-48c6-872d-7a22505d3a5f" path="/var/lib/kubelet/pods/2427d3ca-ae73-48c6-872d-7a22505d3a5f/volumes"
Sep 07 12:05:55.360506 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:55.360480    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" path="/var/lib/kubelet/pods/bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5/volumes"
Sep 07 12:05:56.331928 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.331884    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"]
Sep 07 12:05:56.332253 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.332196    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll" podUID="533d5b9b-c3dc-441e-8828-ba91c4434f27" containerName="payload-processing" containerID="cri-o://331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290" gracePeriod=30
Sep 07 12:05:56.606585 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.606559    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:05:56.757709 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.757670    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7tcw\" (UniqueName: \"kubernetes.io/projected/533d5b9b-c3dc-441e-8828-ba91c4434f27-kube-api-access-p7tcw\") pod \"533d5b9b-c3dc-441e-8828-ba91c4434f27\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") "
Sep 07 12:05:56.757885 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.757795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533d5b9b-c3dc-441e-8828-ba91c4434f27-plugins-config-volume\") pod \"533d5b9b-c3dc-441e-8828-ba91c4434f27\" (UID: \"533d5b9b-c3dc-441e-8828-ba91c4434f27\") "
Sep 07 12:05:56.758119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.758088    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/533d5b9b-c3dc-441e-8828-ba91c4434f27-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "533d5b9b-c3dc-441e-8828-ba91c4434f27" (UID: "533d5b9b-c3dc-441e-8828-ba91c4434f27"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:05:56.759863 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.759844    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533d5b9b-c3dc-441e-8828-ba91c4434f27-kube-api-access-p7tcw" (OuterVolumeSpecName: "kube-api-access-p7tcw") pod "533d5b9b-c3dc-441e-8828-ba91c4434f27" (UID: "533d5b9b-c3dc-441e-8828-ba91c4434f27"). InnerVolumeSpecName "kube-api-access-p7tcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:05:56.859056 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.859021    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7tcw\" (UniqueName: \"kubernetes.io/projected/533d5b9b-c3dc-441e-8828-ba91c4434f27-kube-api-access-p7tcw\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:56.859056 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.859051    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/533d5b9b-c3dc-441e-8828-ba91c4434f27-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:05:56.910332 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.910294    2560 generic.go:356] "Generic (PLEG): container finished" podID="533d5b9b-c3dc-441e-8828-ba91c4434f27" containerID="331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290" exitCode=0
Sep 07 12:05:56.910513 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.910335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"
Sep 07 12:05:56.910513 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.910374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll" event={"ID":"533d5b9b-c3dc-441e-8828-ba91c4434f27","Type":"ContainerDied","Data":"331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290"}
Sep 07 12:05:56.910513 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.910430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll" event={"ID":"533d5b9b-c3dc-441e-8828-ba91c4434f27","Type":"ContainerDied","Data":"45f9df48908904dbb4260adf8b0710616391a4211758581ebaeeceefedf0c54f"}
Sep 07 12:05:56.910513 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.910451    2560 scope.go:117] "RemoveContainer" containerID="331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290"
Sep 07 12:05:56.920065 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.920045    2560 scope.go:117] "RemoveContainer" containerID="331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290"
Sep 07 12:05:56.920383 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:05:56.920361    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290\": container with ID starting with 331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290 not found: ID does not exist" containerID="331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290"
Sep 07 12:05:56.920443 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.920398    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290"} err="failed to get container status \"331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290\": rpc error: code = NotFound desc = could not find container \"331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290\": container with ID starting with 331d0c44988c4650688f455ce191bd757f473c8490039af7e6fe57f5a6c41290 not found: ID does not exist"
Sep 07 12:05:56.938865 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.938827    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"]
Sep 07 12:05:56.944011 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:56.943976    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-ebf845-588cf6db4f-tvjll"]
Sep 07 12:05:57.360277 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:05:57.360243    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="533d5b9b-c3dc-441e-8828-ba91c4434f27" path="/var/lib/kubelet/pods/533d5b9b-c3dc-441e-8828-ba91c4434f27/volumes"
Sep 07 12:06:00.011667 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.011628    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"]
Sep 07 12:06:00.012265 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012247    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy"
Sep 07 12:06:00.012312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012266    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy"
Sep 07 12:06:00.012312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012277    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533d5b9b-c3dc-441e-8828-ba91c4434f27" containerName="payload-processing"
Sep 07 12:06:00.012312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012283    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="533d5b9b-c3dc-441e-8828-ba91c4434f27" containerName="payload-processing"
Sep 07 12:06:00.012312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012296    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2427d3ca-ae73-48c6-872d-7a22505d3a5f" containerName="maas-api"
Sep 07 12:06:00.012312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012302    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2427d3ca-ae73-48c6-872d-7a22505d3a5f" containerName="maas-api"
Sep 07 12:06:00.012312 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012313    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" containerName="payload-processing"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012319    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" containerName="payload-processing"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012326    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012331    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012434    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="533d5b9b-c3dc-441e-8828-ba91c4434f27" containerName="payload-processing"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012444    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012450    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="350ba8f7-7000-4858-b36c-da7acc973ac7" containerName="istio-proxy"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012458    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2427d3ca-ae73-48c6-872d-7a22505d3a5f" containerName="maas-api"
Sep 07 12:06:00.012538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.012464    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae5b9d6-fa18-4e1b-9287-d066a8f0f9a5" containerName="payload-processing"
Sep 07 12:06:00.020641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.020609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.023469 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.023429    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-57104ad7-serving-cert\""
Sep 07 12:06:00.026440 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.026413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"]
Sep 07 12:06:00.086641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.086605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dn9\" (UniqueName: \"kubernetes.io/projected/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-kube-api-access-64dn9\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.086803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.086648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-metrics-certs\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.086803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.086703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-openshift-service-ca\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.086803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.086723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.187285 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.187248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dn9\" (UniqueName: \"kubernetes.io/projected/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-kube-api-access-64dn9\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.187520 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.187313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-metrics-certs\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.187520 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.187393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-openshift-service-ca\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.187520 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.187427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.187703 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:06:00.187585    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-serving-cert: secret "maas-api-e2e-derive-57104ad7-serving-cert" not found
Sep 07 12:06:00.187703 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:06:00.187678    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls podName:2d7351cf-bf58-48b0-b634-4b6dc2283b7e nodeName:}" failed. No retries permitted until 2026-09-07 12:06:00.687650846 +0000 UTC m=+1135.825402160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls") pod "maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" (UID: "2d7351cf-bf58-48b0-b634-4b6dc2283b7e") : secret "maas-api-e2e-derive-57104ad7-serving-cert" not found
Sep 07 12:06:00.188133 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.188112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-openshift-service-ca\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.189955 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.189932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-metrics-certs\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.195565 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.195545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dn9\" (UniqueName: \"kubernetes.io/projected/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-kube-api-access-64dn9\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.691331 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.691286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.693607 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.693587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls\") pod \"maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.847056 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.847006    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"]
Sep 07 12:06:00.851584 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.851559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:00.854408 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.854385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-57104ad7\""
Sep 07 12:06:00.854538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.854484    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-57104ad7-dockercfg-qjk6b\""
Sep 07 12:06:00.860420 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.860323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"]
Sep 07 12:06:00.893222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.893191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4gc\" (UniqueName: \"kubernetes.io/projected/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-kube-api-access-dn4gc\") pod \"payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:00.893222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.893225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:00.934137 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.934108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:00.994850 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.993937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4gc\" (UniqueName: \"kubernetes.io/projected/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-kube-api-access-dn4gc\") pod \"payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:00.994850 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.994017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:00.994850 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:00.994779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:01.006019 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.005979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4gc\" (UniqueName: \"kubernetes.io/projected/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-kube-api-access-dn4gc\") pod \"payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:01.165853 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.165817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:01.218021 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.217923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"]
Sep 07 12:06:01.461745 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.461717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"]
Sep 07 12:06:01.462616 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:06:01.462594    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb731fd_7c70_4f72_a4be_ae82c3a289cb.slice/crio-8d4402373316307c342ba3bba03f3e5b7f681a2a2efcc69f2842e098918193c1 WatchSource:0}: Error finding container 8d4402373316307c342ba3bba03f3e5b7f681a2a2efcc69f2842e098918193c1: Status 404 returned error can't find the container with id 8d4402373316307c342ba3bba03f3e5b7f681a2a2efcc69f2842e098918193c1
Sep 07 12:06:01.944689 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.944638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q" event={"ID":"1bb731fd-7c70-4f72-a4be-ae82c3a289cb","Type":"ContainerStarted","Data":"ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3"}
Sep 07 12:06:01.944874 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.944718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q" event={"ID":"1bb731fd-7c70-4f72-a4be-ae82c3a289cb","Type":"ContainerStarted","Data":"8d4402373316307c342ba3bba03f3e5b7f681a2a2efcc69f2842e098918193c1"}
Sep 07 12:06:01.944874 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.944776    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:01.946583 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.946539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" event={"ID":"2d7351cf-bf58-48b0-b634-4b6dc2283b7e","Type":"ContainerStarted","Data":"7bb291035982390d6c76813366399b897dfcdfe610a68a097fcf00dacc36bc73"}
Sep 07 12:06:01.963530 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:01.963470    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q" podStartSLOduration=1.963453333 podStartE2EDuration="1.963453333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:06:01.960951107 +0000 UTC m=+1137.098702425" watchObservedRunningTime="2026-09-07 12:06:01.963453333 +0000 UTC m=+1137.101204643"
Sep 07 12:06:02.956257 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:02.956210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" event={"ID":"2d7351cf-bf58-48b0-b634-4b6dc2283b7e","Type":"ContainerStarted","Data":"98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9"}
Sep 07 12:06:02.956757 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:02.956290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:02.976382 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:02.976311    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" podStartSLOduration=2.7813919240000002 podStartE2EDuration="3.976293775s" totalImagesPullingTime="1.194901851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:06:02.973074806 +0000 UTC m=+1138.110826130" watchObservedRunningTime="2026-09-07 12:06:02.976293775 +0000 UTC m=+1138.114045104"
Sep 07 12:06:07.911520 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.911480    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"]
Sep 07 12:06:07.917535 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.917508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:07.920028 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.920005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-3fa352-serving-cert\""
Sep 07 12:06:07.929595 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.929561    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"]
Sep 07 12:06:07.962073 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.962031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccw5g\" (UniqueName: \"kubernetes.io/projected/032368af-b9fd-4b54-97f3-b093ea5021d9-kube-api-access-ccw5g\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:07.962216 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.962166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-maas-api-tls\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:07.962216 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.962200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032368af-b9fd-4b54-97f3-b093ea5021d9-openshift-service-ca\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:07.962306 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:07.962227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-metrics-certs\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.063118 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.063084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-maas-api-tls\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.063308 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.063126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032368af-b9fd-4b54-97f3-b093ea5021d9-openshift-service-ca\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.063308 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.063151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-metrics-certs\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.063308 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.063217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccw5g\" (UniqueName: \"kubernetes.io/projected/032368af-b9fd-4b54-97f3-b093ea5021d9-kube-api-access-ccw5g\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.063846 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.063807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032368af-b9fd-4b54-97f3-b093ea5021d9-openshift-service-ca\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.065653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.065623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-maas-api-tls\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.065752 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.065700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-metrics-certs\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.072889 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.072865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccw5g\" (UniqueName: \"kubernetes.io/projected/032368af-b9fd-4b54-97f3-b093ea5021d9-kube-api-access-ccw5g\") pod \"maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.231366 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.231256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:08.513999 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.513816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"]
Sep 07 12:06:08.564038 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.563998    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"]
Sep 07 12:06:08.568927 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.568905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.571540 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.571519    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-3fa352-dockercfg-scpf4\""
Sep 07 12:06:08.571653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.571571    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-3fa352\""
Sep 07 12:06:08.579962 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.579939    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"]
Sep 07 12:06:08.669607 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.669567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7h7\" (UniqueName: \"kubernetes.io/projected/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-kube-api-access-dc7h7\") pod \"payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") " pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.669607 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.669610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") " pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.770805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.770725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7h7\" (UniqueName: \"kubernetes.io/projected/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-kube-api-access-dc7h7\") pod \"payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") " pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.770805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.770767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") " pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.771544 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.771525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") " pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.778067 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.778042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7h7\" (UniqueName: \"kubernetes.io/projected/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-kube-api-access-dc7h7\") pod \"payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") " pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.881966 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.881945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:08.968314 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.968280    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:08.999763 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.999730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z" event={"ID":"032368af-b9fd-4b54-97f3-b093ea5021d9","Type":"ContainerStarted","Data":"c46c87059f8bdd84e0c82d9d2d060b2c1edd05960479f43c07b23bada5032238"}
Sep 07 12:06:08.999943 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.999793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z" event={"ID":"032368af-b9fd-4b54-97f3-b093ea5021d9","Type":"ContainerStarted","Data":"74d72cf5538a8eae9483eac3609f1d115e33d99415033f34c542801a5b90b43e"}
Sep 07 12:06:08.999943 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:08.999825    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:09.016145 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:09.016085    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z" podStartSLOduration=1.676575862 podStartE2EDuration="2.016062s" totalImagesPullingTime="339.486138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:06:09.014647043 +0000 UTC m=+1144.152398356" watchObservedRunningTime="2026-09-07 12:06:09.016062 +0000 UTC m=+1144.153813313"
Sep 07 12:06:09.157124 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:09.157006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"]
Sep 07 12:06:09.159254 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:06:09.159223    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051feda_f2f6_4ce7_b1e5_1fa58ef6951e.slice/crio-0606ebb8a97811ca2b1d8a5ee7fbf47d6d48485cb360866e8a3805d9ca14be46 WatchSource:0}: Error finding container 0606ebb8a97811ca2b1d8a5ee7fbf47d6d48485cb360866e8a3805d9ca14be46: Status 404 returned error can't find the container with id 0606ebb8a97811ca2b1d8a5ee7fbf47d6d48485cb360866e8a3805d9ca14be46
Sep 07 12:06:10.007483 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:10.007447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8" event={"ID":"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e","Type":"ContainerStarted","Data":"0824bea9ecbbf10a0d877c95cd18642f5c5368ddb1c92c9bb909c245030a9f6a"}
Sep 07 12:06:10.007913 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:10.007512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8" event={"ID":"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e","Type":"ContainerStarted","Data":"0606ebb8a97811ca2b1d8a5ee7fbf47d6d48485cb360866e8a3805d9ca14be46"}
Sep 07 12:06:10.007913 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:10.007705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:10.025005 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:10.024951    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8" podStartSLOduration=2.024933935 podStartE2EDuration="2.024933935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:06:10.021938493 +0000 UTC m=+1145.159689797" watchObservedRunningTime="2026-09-07 12:06:10.024933935 +0000 UTC m=+1145.162685237"
Sep 07 12:06:12.958704 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:12.958673    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:15.013628 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:15.013592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:06:21.015373 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:21.015306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:06:30.375393 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.375271    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"]
Sep 07 12:06:30.375993 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.375538    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" podUID="2d7351cf-bf58-48b0-b634-4b6dc2283b7e" containerName="maas-api" containerID="cri-o://98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9" gracePeriod=30
Sep 07 12:06:30.437041 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.437003    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"]
Sep 07 12:06:30.437258 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.437230    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q" podUID="1bb731fd-7c70-4f72-a4be-ae82c3a289cb" containerName="payload-pre-processing" containerID="cri-o://ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3" gracePeriod=30
Sep 07 12:06:30.720997 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.720968    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:30.760604 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.760574    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:30.891794 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.891755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-metrics-certs\") pod \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") "
Sep 07 12:06:30.891990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.891837    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls\") pod \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") "
Sep 07 12:06:30.891990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.891899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-plugins-config-volume\") pod \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") "
Sep 07 12:06:30.891990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.891935    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-openshift-service-ca\") pod \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") "
Sep 07 12:06:30.891990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.891959    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn4gc\" (UniqueName: \"kubernetes.io/projected/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-kube-api-access-dn4gc\") pod \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\" (UID: \"1bb731fd-7c70-4f72-a4be-ae82c3a289cb\") "
Sep 07 12:06:30.892221 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.891995    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64dn9\" (UniqueName: \"kubernetes.io/projected/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-kube-api-access-64dn9\") pod \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\" (UID: \"2d7351cf-bf58-48b0-b634-4b6dc2283b7e\") "
Sep 07 12:06:30.892308 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.892274    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2d7351cf-bf58-48b0-b634-4b6dc2283b7e" (UID: "2d7351cf-bf58-48b0-b634-4b6dc2283b7e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:06:30.892391 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.892296    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1bb731fd-7c70-4f72-a4be-ae82c3a289cb" (UID: "1bb731fd-7c70-4f72-a4be-ae82c3a289cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:06:30.893954 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.893924    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2d7351cf-bf58-48b0-b634-4b6dc2283b7e" (UID: "2d7351cf-bf58-48b0-b634-4b6dc2283b7e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:06:30.894067 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.894008    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2d7351cf-bf58-48b0-b634-4b6dc2283b7e" (UID: "2d7351cf-bf58-48b0-b634-4b6dc2283b7e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:06:30.894067 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.894039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-kube-api-access-64dn9" (OuterVolumeSpecName: "kube-api-access-64dn9") pod "2d7351cf-bf58-48b0-b634-4b6dc2283b7e" (UID: "2d7351cf-bf58-48b0-b634-4b6dc2283b7e"). InnerVolumeSpecName "kube-api-access-64dn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:06:30.894139 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.894063    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-kube-api-access-dn4gc" (OuterVolumeSpecName: "kube-api-access-dn4gc") pod "1bb731fd-7c70-4f72-a4be-ae82c3a289cb" (UID: "1bb731fd-7c70-4f72-a4be-ae82c3a289cb"). InnerVolumeSpecName "kube-api-access-dn4gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:06:30.993533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.993421    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:06:30.993533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.993466    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:06:30.993533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.993480    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn4gc\" (UniqueName: \"kubernetes.io/projected/1bb731fd-7c70-4f72-a4be-ae82c3a289cb-kube-api-access-dn4gc\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:06:30.993533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.993493    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64dn9\" (UniqueName: \"kubernetes.io/projected/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-kube-api-access-64dn9\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:06:30.993533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.993507    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:06:30.993533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:30.993519    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d7351cf-bf58-48b0-b634-4b6dc2283b7e-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:06:31.138891 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.138851    2560 generic.go:356] "Generic (PLEG): container finished" podID="1bb731fd-7c70-4f72-a4be-ae82c3a289cb" containerID="ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3" exitCode=0
Sep 07 12:06:31.139075 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.138901    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"
Sep 07 12:06:31.139075 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.138930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q" event={"ID":"1bb731fd-7c70-4f72-a4be-ae82c3a289cb","Type":"ContainerDied","Data":"ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3"}
Sep 07 12:06:31.139075 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.138979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q" event={"ID":"1bb731fd-7c70-4f72-a4be-ae82c3a289cb","Type":"ContainerDied","Data":"8d4402373316307c342ba3bba03f3e5b7f681a2a2efcc69f2842e098918193c1"}
Sep 07 12:06:31.139075 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.139007    2560 scope.go:117] "RemoveContainer" containerID="ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3"
Sep 07 12:06:31.140315 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.140296    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d7351cf-bf58-48b0-b634-4b6dc2283b7e" containerID="98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9" exitCode=0
Sep 07 12:06:31.140411 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.140331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" event={"ID":"2d7351cf-bf58-48b0-b634-4b6dc2283b7e","Type":"ContainerDied","Data":"98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9"}
Sep 07 12:06:31.140411 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.140402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl" event={"ID":"2d7351cf-bf58-48b0-b634-4b6dc2283b7e","Type":"ContainerDied","Data":"7bb291035982390d6c76813366399b897dfcdfe610a68a097fcf00dacc36bc73"}
Sep 07 12:06:31.140523 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.140364    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"
Sep 07 12:06:31.150281 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.150255    2560 scope.go:117] "RemoveContainer" containerID="ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3"
Sep 07 12:06:31.150617 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:06:31.150591    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3\": container with ID starting with ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3 not found: ID does not exist" containerID="ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3"
Sep 07 12:06:31.150723 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.150626    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3"} err="failed to get container status \"ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3\": rpc error: code = NotFound desc = could not find container \"ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3\": container with ID starting with ecd7ace140ac6c3d429130b72e5b343d03d16e93fca1c81fd1eab93d4e9b42e3 not found: ID does not exist"
Sep 07 12:06:31.150723 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.150648    2560 scope.go:117] "RemoveContainer" containerID="98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9"
Sep 07 12:06:31.160189 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.160169    2560 scope.go:117] "RemoveContainer" containerID="98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9"
Sep 07 12:06:31.160521 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:06:31.160498    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9\": container with ID starting with 98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9 not found: ID does not exist" containerID="98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9"
Sep 07 12:06:31.160648 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.160526    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9"} err="failed to get container status \"98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9\": rpc error: code = NotFound desc = could not find container \"98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9\": container with ID starting with 98512a3f440c9727247816d872233b1c2a53fa1d87c0b1c639310904810bc5d9 not found: ID does not exist"
Sep 07 12:06:31.168881 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.168858    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"]
Sep 07 12:06:31.172681 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.172656    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57104ad7-c879bd8db-zmrkl"]
Sep 07 12:06:31.190237 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.190203    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"]
Sep 07 12:06:31.192789 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.192759    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-57104ad7-7f84dccc5d-wld9q"]
Sep 07 12:06:31.361525 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.361489    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb731fd-7c70-4f72-a4be-ae82c3a289cb" path="/var/lib/kubelet/pods/1bb731fd-7c70-4f72-a4be-ae82c3a289cb/volumes"
Sep 07 12:06:31.361923 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:06:31.361911    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7351cf-bf58-48b0-b634-4b6dc2283b7e" path="/var/lib/kubelet/pods/2d7351cf-bf58-48b0-b634-4b6dc2283b7e/volumes"
Sep 07 12:07:34.238257 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.238221    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"]
Sep 07 12:07:34.238785 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.238517    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z" podUID="032368af-b9fd-4b54-97f3-b093ea5021d9" containerName="maas-api" containerID="cri-o://c46c87059f8bdd84e0c82d9d2d060b2c1edd05960479f43c07b23bada5032238" gracePeriod=30
Sep 07 12:07:34.303824 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.303790    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"]
Sep 07 12:07:34.304042 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.304016    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8" podUID="8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" containerName="payload-processing" containerID="cri-o://0824bea9ecbbf10a0d877c95cd18642f5c5368ddb1c92c9bb909c245030a9f6a" gracePeriod=30
Sep 07 12:07:34.542588 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.542539    2560 generic.go:356] "Generic (PLEG): container finished" podID="032368af-b9fd-4b54-97f3-b093ea5021d9" containerID="c46c87059f8bdd84e0c82d9d2d060b2c1edd05960479f43c07b23bada5032238" exitCode=0
Sep 07 12:07:34.542747 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.542611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z" event={"ID":"032368af-b9fd-4b54-97f3-b093ea5021d9","Type":"ContainerDied","Data":"c46c87059f8bdd84e0c82d9d2d060b2c1edd05960479f43c07b23bada5032238"}
Sep 07 12:07:34.544807 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.544693    2560 generic.go:356] "Generic (PLEG): container finished" podID="8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" containerID="0824bea9ecbbf10a0d877c95cd18642f5c5368ddb1c92c9bb909c245030a9f6a" exitCode=0
Sep 07 12:07:34.544807 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.544750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8" event={"ID":"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e","Type":"ContainerDied","Data":"0824bea9ecbbf10a0d877c95cd18642f5c5368ddb1c92c9bb909c245030a9f6a"}
Sep 07 12:07:34.595906 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.595880    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:07:34.599167 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.599146    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:07:34.704284 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704245    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-plugins-config-volume\") pod \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") "
Sep 07 12:07:34.704510 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704296    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032368af-b9fd-4b54-97f3-b093ea5021d9-openshift-service-ca\") pod \"032368af-b9fd-4b54-97f3-b093ea5021d9\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") "
Sep 07 12:07:34.704510 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704376    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-maas-api-tls\") pod \"032368af-b9fd-4b54-97f3-b093ea5021d9\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") "
Sep 07 12:07:34.704510 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc7h7\" (UniqueName: \"kubernetes.io/projected/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-kube-api-access-dc7h7\") pod \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\" (UID: \"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e\") "
Sep 07 12:07:34.704510 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccw5g\" (UniqueName: \"kubernetes.io/projected/032368af-b9fd-4b54-97f3-b093ea5021d9-kube-api-access-ccw5g\") pod \"032368af-b9fd-4b54-97f3-b093ea5021d9\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") "
Sep 07 12:07:34.704510 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704462    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-metrics-certs\") pod \"032368af-b9fd-4b54-97f3-b093ea5021d9\" (UID: \"032368af-b9fd-4b54-97f3-b093ea5021d9\") "
Sep 07 12:07:34.704789 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032368af-b9fd-4b54-97f3-b093ea5021d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "032368af-b9fd-4b54-97f3-b093ea5021d9" (UID: "032368af-b9fd-4b54-97f3-b093ea5021d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:07:34.704850 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.704767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" (UID: "8051feda-f2f6-4ce7-b1e5-1fa58ef6951e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:07:34.706642 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.706617    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "032368af-b9fd-4b54-97f3-b093ea5021d9" (UID: "032368af-b9fd-4b54-97f3-b093ea5021d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:07:34.706642 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.706633    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-kube-api-access-dc7h7" (OuterVolumeSpecName: "kube-api-access-dc7h7") pod "8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" (UID: "8051feda-f2f6-4ce7-b1e5-1fa58ef6951e"). InnerVolumeSpecName "kube-api-access-dc7h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:07:34.706897 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.706869    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "032368af-b9fd-4b54-97f3-b093ea5021d9" (UID: "032368af-b9fd-4b54-97f3-b093ea5021d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:07:34.706897 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.706890    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032368af-b9fd-4b54-97f3-b093ea5021d9-kube-api-access-ccw5g" (OuterVolumeSpecName: "kube-api-access-ccw5g") pod "032368af-b9fd-4b54-97f3-b093ea5021d9" (UID: "032368af-b9fd-4b54-97f3-b093ea5021d9"). InnerVolumeSpecName "kube-api-access-ccw5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:07:34.805653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.805573    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:07:34.805653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.805602    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/032368af-b9fd-4b54-97f3-b093ea5021d9-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:07:34.805653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.805612    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:07:34.805653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.805621    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc7h7\" (UniqueName: \"kubernetes.io/projected/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e-kube-api-access-dc7h7\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:07:34.805653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.805631    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccw5g\" (UniqueName: \"kubernetes.io/projected/032368af-b9fd-4b54-97f3-b093ea5021d9-kube-api-access-ccw5g\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:07:34.805653 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:34.805639    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/032368af-b9fd-4b54-97f3-b093ea5021d9-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:07:35.553428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.553326    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"
Sep 07 12:07:35.553428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.553328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z" event={"ID":"032368af-b9fd-4b54-97f3-b093ea5021d9","Type":"ContainerDied","Data":"74d72cf5538a8eae9483eac3609f1d115e33d99415033f34c542801a5b90b43e"}
Sep 07 12:07:35.553428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.553423    2560 scope.go:117] "RemoveContainer" containerID="c46c87059f8bdd84e0c82d9d2d060b2c1edd05960479f43c07b23bada5032238"
Sep 07 12:07:35.555209 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.555181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8" event={"ID":"8051feda-f2f6-4ce7-b1e5-1fa58ef6951e","Type":"ContainerDied","Data":"0606ebb8a97811ca2b1d8a5ee7fbf47d6d48485cb360866e8a3805d9ca14be46"}
Sep 07 12:07:35.555362 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.555195    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"
Sep 07 12:07:35.564255 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.564229    2560 scope.go:117] "RemoveContainer" containerID="0824bea9ecbbf10a0d877c95cd18642f5c5368ddb1c92c9bb909c245030a9f6a"
Sep 07 12:07:35.573666 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.573646    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"]
Sep 07 12:07:35.577508 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.577472    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3fa352-6d7fbd5b65-dtgp8"]
Sep 07 12:07:35.587871 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.587848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"]
Sep 07 12:07:35.591692 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:35.591672    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-3fa352-5f5464f9f8-jtj4z"]
Sep 07 12:07:37.360295 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:37.360261    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="032368af-b9fd-4b54-97f3-b093ea5021d9" path="/var/lib/kubelet/pods/032368af-b9fd-4b54-97f3-b093ea5021d9/volumes"
Sep 07 12:07:37.360818 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:07:37.360801    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" path="/var/lib/kubelet/pods/8051feda-f2f6-4ce7-b1e5-1fa58ef6951e/volumes"
Sep 07 12:08:10.221925 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.221313    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"]
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222017    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb731fd-7c70-4f72-a4be-ae82c3a289cb" containerName="payload-pre-processing"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222039    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb731fd-7c70-4f72-a4be-ae82c3a289cb" containerName="payload-pre-processing"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222047    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7351cf-bf58-48b0-b634-4b6dc2283b7e" containerName="maas-api"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222053    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7351cf-bf58-48b0-b634-4b6dc2283b7e" containerName="maas-api"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222063    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032368af-b9fd-4b54-97f3-b093ea5021d9" containerName="maas-api"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222069    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="032368af-b9fd-4b54-97f3-b093ea5021d9" containerName="maas-api"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222088    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" containerName="payload-processing"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222094    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" containerName="payload-processing"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222159    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8051feda-f2f6-4ce7-b1e5-1fa58ef6951e" containerName="payload-processing"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222168    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="032368af-b9fd-4b54-97f3-b093ea5021d9" containerName="maas-api"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222177    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7351cf-bf58-48b0-b634-4b6dc2283b7e" containerName="maas-api"
Sep 07 12:08:10.222591 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.222183    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb731fd-7c70-4f72-a4be-ae82c3a289cb" containerName="payload-pre-processing"
Sep 07 12:08:10.227431 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.227390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.230000 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.229977    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5f62f6f8-serving-cert\""
Sep 07 12:08:10.231986 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.231962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.232167 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.232138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95a8284-1122-46a1-9758-343f58855eaf-openshift-service-ca\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.232304 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.232257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-metrics-certs\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.232421 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.232404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2x5\" (UniqueName: \"kubernetes.io/projected/e95a8284-1122-46a1-9758-343f58855eaf-kube-api-access-mb2x5\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.237115 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.236679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"]
Sep 07 12:08:10.333020 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.332985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2x5\" (UniqueName: \"kubernetes.io/projected/e95a8284-1122-46a1-9758-343f58855eaf-kube-api-access-mb2x5\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.333188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.333031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.333188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.333059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95a8284-1122-46a1-9758-343f58855eaf-openshift-service-ca\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.333188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.333134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-metrics-certs\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.333188 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:08:10.333157    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-serving-cert: secret "maas-api-e2e-mt-5f62f6f8-serving-cert" not found
Sep 07 12:08:10.333372 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:08:10.333231    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls podName:e95a8284-1122-46a1-9758-343f58855eaf nodeName:}" failed. No retries permitted until 2026-09-07 12:08:10.833210421 +0000 UTC m=+1265.970961710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls") pod "maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" (UID: "e95a8284-1122-46a1-9758-343f58855eaf") : secret "maas-api-e2e-mt-5f62f6f8-serving-cert" not found
Sep 07 12:08:10.333781 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.333759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95a8284-1122-46a1-9758-343f58855eaf-openshift-service-ca\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.335646 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.335622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-metrics-certs\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.343245 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.343221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2x5\" (UniqueName: \"kubernetes.io/projected/e95a8284-1122-46a1-9758-343f58855eaf-kube-api-access-mb2x5\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.837247 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.837191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.839958 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.839928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls\") pod \"maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.841783 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.841708    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:10.853240 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.853209    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"]
Sep 07 12:08:10.858995 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.858967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:10.861596 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.861575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5f62f6f8-dockercfg-w7qt2\""
Sep 07 12:08:10.861690 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.861669    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5f62f6f8\""
Sep 07 12:08:10.868969 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.868943    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"]
Sep 07 12:08:10.938112 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.938078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfz8\" (UniqueName: \"kubernetes.io/projected/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-kube-api-access-rcfz8\") pod \"payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:10.938112 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:10.938156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.038939 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.038909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfz8\" (UniqueName: \"kubernetes.io/projected/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-kube-api-access-rcfz8\") pod \"payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.039139 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.038979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.039710 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.039685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.048334 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.048305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfz8\" (UniqueName: \"kubernetes.io/projected/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-kube-api-access-rcfz8\") pod \"payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.121986 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.121951    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"]
Sep 07 12:08:11.123003 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:08:11.122952    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95a8284_1122_46a1_9758_343f58855eaf.slice/crio-acfab6c04f19afeca56ba680a632925ad8740e8d6583ac14309696f6f39baeba WatchSource:0}: Error finding container acfab6c04f19afeca56ba680a632925ad8740e8d6583ac14309696f6f39baeba: Status 404 returned error can't find the container with id acfab6c04f19afeca56ba680a632925ad8740e8d6583ac14309696f6f39baeba
Sep 07 12:08:11.182915 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.182875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.454902 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.454867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"]
Sep 07 12:08:11.455837 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:08:11.455809    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3725ee5_54c9_4db6_96ff_af4ea7894a7c.slice/crio-ea446fb0ed071a2a8d2483b46b7f4db769d5720710edeef519b5a6690c4ff06e WatchSource:0}: Error finding container ea446fb0ed071a2a8d2483b46b7f4db769d5720710edeef519b5a6690c4ff06e: Status 404 returned error can't find the container with id ea446fb0ed071a2a8d2483b46b7f4db769d5720710edeef519b5a6690c4ff06e
Sep 07 12:08:11.787125 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.787025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" event={"ID":"e95a8284-1122-46a1-9758-343f58855eaf","Type":"ContainerStarted","Data":"c8adda588f0b110d1492bc691bf223c9662a56a881c902987640268ab3dc6c22"}
Sep 07 12:08:11.787125 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.787088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" event={"ID":"e95a8284-1122-46a1-9758-343f58855eaf","Type":"ContainerStarted","Data":"acfab6c04f19afeca56ba680a632925ad8740e8d6583ac14309696f6f39baeba"}
Sep 07 12:08:11.787125 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.787117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:11.788733 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.788710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr" event={"ID":"a3725ee5-54c9-4db6-96ff-af4ea7894a7c","Type":"ContainerStarted","Data":"a80d32b802fd75122af94bc379181f4e76278ea2e5da06efc9a595f16bbf06d3"}
Sep 07 12:08:11.788848 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.788756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr" event={"ID":"a3725ee5-54c9-4db6-96ff-af4ea7894a7c","Type":"ContainerStarted","Data":"ea446fb0ed071a2a8d2483b46b7f4db769d5720710edeef519b5a6690c4ff06e"}
Sep 07 12:08:11.788848 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.788833    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:11.803599 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.803557    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" podStartSLOduration=1.322296011 podStartE2EDuration="1.803542392s" totalImagesPullingTime="481.246381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:08:11.802324962 +0000 UTC m=+1266.940076274" watchObservedRunningTime="2026-09-07 12:08:11.803542392 +0000 UTC m=+1266.941293714"
Sep 07 12:08:11.827454 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:11.827400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr" podStartSLOduration=1.827383642 podStartE2EDuration="1.827383642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:08:11.824259347 +0000 UTC m=+1266.962010657" watchObservedRunningTime="2026-09-07 12:08:11.827383642 +0000 UTC m=+1266.965134952"
Sep 07 12:08:17.800066 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:17.800035    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:22.796979 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:22.796941    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:36.450088 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.450048    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"]
Sep 07 12:08:36.450609 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.450303    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n" podUID="0cb71a24-ecdd-4222-9cc8-f395e33b054f" containerName="maas-api" containerID="cri-o://9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373" gracePeriod=30
Sep 07 12:08:36.727695 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.727670    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:08:36.888820 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.888783    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb71a24-ecdd-4222-9cc8-f395e33b054f-openshift-service-ca\") pod \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") "
Sep 07 12:08:36.889027 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.888857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-metrics-certs\") pod \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") "
Sep 07 12:08:36.889027 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.888941    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk986\" (UniqueName: \"kubernetes.io/projected/0cb71a24-ecdd-4222-9cc8-f395e33b054f-kube-api-access-tk986\") pod \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") "
Sep 07 12:08:36.889027 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.888969    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-maas-api-tls\") pod \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\" (UID: \"0cb71a24-ecdd-4222-9cc8-f395e33b054f\") "
Sep 07 12:08:36.889236 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.889209    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb71a24-ecdd-4222-9cc8-f395e33b054f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0cb71a24-ecdd-4222-9cc8-f395e33b054f" (UID: "0cb71a24-ecdd-4222-9cc8-f395e33b054f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:08:36.891018 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.890987    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0cb71a24-ecdd-4222-9cc8-f395e33b054f" (UID: "0cb71a24-ecdd-4222-9cc8-f395e33b054f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:08:36.891136 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.891051    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0cb71a24-ecdd-4222-9cc8-f395e33b054f" (UID: "0cb71a24-ecdd-4222-9cc8-f395e33b054f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:08:36.891136 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.891068    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cb71a24-ecdd-4222-9cc8-f395e33b054f-kube-api-access-tk986" (OuterVolumeSpecName: "kube-api-access-tk986") pod "0cb71a24-ecdd-4222-9cc8-f395e33b054f" (UID: "0cb71a24-ecdd-4222-9cc8-f395e33b054f"). InnerVolumeSpecName "kube-api-access-tk986". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:08:36.945867 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.945830    2560 generic.go:356] "Generic (PLEG): container finished" podID="0cb71a24-ecdd-4222-9cc8-f395e33b054f" containerID="9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373" exitCode=0
Sep 07 12:08:36.946050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.945888    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"
Sep 07 12:08:36.946050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.945907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n" event={"ID":"0cb71a24-ecdd-4222-9cc8-f395e33b054f","Type":"ContainerDied","Data":"9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373"}
Sep 07 12:08:36.946050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.945995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n" event={"ID":"0cb71a24-ecdd-4222-9cc8-f395e33b054f","Type":"ContainerDied","Data":"ede3eb26428ecc857a900a1451386e7106e68b4a3f9dbe152b3d3524cf5b9c0d"}
Sep 07 12:08:36.946197 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.946029    2560 scope.go:117] "RemoveContainer" containerID="9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373"
Sep 07 12:08:36.957016 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.956996    2560 scope.go:117] "RemoveContainer" containerID="9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373"
Sep 07 12:08:36.957279 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:08:36.957260    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373\": container with ID starting with 9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373 not found: ID does not exist" containerID="9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373"
Sep 07 12:08:36.957329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.957288    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373"} err="failed to get container status \"9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373\": rpc error: code = NotFound desc = could not find container \"9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373\": container with ID starting with 9ef68495637d0cac274fdf7ef906eb22866cc03ab9d0bc4280395ceca8106373 not found: ID does not exist"
Sep 07 12:08:36.976500 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.976479    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"]
Sep 07 12:08:36.990568 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.990549    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk986\" (UniqueName: \"kubernetes.io/projected/0cb71a24-ecdd-4222-9cc8-f395e33b054f-kube-api-access-tk986\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:36.990568 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.990568    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:36.990665 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.990578    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb71a24-ecdd-4222-9cc8-f395e33b054f-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:36.990665 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:36.990588    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb71a24-ecdd-4222-9cc8-f395e33b054f-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:37.008631 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:37.008605    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c7d751-8584569d8d-9fz5n"]
Sep 07 12:08:37.360016 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:37.359982    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cb71a24-ecdd-4222-9cc8-f395e33b054f" path="/var/lib/kubelet/pods/0cb71a24-ecdd-4222-9cc8-f395e33b054f/volumes"
Sep 07 12:08:51.755363 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:51.755303    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"]
Sep 07 12:08:51.755938 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:51.755550    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" podUID="e95a8284-1122-46a1-9758-343f58855eaf" containerName="maas-api" containerID="cri-o://c8adda588f0b110d1492bc691bf223c9662a56a881c902987640268ab3dc6c22" gracePeriod=30
Sep 07 12:08:51.822699 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:51.822664    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"]
Sep 07 12:08:51.823027 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:51.822885    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr" podUID="a3725ee5-54c9-4db6-96ff-af4ea7894a7c" containerName="payload-pre-processing" containerID="cri-o://a80d32b802fd75122af94bc379181f4e76278ea2e5da06efc9a595f16bbf06d3" gracePeriod=30
Sep 07 12:08:52.036222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.036118    2560 generic.go:356] "Generic (PLEG): container finished" podID="e95a8284-1122-46a1-9758-343f58855eaf" containerID="c8adda588f0b110d1492bc691bf223c9662a56a881c902987640268ab3dc6c22" exitCode=0
Sep 07 12:08:52.036381 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.036219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" event={"ID":"e95a8284-1122-46a1-9758-343f58855eaf","Type":"ContainerDied","Data":"c8adda588f0b110d1492bc691bf223c9662a56a881c902987640268ab3dc6c22"}
Sep 07 12:08:52.038574 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.038542    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3725ee5-54c9-4db6-96ff-af4ea7894a7c" containerID="a80d32b802fd75122af94bc379181f4e76278ea2e5da06efc9a595f16bbf06d3" exitCode=0
Sep 07 12:08:52.038718 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.038645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr" event={"ID":"a3725ee5-54c9-4db6-96ff-af4ea7894a7c","Type":"ContainerDied","Data":"a80d32b802fd75122af94bc379181f4e76278ea2e5da06efc9a595f16bbf06d3"}
Sep 07 12:08:52.085272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.085244    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:52.116864 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.116835    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:52.132624 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.132593    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls\") pod \"e95a8284-1122-46a1-9758-343f58855eaf\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") "
Sep 07 12:08:52.132790 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.132665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-metrics-certs\") pod \"e95a8284-1122-46a1-9758-343f58855eaf\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") "
Sep 07 12:08:52.132790 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.132706    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95a8284-1122-46a1-9758-343f58855eaf-openshift-service-ca\") pod \"e95a8284-1122-46a1-9758-343f58855eaf\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") "
Sep 07 12:08:52.133198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.133155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e95a8284-1122-46a1-9758-343f58855eaf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e95a8284-1122-46a1-9758-343f58855eaf" (UID: "e95a8284-1122-46a1-9758-343f58855eaf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:08:52.133390 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.133362    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb2x5\" (UniqueName: \"kubernetes.io/projected/e95a8284-1122-46a1-9758-343f58855eaf-kube-api-access-mb2x5\") pod \"e95a8284-1122-46a1-9758-343f58855eaf\" (UID: \"e95a8284-1122-46a1-9758-343f58855eaf\") "
Sep 07 12:08:52.133493 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.133458    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-plugins-config-volume\") pod \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") "
Sep 07 12:08:52.133562 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.133536    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcfz8\" (UniqueName: \"kubernetes.io/projected/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-kube-api-access-rcfz8\") pod \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\" (UID: \"a3725ee5-54c9-4db6-96ff-af4ea7894a7c\") "
Sep 07 12:08:52.133919 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.133897    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95a8284-1122-46a1-9758-343f58855eaf-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:52.134051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.134019    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3725ee5-54c9-4db6-96ff-af4ea7894a7c" (UID: "a3725ee5-54c9-4db6-96ff-af4ea7894a7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:08:52.135990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.135951    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95a8284-1122-46a1-9758-343f58855eaf-kube-api-access-mb2x5" (OuterVolumeSpecName: "kube-api-access-mb2x5") pod "e95a8284-1122-46a1-9758-343f58855eaf" (UID: "e95a8284-1122-46a1-9758-343f58855eaf"). InnerVolumeSpecName "kube-api-access-mb2x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:08:52.136253 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.136233    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e95a8284-1122-46a1-9758-343f58855eaf" (UID: "e95a8284-1122-46a1-9758-343f58855eaf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:08:52.136372 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.136330    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-kube-api-access-rcfz8" (OuterVolumeSpecName: "kube-api-access-rcfz8") pod "a3725ee5-54c9-4db6-96ff-af4ea7894a7c" (UID: "a3725ee5-54c9-4db6-96ff-af4ea7894a7c"). InnerVolumeSpecName "kube-api-access-rcfz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:08:52.136458 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.136305    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e95a8284-1122-46a1-9758-343f58855eaf" (UID: "e95a8284-1122-46a1-9758-343f58855eaf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:08:52.235030 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.234995    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:52.235030 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.235023    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e95a8284-1122-46a1-9758-343f58855eaf-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:52.235030 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.235032    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb2x5\" (UniqueName: \"kubernetes.io/projected/e95a8284-1122-46a1-9758-343f58855eaf-kube-api-access-mb2x5\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:52.235283 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.235042    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:52.235283 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:52.235051    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcfz8\" (UniqueName: \"kubernetes.io/projected/a3725ee5-54c9-4db6-96ff-af4ea7894a7c-kube-api-access-rcfz8\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:53.046577 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.046479    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"
Sep 07 12:08:53.046577 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.046517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6" event={"ID":"e95a8284-1122-46a1-9758-343f58855eaf","Type":"ContainerDied","Data":"acfab6c04f19afeca56ba680a632925ad8740e8d6583ac14309696f6f39baeba"}
Sep 07 12:08:53.047096 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.046589    2560 scope.go:117] "RemoveContainer" containerID="c8adda588f0b110d1492bc691bf223c9662a56a881c902987640268ab3dc6c22"
Sep 07 12:08:53.048983 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.048953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr" event={"ID":"a3725ee5-54c9-4db6-96ff-af4ea7894a7c","Type":"ContainerDied","Data":"ea446fb0ed071a2a8d2483b46b7f4db769d5720710edeef519b5a6690c4ff06e"}
Sep 07 12:08:53.049147 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.049120    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"
Sep 07 12:08:53.058886 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.058869    2560 scope.go:117] "RemoveContainer" containerID="a80d32b802fd75122af94bc379181f4e76278ea2e5da06efc9a595f16bbf06d3"
Sep 07 12:08:53.071497 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.071428    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"]
Sep 07 12:08:53.075047 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.075025    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f62f6f8-66685899cd-p7xb6"]
Sep 07 12:08:53.083751 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.083732    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"]
Sep 07 12:08:53.090261 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.090239    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5f62f6f8-5fffdf55d-b7znr"]
Sep 07 12:08:53.360677 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.360647    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3725ee5-54c9-4db6-96ff-af4ea7894a7c" path="/var/lib/kubelet/pods/a3725ee5-54c9-4db6-96ff-af4ea7894a7c/volumes"
Sep 07 12:08:53.361128 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:53.361106    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e95a8284-1122-46a1-9758-343f58855eaf" path="/var/lib/kubelet/pods/e95a8284-1122-46a1-9758-343f58855eaf/volumes"
Sep 07 12:08:54.643125 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.643090    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"]
Sep 07 12:08:54.643608 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.643456    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg" podUID="7d671525-2616-412b-b453-e7b32fa935ae" containerName="payload-pre-processing" containerID="cri-o://c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c" gracePeriod=30
Sep 07 12:08:54.923009 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.922982    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:08:54.958189 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.958160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79k6c\" (UniqueName: \"kubernetes.io/projected/7d671525-2616-412b-b453-e7b32fa935ae-kube-api-access-79k6c\") pod \"7d671525-2616-412b-b453-e7b32fa935ae\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") "
Sep 07 12:08:54.958437 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.958406    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d671525-2616-412b-b453-e7b32fa935ae-plugins-config-volume\") pod \"7d671525-2616-412b-b453-e7b32fa935ae\" (UID: \"7d671525-2616-412b-b453-e7b32fa935ae\") "
Sep 07 12:08:54.958800 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.958772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d671525-2616-412b-b453-e7b32fa935ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d671525-2616-412b-b453-e7b32fa935ae" (UID: "7d671525-2616-412b-b453-e7b32fa935ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:08:54.960549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:54.960520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d671525-2616-412b-b453-e7b32fa935ae-kube-api-access-79k6c" (OuterVolumeSpecName: "kube-api-access-79k6c") pod "7d671525-2616-412b-b453-e7b32fa935ae" (UID: "7d671525-2616-412b-b453-e7b32fa935ae"). InnerVolumeSpecName "kube-api-access-79k6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:08:55.059400 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.059335    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d671525-2616-412b-b453-e7b32fa935ae-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:55.059400 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.059386    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79k6c\" (UniqueName: \"kubernetes.io/projected/7d671525-2616-412b-b453-e7b32fa935ae-kube-api-access-79k6c\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:08:55.070463 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.070432    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d671525-2616-412b-b453-e7b32fa935ae" containerID="c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c" exitCode=0
Sep 07 12:08:55.070601 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.070534    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"
Sep 07 12:08:55.070642 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.070541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg" event={"ID":"7d671525-2616-412b-b453-e7b32fa935ae","Type":"ContainerDied","Data":"c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c"}
Sep 07 12:08:55.070678 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.070671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg" event={"ID":"7d671525-2616-412b-b453-e7b32fa935ae","Type":"ContainerDied","Data":"39165d36cc32d98435a93679ec07c20eb04abd866aea08584b46c22bc95db845"}
Sep 07 12:08:55.070715 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.070695    2560 scope.go:117] "RemoveContainer" containerID="c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c"
Sep 07 12:08:55.081176 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.081154    2560 scope.go:117] "RemoveContainer" containerID="c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c"
Sep 07 12:08:55.081515 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:08:55.081485    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c\": container with ID starting with c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c not found: ID does not exist" containerID="c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c"
Sep 07 12:08:55.081612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.081525    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c"} err="failed to get container status \"c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c\": rpc error: code = NotFound desc = could not find container \"c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c\": container with ID starting with c28197fa4a303a454d24d59400ae69b9012f2f66e0dda80b652a931d077f8c9c not found: ID does not exist"
Sep 07 12:08:55.095216 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.095193    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"]
Sep 07 12:08:55.099660 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.099638    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-af50c7-67bdbc9fc8-7jfsg"]
Sep 07 12:08:55.360634 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:08:55.360595    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d671525-2616-412b-b453-e7b32fa935ae" path="/var/lib/kubelet/pods/7d671525-2616-412b-b453-e7b32fa935ae/volumes"
Sep 07 12:09:07.263088 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263042    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"]
Sep 07 12:09:07.263761 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263741    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3725ee5-54c9-4db6-96ff-af4ea7894a7c" containerName="payload-pre-processing"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263763    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3725ee5-54c9-4db6-96ff-af4ea7894a7c" containerName="payload-pre-processing"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263793    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb71a24-ecdd-4222-9cc8-f395e33b054f" containerName="maas-api"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263798    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb71a24-ecdd-4222-9cc8-f395e33b054f" containerName="maas-api"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95a8284-1122-46a1-9758-343f58855eaf" containerName="maas-api"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263813    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95a8284-1122-46a1-9758-343f58855eaf" containerName="maas-api"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263828    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d671525-2616-412b-b453-e7b32fa935ae" containerName="payload-pre-processing"
Sep 07 12:09:07.263831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263834    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d671525-2616-412b-b453-e7b32fa935ae" containerName="payload-pre-processing"
Sep 07 12:09:07.264071 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263895    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d671525-2616-412b-b453-e7b32fa935ae" containerName="payload-pre-processing"
Sep 07 12:09:07.264071 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263910    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e95a8284-1122-46a1-9758-343f58855eaf" containerName="maas-api"
Sep 07 12:09:07.264071 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263920    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3725ee5-54c9-4db6-96ff-af4ea7894a7c" containerName="payload-pre-processing"
Sep 07 12:09:07.264071 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.263933    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb71a24-ecdd-4222-9cc8-f395e33b054f" containerName="maas-api"
Sep 07 12:09:07.268327 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.268306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.270915 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.270892    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-491296-dockercfg-xb9jl\""
Sep 07 12:09:07.271044 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.270932    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-491296\""
Sep 07 12:09:07.276436 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.276410    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"]
Sep 07 12:09:07.381464 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.381426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8dgd\" (UniqueName: \"kubernetes.io/projected/e8677a80-b8bb-40c7-a6df-792c83ed007d-kube-api-access-q8dgd\") pod \"payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.381464 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.381466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8677a80-b8bb-40c7-a6df-792c83ed007d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.482000 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.481955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8dgd\" (UniqueName: \"kubernetes.io/projected/e8677a80-b8bb-40c7-a6df-792c83ed007d-kube-api-access-q8dgd\") pod \"payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.482000 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.482000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8677a80-b8bb-40c7-a6df-792c83ed007d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.482714 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.482691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8677a80-b8bb-40c7-a6df-792c83ed007d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.489875 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.489843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8dgd\" (UniqueName: \"kubernetes.io/projected/e8677a80-b8bb-40c7-a6df-792c83ed007d-kube-api-access-q8dgd\") pod \"payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.582136 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.582041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:07.854109 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:07.854074    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"]
Sep 07 12:09:07.855165 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:09:07.855137    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8677a80_b8bb_40c7_a6df_792c83ed007d.slice/crio-090ef4afe6bf27b5fc8ffcddd939e6dfb8998b9fa0fa92741b6a620464be55a7 WatchSource:0}: Error finding container 090ef4afe6bf27b5fc8ffcddd939e6dfb8998b9fa0fa92741b6a620464be55a7: Status 404 returned error can't find the container with id 090ef4afe6bf27b5fc8ffcddd939e6dfb8998b9fa0fa92741b6a620464be55a7
Sep 07 12:09:08.153605 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:08.153570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5" event={"ID":"e8677a80-b8bb-40c7-a6df-792c83ed007d","Type":"ContainerStarted","Data":"d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1"}
Sep 07 12:09:08.153801 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:08.153621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5" event={"ID":"e8677a80-b8bb-40c7-a6df-792c83ed007d","Type":"ContainerStarted","Data":"090ef4afe6bf27b5fc8ffcddd939e6dfb8998b9fa0fa92741b6a620464be55a7"}
Sep 07 12:09:08.153801 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:08.153705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:08.172575 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:08.172527    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5" podStartSLOduration=1.172512948 podStartE2EDuration="1.172512948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:09:08.169240203 +0000 UTC m=+1323.306991518" watchObservedRunningTime="2026-09-07 12:09:08.172512948 +0000 UTC m=+1323.310264258"
Sep 07 12:09:17.254645 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.254607    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"]
Sep 07 12:09:17.258831 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.258808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.261484 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.261446    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-3a0bb2-dockercfg-zr9zv\""
Sep 07 12:09:17.261644 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.261588    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-3a0bb2\""
Sep 07 12:09:17.269931 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.269894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"]
Sep 07 12:09:17.285494 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.285464    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"]
Sep 07 12:09:17.289239 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.289216    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.298598 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.298570    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"]
Sep 07 12:09:17.371443 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.371414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595fk\" (UniqueName: \"kubernetes.io/projected/a37625e3-de14-460f-b5f3-d885708c5825-kube-api-access-595fk\") pod \"payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.371597 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.371464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a37625e3-de14-460f-b5f3-d885708c5825-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.371597 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.371534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pskr\" (UniqueName: \"kubernetes.io/projected/e8d45c65-c6dc-4051-8559-acf9255b8005-kube-api-access-4pskr\") pod \"payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.371687 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.371600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8d45c65-c6dc-4051-8559-acf9255b8005-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.472688 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.472637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-595fk\" (UniqueName: \"kubernetes.io/projected/a37625e3-de14-460f-b5f3-d885708c5825-kube-api-access-595fk\") pod \"payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.472875 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.472720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a37625e3-de14-460f-b5f3-d885708c5825-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.472875 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.472775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pskr\" (UniqueName: \"kubernetes.io/projected/e8d45c65-c6dc-4051-8559-acf9255b8005-kube-api-access-4pskr\") pod \"payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.473009 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.472874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8d45c65-c6dc-4051-8559-acf9255b8005-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.473560 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.473533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a37625e3-de14-460f-b5f3-d885708c5825-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.473723 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.473700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8d45c65-c6dc-4051-8559-acf9255b8005-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.484128 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.484103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pskr\" (UniqueName: \"kubernetes.io/projected/e8d45c65-c6dc-4051-8559-acf9255b8005-kube-api-access-4pskr\") pod \"payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.484690 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.484668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-595fk\" (UniqueName: \"kubernetes.io/projected/a37625e3-de14-460f-b5f3-d885708c5825-kube-api-access-595fk\") pod \"payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.570378 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.570251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:17.601613 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.601578    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:17.849322 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.849283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"]
Sep 07 12:09:17.850813 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:09:17.850777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37625e3_de14_460f_b5f3_d885708c5825.slice/crio-763be9d105550aaf7f9d1e4d57d1c8f0d36279179426f33d4e658e7f1bfd1340 WatchSource:0}: Error finding container 763be9d105550aaf7f9d1e4d57d1c8f0d36279179426f33d4e658e7f1bfd1340: Status 404 returned error can't find the container with id 763be9d105550aaf7f9d1e4d57d1c8f0d36279179426f33d4e658e7f1bfd1340
Sep 07 12:09:17.885387 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:17.885360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"]
Sep 07 12:09:17.886948 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:09:17.886916    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d45c65_c6dc_4051_8559_acf9255b8005.slice/crio-f7efbc52f043483b3aa2ead3a14fee925d481e812c9739aad923ea85af4be7f0 WatchSource:0}: Error finding container f7efbc52f043483b3aa2ead3a14fee925d481e812c9739aad923ea85af4be7f0: Status 404 returned error can't find the container with id f7efbc52f043483b3aa2ead3a14fee925d481e812c9739aad923ea85af4be7f0
Sep 07 12:09:18.223502 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.223453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx" event={"ID":"a37625e3-de14-460f-b5f3-d885708c5825","Type":"ContainerStarted","Data":"0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed"}
Sep 07 12:09:18.223711 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.223531    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:18.223711 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.223558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx" event={"ID":"a37625e3-de14-460f-b5f3-d885708c5825","Type":"ContainerStarted","Data":"763be9d105550aaf7f9d1e4d57d1c8f0d36279179426f33d4e658e7f1bfd1340"}
Sep 07 12:09:18.225383 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.225334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l" event={"ID":"e8d45c65-c6dc-4051-8559-acf9255b8005","Type":"ContainerStarted","Data":"2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257"}
Sep 07 12:09:18.225505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.225410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l" event={"ID":"e8d45c65-c6dc-4051-8559-acf9255b8005","Type":"ContainerStarted","Data":"f7efbc52f043483b3aa2ead3a14fee925d481e812c9739aad923ea85af4be7f0"}
Sep 07 12:09:18.225505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.225439    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:18.239242 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.239188    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx" podStartSLOduration=1.239174084 podStartE2EDuration="1.239174084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:09:18.237508796 +0000 UTC m=+1333.375260107" watchObservedRunningTime="2026-09-07 12:09:18.239174084 +0000 UTC m=+1333.376925394"
Sep 07 12:09:18.255099 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:18.255045    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l" podStartSLOduration=1.255026454 podStartE2EDuration="1.255026454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:09:18.252386567 +0000 UTC m=+1333.390137881" watchObservedRunningTime="2026-09-07 12:09:18.255026454 +0000 UTC m=+1333.392777768"
Sep 07 12:09:19.162835 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:19.162802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:09:29.234505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:29.234426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:09:29.234505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:29.234505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:09:34.912119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.912084    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"]
Sep 07 12:09:34.917418 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.917392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:34.920149 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.920121    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-613886-serving-cert\""
Sep 07 12:09:34.926525 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.926499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"]
Sep 07 12:09:34.942795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.942763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:34.942939 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.942821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqgbt\" (UniqueName: \"kubernetes.io/projected/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-kube-api-access-tqgbt\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:34.942939 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.942876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:34.942939 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:34.942928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.043450 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.043406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqgbt\" (UniqueName: \"kubernetes.io/projected/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-kube-api-access-tqgbt\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.043636 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.043462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.043636 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.043503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.043636 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.043615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.044260 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.044233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.045944 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.045918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.046460 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.046441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.052191 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.052167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqgbt\" (UniqueName: \"kubernetes.io/projected/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-kube-api-access-tqgbt\") pod \"maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.234528 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.234489    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:35.511538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.511509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"]
Sep 07 12:09:35.511977 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:09:35.511953    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f2c49c_bddc_4fcd_9ac9_4d904ebb111a.slice/crio-480c8d869d34bc33d664a40ce88994b544ed70edc9918ec5dbba299a755dec18 WatchSource:0}: Error finding container 480c8d869d34bc33d664a40ce88994b544ed70edc9918ec5dbba299a755dec18: Status 404 returned error can't find the container with id 480c8d869d34bc33d664a40ce88994b544ed70edc9918ec5dbba299a755dec18
Sep 07 12:09:35.513420 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:35.513403    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:09:36.346549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:36.346502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf" event={"ID":"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a","Type":"ContainerStarted","Data":"480c8d869d34bc33d664a40ce88994b544ed70edc9918ec5dbba299a755dec18"}
Sep 07 12:09:37.359461 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:37.359430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:37.359881 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:37.359488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf" event={"ID":"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a","Type":"ContainerStarted","Data":"2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd"}
Sep 07 12:09:37.371366 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:37.371292    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf" podStartSLOduration=2.360455875 podStartE2EDuration="3.371277538s" totalImagesPullingTime="1.010821663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:09:37.36936426 +0000 UTC m=+1352.507115569" watchObservedRunningTime="2026-09-07 12:09:37.371277538 +0000 UTC m=+1352.509028849"
Sep 07 12:09:43.366496 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:43.366465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:09:45.100585 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.100549    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"]
Sep 07 12:09:45.105802 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.105769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.108694 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.108666    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-bff0c9-serving-cert\""
Sep 07 12:09:45.118444 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.118417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"]
Sep 07 12:09:45.138425 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.138387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b32b18-c19f-4efd-aadc-2b925d1b08df-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.138594 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.138515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.138659 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.138637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.138698 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.138678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6jv\" (UniqueName: \"kubernetes.io/projected/c6b32b18-c19f-4efd-aadc-2b925d1b08df-kube-api-access-9n6jv\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.240010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.239963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.240211 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.240039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.240211 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.240056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6jv\" (UniqueName: \"kubernetes.io/projected/c6b32b18-c19f-4efd-aadc-2b925d1b08df-kube-api-access-9n6jv\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.240211 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.240086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b32b18-c19f-4efd-aadc-2b925d1b08df-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.240211 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:09:45.240175    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-serving-cert: secret "maas-api-e2e-shared-b-w2-bff0c9-serving-cert" not found
Sep 07 12:09:45.240470 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:09:45.240256    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls podName:c6b32b18-c19f-4efd-aadc-2b925d1b08df nodeName:}" failed. No retries permitted until 2026-09-07 12:09:45.740239266 +0000 UTC m=+1360.877990555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls") pod "maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" (UID: "c6b32b18-c19f-4efd-aadc-2b925d1b08df") : secret "maas-api-e2e-shared-b-w2-bff0c9-serving-cert" not found
Sep 07 12:09:45.240752 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.240733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b32b18-c19f-4efd-aadc-2b925d1b08df-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.242558 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.242540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.251915 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.251888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6jv\" (UniqueName: \"kubernetes.io/projected/c6b32b18-c19f-4efd-aadc-2b925d1b08df-kube-api-access-9n6jv\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.745065 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.745028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:45.747719 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:45.747687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:46.019489 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:46.019403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:46.294603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:46.294572    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"]
Sep 07 12:09:46.295380 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:09:46.295348    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b32b18_c19f_4efd_aadc_2b925d1b08df.slice/crio-b3549e0a4ded426e5e62c4416d44cd4e951f4ca1c240d014c793f4beedfae4be WatchSource:0}: Error finding container b3549e0a4ded426e5e62c4416d44cd4e951f4ca1c240d014c793f4beedfae4be: Status 404 returned error can't find the container with id b3549e0a4ded426e5e62c4416d44cd4e951f4ca1c240d014c793f4beedfae4be
Sep 07 12:09:46.409370 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:46.409325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" event={"ID":"c6b32b18-c19f-4efd-aadc-2b925d1b08df","Type":"ContainerStarted","Data":"b3549e0a4ded426e5e62c4416d44cd4e951f4ca1c240d014c793f4beedfae4be"}
Sep 07 12:09:47.417263 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:47.417225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" event={"ID":"c6b32b18-c19f-4efd-aadc-2b925d1b08df","Type":"ContainerStarted","Data":"214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075"}
Sep 07 12:09:47.417731 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:47.417369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:09:47.437083 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:47.437040    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" podStartSLOduration=1.8843112610000001 podStartE2EDuration="2.437026032s" totalImagesPullingTime="552.714771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:09:47.436269226 +0000 UTC m=+1362.574020538" watchObservedRunningTime="2026-09-07 12:09:47.437026032 +0000 UTC m=+1362.574777392"
Sep 07 12:09:53.428083 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:09:53.428049    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:10:05.850374 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:05.850323    2560 scope.go:117] "RemoveContainer" containerID="768810a1caee3364240da9e38c326ef5b88c538c55e4c19b0daf5f68f22e7392"
Sep 07 12:10:09.455356 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.455306    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7494-140427222083024"]
Sep 07 12:10:09.459206 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.459183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:09.461779 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.461752    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c7bf7\""
Sep 07 12:10:09.462928 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.462905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140427222083024"]
Sep 07 12:10:09.571116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.571083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5w8f\" (UniqueName: \"kubernetes.io/projected/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0-kube-api-access-v5w8f\") pod \"test-curl-7494-140427222083024\" (UID: \"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0\") " pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:09.672209 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.672170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5w8f\" (UniqueName: \"kubernetes.io/projected/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0-kube-api-access-v5w8f\") pod \"test-curl-7494-140427222083024\" (UID: \"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0\") " pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:09.679548 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.679517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5w8f\" (UniqueName: \"kubernetes.io/projected/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0-kube-api-access-v5w8f\") pod \"test-curl-7494-140427222083024\" (UID: \"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0\") " pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:09.770898 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:09.770811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:10.041985 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:10.041950    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140427222083024"]
Sep 07 12:10:10.043154 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:10:10.043129    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cbbfb0b_dd18_4a4e_b441_05e9e4f9e6b0.slice/crio-288fecbe69a381964847ff4173501320af3d32a9b2531f4c0db31e13cb6e4485 WatchSource:0}: Error finding container 288fecbe69a381964847ff4173501320af3d32a9b2531f4c0db31e13cb6e4485: Status 404 returned error can't find the container with id 288fecbe69a381964847ff4173501320af3d32a9b2531f4c0db31e13cb6e4485
Sep 07 12:10:10.562781 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:10.562747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140427222083024" event={"ID":"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0","Type":"ContainerStarted","Data":"288fecbe69a381964847ff4173501320af3d32a9b2531f4c0db31e13cb6e4485"}
Sep 07 12:10:11.570324 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:11.570292    2560 generic.go:356] "Generic (PLEG): container finished" podID="5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0" containerID="7060d873fdc6a64ecf7cf2d8f12c811546ace20701c3d19a9f9361f7d342d9da" exitCode=0
Sep 07 12:10:11.570730 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:11.570385    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140427222083024" event={"ID":"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0","Type":"ContainerDied","Data":"7060d873fdc6a64ecf7cf2d8f12c811546ace20701c3d19a9f9361f7d342d9da"}
Sep 07 12:10:12.716701 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.716675    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:12.746583 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.746508    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7494-140427222083024_5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0/test-curl-7494-140427222083024/0.log"
Sep 07 12:10:12.769622 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.769591    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7494-140427222083024"]
Sep 07 12:10:12.773051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.773023    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7494-140427222083024"]
Sep 07 12:10:12.802618 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.802585    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5w8f\" (UniqueName: \"kubernetes.io/projected/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0-kube-api-access-v5w8f\") pod \"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0\" (UID: \"5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0\") "
Sep 07 12:10:12.804650 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.804620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0-kube-api-access-v5w8f" (OuterVolumeSpecName: "kube-api-access-v5w8f") pod "5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0" (UID: "5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0"). InnerVolumeSpecName "kube-api-access-v5w8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:10:12.903649 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:12.903611    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5w8f\" (UniqueName: \"kubernetes.io/projected/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0-kube-api-access-v5w8f\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:10:13.363459 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:13.361804    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0" path="/var/lib/kubelet/pods/5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0/volumes"
Sep 07 12:10:13.582484 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:13.582451    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083024"
Sep 07 12:10:13.582484 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:13.582440    2560 scope.go:117] "RemoveContainer" containerID="7060d873fdc6a64ecf7cf2d8f12c811546ace20701c3d19a9f9361f7d342d9da"
Sep 07 12:10:16.479158 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.479121    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:16.479604 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.479590    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0" containerName="test-curl-7494-140427222083024"
Sep 07 12:10:16.479604 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.479605    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0" containerName="test-curl-7494-140427222083024"
Sep 07 12:10:16.479702 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.479678    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cbbfb0b-dd18-4a4e-b441-05e9e4f9e6b0" containerName="test-curl-7494-140427222083024"
Sep 07 12:10:16.484241 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.484212    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:16.486475 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.486446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:16.486669 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.486648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c7bf7\""
Sep 07 12:10:16.638582 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.638546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47vt\" (UniqueName: \"kubernetes.io/projected/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc-kube-api-access-b47vt\") pod \"test-curl-7494-140427222083600\" (UID: \"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc\") " pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:16.740070 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.739973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47vt\" (UniqueName: \"kubernetes.io/projected/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc-kube-api-access-b47vt\") pod \"test-curl-7494-140427222083600\" (UID: \"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc\") " pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:16.748003 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.747978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47vt\" (UniqueName: \"kubernetes.io/projected/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc-kube-api-access-b47vt\") pod \"test-curl-7494-140427222083600\" (UID: \"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc\") " pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:16.795012 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:16.794976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:17.065673 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:17.065645    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:17.066620 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:10:17.066589    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ff428cd_74ff_43e6_8809_33e0f9f6e5fc.slice/crio-c4498506046ef029928c9026f044d707c5c3dbc706f5527a2eabff8b768fca8e WatchSource:0}: Error finding container c4498506046ef029928c9026f044d707c5c3dbc706f5527a2eabff8b768fca8e: Status 404 returned error can't find the container with id c4498506046ef029928c9026f044d707c5c3dbc706f5527a2eabff8b768fca8e
Sep 07 12:10:17.609217 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:17.609181    2560 generic.go:356] "Generic (PLEG): container finished" podID="6ff428cd-74ff-43e6-8809-33e0f9f6e5fc" containerID="a59ec82e4dd9c11f66f6c56e14649c491022f2c2a688f8846a38a8043670330d" exitCode=0
Sep 07 12:10:17.609610 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:17.609262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140427222083600" event={"ID":"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc","Type":"ContainerDied","Data":"a59ec82e4dd9c11f66f6c56e14649c491022f2c2a688f8846a38a8043670330d"}
Sep 07 12:10:17.609610 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:17.609306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140427222083600" event={"ID":"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc","Type":"ContainerStarted","Data":"c4498506046ef029928c9026f044d707c5c3dbc706f5527a2eabff8b768fca8e"}
Sep 07 12:10:18.758629 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.758593    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:18.776905 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.776873    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7494-140427222083600_6ff428cd-74ff-43e6-8809-33e0f9f6e5fc/test-curl-7494-140427222083600/0.log"
Sep 07 12:10:18.797279 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.797238    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:18.800537 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.800507    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:18.859715 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.859617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b47vt\" (UniqueName: \"kubernetes.io/projected/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc-kube-api-access-b47vt\") pod \"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc\" (UID: \"6ff428cd-74ff-43e6-8809-33e0f9f6e5fc\") "
Sep 07 12:10:18.861640 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.861616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc-kube-api-access-b47vt" (OuterVolumeSpecName: "kube-api-access-b47vt") pod "6ff428cd-74ff-43e6-8809-33e0f9f6e5fc" (UID: "6ff428cd-74ff-43e6-8809-33e0f9f6e5fc"). InnerVolumeSpecName "kube-api-access-b47vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:10:18.929689 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.929654    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:18.930144 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.930130    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff428cd-74ff-43e6-8809-33e0f9f6e5fc" containerName="test-curl-7494-140427222083600"
Sep 07 12:10:18.930204 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.930146    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff428cd-74ff-43e6-8809-33e0f9f6e5fc" containerName="test-curl-7494-140427222083600"
Sep 07 12:10:18.930241 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.930222    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff428cd-74ff-43e6-8809-33e0f9f6e5fc" containerName="test-curl-7494-140427222083600"
Sep 07 12:10:18.933474 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.933454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:18.939462 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.939437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:18.960894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:18.960863    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b47vt\" (UniqueName: \"kubernetes.io/projected/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc-kube-api-access-b47vt\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:10:19.061642 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.061599    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gthbf\" (UniqueName: \"kubernetes.io/projected/960d2b46-c8fd-4038-b1c0-0739425f369b-kube-api-access-gthbf\") pod \"test-curl-7494-140427222083600\" (UID: \"960d2b46-c8fd-4038-b1c0-0739425f369b\") " pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:19.162874 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.162795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gthbf\" (UniqueName: \"kubernetes.io/projected/960d2b46-c8fd-4038-b1c0-0739425f369b-kube-api-access-gthbf\") pod \"test-curl-7494-140427222083600\" (UID: \"960d2b46-c8fd-4038-b1c0-0739425f369b\") " pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:19.171446 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.171414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gthbf\" (UniqueName: \"kubernetes.io/projected/960d2b46-c8fd-4038-b1c0-0739425f369b-kube-api-access-gthbf\") pod \"test-curl-7494-140427222083600\" (UID: \"960d2b46-c8fd-4038-b1c0-0739425f369b\") " pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:19.244714 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.244678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:19.360861 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.360758    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff428cd-74ff-43e6-8809-33e0f9f6e5fc" path="/var/lib/kubelet/pods/6ff428cd-74ff-43e6-8809-33e0f9f6e5fc/volumes"
Sep 07 12:10:19.515105 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.515077    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:19.516295 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:10:19.516270    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod960d2b46_c8fd_4038_b1c0_0739425f369b.slice/crio-fba86b07839f6aa133cd96f04df502c49138d09db57f1a41cc82714b3e078334 WatchSource:0}: Error finding container fba86b07839f6aa133cd96f04df502c49138d09db57f1a41cc82714b3e078334: Status 404 returned error can't find the container with id fba86b07839f6aa133cd96f04df502c49138d09db57f1a41cc82714b3e078334
Sep 07 12:10:19.622145 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.622099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140427222083600" event={"ID":"960d2b46-c8fd-4038-b1c0-0739425f369b","Type":"ContainerStarted","Data":"fba86b07839f6aa133cd96f04df502c49138d09db57f1a41cc82714b3e078334"}
Sep 07 12:10:19.623394 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.623375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:19.623464 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:19.623400    2560 scope.go:117] "RemoveContainer" containerID="a59ec82e4dd9c11f66f6c56e14649c491022f2c2a688f8846a38a8043670330d"
Sep 07 12:10:20.631227 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:20.631189    2560 generic.go:356] "Generic (PLEG): container finished" podID="960d2b46-c8fd-4038-b1c0-0739425f369b" containerID="4ed1618d7ea9a94c83bed4d255ddfd0a36ff7b1e987711d7afaa2d39161e3d2c" exitCode=0
Sep 07 12:10:20.631706 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:20.631275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140427222083600" event={"ID":"960d2b46-c8fd-4038-b1c0-0739425f369b","Type":"ContainerDied","Data":"4ed1618d7ea9a94c83bed4d255ddfd0a36ff7b1e987711d7afaa2d39161e3d2c"}
Sep 07 12:10:21.781515 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.781488    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:21.799175 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.799143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7494-140427222083600_960d2b46-c8fd-4038-b1c0-0739425f369b/test-curl-7494-140427222083600/0.log"
Sep 07 12:10:21.817539 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.817501    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:21.820194 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.820162    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7494-140427222083600"]
Sep 07 12:10:21.885930 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.885883    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gthbf\" (UniqueName: \"kubernetes.io/projected/960d2b46-c8fd-4038-b1c0-0739425f369b-kube-api-access-gthbf\") pod \"960d2b46-c8fd-4038-b1c0-0739425f369b\" (UID: \"960d2b46-c8fd-4038-b1c0-0739425f369b\") "
Sep 07 12:10:21.888167 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.888143    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960d2b46-c8fd-4038-b1c0-0739425f369b-kube-api-access-gthbf" (OuterVolumeSpecName: "kube-api-access-gthbf") pod "960d2b46-c8fd-4038-b1c0-0739425f369b" (UID: "960d2b46-c8fd-4038-b1c0-0739425f369b"). InnerVolumeSpecName "kube-api-access-gthbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:10:21.987091 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:21.987052    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gthbf\" (UniqueName: \"kubernetes.io/projected/960d2b46-c8fd-4038-b1c0-0739425f369b-kube-api-access-gthbf\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:10:22.645941 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:22.645910    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fba86b07839f6aa133cd96f04df502c49138d09db57f1a41cc82714b3e078334"
Sep 07 12:10:22.645941 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:22.645930    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:22.656127 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:10:22.656094    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7494-140427222083600\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="960d2b46-c8fd-4038-b1c0-0739425f369b" pod="opendatahub/test-curl-7494-140427222083600"
Sep 07 12:10:23.360394 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:23.360355    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960d2b46-c8fd-4038-b1c0-0739425f369b" path="/var/lib/kubelet/pods/960d2b46-c8fd-4038-b1c0-0739425f369b/volumes"
Sep 07 12:10:27.396141 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.396099    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"]
Sep 07 12:10:27.396832 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.396809    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960d2b46-c8fd-4038-b1c0-0739425f369b" containerName="test-curl-7494-140427222083600"
Sep 07 12:10:27.396832 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.396832    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="960d2b46-c8fd-4038-b1c0-0739425f369b" containerName="test-curl-7494-140427222083600"
Sep 07 12:10:27.396989 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.396907    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="960d2b46-c8fd-4038-b1c0-0739425f369b" containerName="test-curl-7494-140427222083600"
Sep 07 12:10:27.400396 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.400375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.402933 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.402913    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-619f5b7c-serving-cert\""
Sep 07 12:10:27.410409 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.410267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"]
Sep 07 12:10:27.439676 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.439647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kqp\" (UniqueName: \"kubernetes.io/projected/2525cebc-5c18-4db0-ace9-fe9edee238c9-kube-api-access-c9kqp\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.439805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.439700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2525cebc-5c18-4db0-ace9-fe9edee238c9-openshift-service-ca\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.439805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.439749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.439805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.439764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-metrics-certs\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.541134 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.541097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kqp\" (UniqueName: \"kubernetes.io/projected/2525cebc-5c18-4db0-ace9-fe9edee238c9-kube-api-access-c9kqp\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.541304 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.541146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2525cebc-5c18-4db0-ace9-fe9edee238c9-openshift-service-ca\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.541304 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.541179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.541304 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.541203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-metrics-certs\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.541447 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:10:27.541327    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-serving-cert: secret "maas-api-e2e-mt-619f5b7c-serving-cert" not found
Sep 07 12:10:27.541447 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:10:27.541428    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls podName:2525cebc-5c18-4db0-ace9-fe9edee238c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:28.04140954 +0000 UTC m=+1403.179160852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls") pod "maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" (UID: "2525cebc-5c18-4db0-ace9-fe9edee238c9") : secret "maas-api-e2e-mt-619f5b7c-serving-cert" not found
Sep 07 12:10:27.541775 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.541756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2525cebc-5c18-4db0-ace9-fe9edee238c9-openshift-service-ca\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.543595 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.543579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-metrics-certs\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:27.549553 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:27.549530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kqp\" (UniqueName: \"kubernetes.io/projected/2525cebc-5c18-4db0-ace9-fe9edee238c9-kube-api-access-c9kqp\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:28.037822 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.037786    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"]
Sep 07 12:10:28.041597 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.041577    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.044553 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.044529    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-619f5b7c\""
Sep 07 12:10:28.044841 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.044614    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-619f5b7c-dockercfg-mmbr4\""
Sep 07 12:10:28.046227 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.046202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:28.048762 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.048730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls\") pod \"maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:28.057182 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.057158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"]
Sep 07 12:10:28.147012 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.146959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plgcl\" (UniqueName: \"kubernetes.io/projected/2be94707-bdb2-4cb3-a6e8-da80e467e410-kube-api-access-plgcl\") pod \"payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") " pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.147196 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.147037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be94707-bdb2-4cb3-a6e8-da80e467e410-plugins-config-volume\") pod \"payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") " pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.248311 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.248273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plgcl\" (UniqueName: \"kubernetes.io/projected/2be94707-bdb2-4cb3-a6e8-da80e467e410-kube-api-access-plgcl\") pod \"payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") " pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.248527 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.248335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be94707-bdb2-4cb3-a6e8-da80e467e410-plugins-config-volume\") pod \"payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") " pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.249223 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.249195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be94707-bdb2-4cb3-a6e8-da80e467e410-plugins-config-volume\") pod \"payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") " pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.256354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.256308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plgcl\" (UniqueName: \"kubernetes.io/projected/2be94707-bdb2-4cb3-a6e8-da80e467e410-kube-api-access-plgcl\") pod \"payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") " pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.314779 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.314701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:28.366573 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.366545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:28.589817 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.589783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"]
Sep 07 12:10:28.590465 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:10:28.590428    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2525cebc_5c18_4db0_ace9_fe9edee238c9.slice/crio-dbaed483606e8efabfeb31ceecd6962fa7ceb2de5b64612dffc3f2284c62bba4 WatchSource:0}: Error finding container dbaed483606e8efabfeb31ceecd6962fa7ceb2de5b64612dffc3f2284c62bba4: Status 404 returned error can't find the container with id dbaed483606e8efabfeb31ceecd6962fa7ceb2de5b64612dffc3f2284c62bba4
Sep 07 12:10:28.651496 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.651465    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"]
Sep 07 12:10:28.652627 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:10:28.652598    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be94707_bdb2_4cb3_a6e8_da80e467e410.slice/crio-79601fc2ba789215dd1ea02a40900bed9f9cb5af8e21b7d4844040f09492ea4c WatchSource:0}: Error finding container 79601fc2ba789215dd1ea02a40900bed9f9cb5af8e21b7d4844040f09492ea4c: Status 404 returned error can't find the container with id 79601fc2ba789215dd1ea02a40900bed9f9cb5af8e21b7d4844040f09492ea4c
Sep 07 12:10:28.689976 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.689947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" event={"ID":"2525cebc-5c18-4db0-ace9-fe9edee238c9","Type":"ContainerStarted","Data":"dbaed483606e8efabfeb31ceecd6962fa7ceb2de5b64612dffc3f2284c62bba4"}
Sep 07 12:10:28.691176 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:28.691143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs" event={"ID":"2be94707-bdb2-4cb3-a6e8-da80e467e410","Type":"ContainerStarted","Data":"79601fc2ba789215dd1ea02a40900bed9f9cb5af8e21b7d4844040f09492ea4c"}
Sep 07 12:10:29.699563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:29.699523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" event={"ID":"2525cebc-5c18-4db0-ace9-fe9edee238c9","Type":"ContainerStarted","Data":"73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a"}
Sep 07 12:10:29.700002 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:29.699711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:29.701302 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:29.701270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs" event={"ID":"2be94707-bdb2-4cb3-a6e8-da80e467e410","Type":"ContainerStarted","Data":"9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c"}
Sep 07 12:10:29.701453 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:29.701353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:10:29.718124 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:29.718071    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" podStartSLOduration=2.264168484 podStartE2EDuration="2.718050532s" totalImagesPullingTime="453.882048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:29.714993118 +0000 UTC m=+1404.852744427" watchObservedRunningTime="2026-09-07 12:10:29.718050532 +0000 UTC m=+1404.855801844"
Sep 07 12:10:29.732052 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:29.732008    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs" podStartSLOduration=1.731990099 podStartE2EDuration="1.731990099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:29.729971072 +0000 UTC m=+1404.867722380" watchObservedRunningTime="2026-09-07 12:10:29.731990099 +0000 UTC m=+1404.869741409"
Sep 07 12:10:35.714082 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:35.714049    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:10:40.711323 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:10:40.711288    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:12:16.615250 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:16.615214    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"]
Sep 07 12:12:16.615907 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:16.615448    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" podUID="2525cebc-5c18-4db0-ace9-fe9edee238c9" containerName="maas-api" containerID="cri-o://73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a" gracePeriod=30
Sep 07 12:12:16.676075 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:16.675986    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"]
Sep 07 12:12:16.676272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:16.676211    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs" podUID="2be94707-bdb2-4cb3-a6e8-da80e467e410" containerName="payload-processing" containerID="cri-o://9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c" gracePeriod=30
Sep 07 12:12:16.934257 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:16.934227    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:12:16.972226 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:16.972196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:12:17.117499 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117465    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kqp\" (UniqueName: \"kubernetes.io/projected/2525cebc-5c18-4db0-ace9-fe9edee238c9-kube-api-access-c9kqp\") pod \"2525cebc-5c18-4db0-ace9-fe9edee238c9\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") "
Sep 07 12:12:17.117684 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2525cebc-5c18-4db0-ace9-fe9edee238c9-openshift-service-ca\") pod \"2525cebc-5c18-4db0-ace9-fe9edee238c9\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") "
Sep 07 12:12:17.117684 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117629    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plgcl\" (UniqueName: \"kubernetes.io/projected/2be94707-bdb2-4cb3-a6e8-da80e467e410-kube-api-access-plgcl\") pod \"2be94707-bdb2-4cb3-a6e8-da80e467e410\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") "
Sep 07 12:12:17.117803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117683    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-metrics-certs\") pod \"2525cebc-5c18-4db0-ace9-fe9edee238c9\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") "
Sep 07 12:12:17.117803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117723    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls\") pod \"2525cebc-5c18-4db0-ace9-fe9edee238c9\" (UID: \"2525cebc-5c18-4db0-ace9-fe9edee238c9\") "
Sep 07 12:12:17.117803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be94707-bdb2-4cb3-a6e8-da80e467e410-plugins-config-volume\") pod \"2be94707-bdb2-4cb3-a6e8-da80e467e410\" (UID: \"2be94707-bdb2-4cb3-a6e8-da80e467e410\") "
Sep 07 12:12:17.117980 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.117945    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2525cebc-5c18-4db0-ace9-fe9edee238c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2525cebc-5c18-4db0-ace9-fe9edee238c9" (UID: "2525cebc-5c18-4db0-ace9-fe9edee238c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:12:17.118230 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.118209    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2525cebc-5c18-4db0-ace9-fe9edee238c9-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:12:17.118326 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.118225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2be94707-bdb2-4cb3-a6e8-da80e467e410-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2be94707-bdb2-4cb3-a6e8-da80e467e410" (UID: "2be94707-bdb2-4cb3-a6e8-da80e467e410"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:12:17.119716 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.119685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2525cebc-5c18-4db0-ace9-fe9edee238c9-kube-api-access-c9kqp" (OuterVolumeSpecName: "kube-api-access-c9kqp") pod "2525cebc-5c18-4db0-ace9-fe9edee238c9" (UID: "2525cebc-5c18-4db0-ace9-fe9edee238c9"). InnerVolumeSpecName "kube-api-access-c9kqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:12:17.119716 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.119699    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be94707-bdb2-4cb3-a6e8-da80e467e410-kube-api-access-plgcl" (OuterVolumeSpecName: "kube-api-access-plgcl") pod "2be94707-bdb2-4cb3-a6e8-da80e467e410" (UID: "2be94707-bdb2-4cb3-a6e8-da80e467e410"). InnerVolumeSpecName "kube-api-access-plgcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:12:17.120146 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.120128    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2525cebc-5c18-4db0-ace9-fe9edee238c9" (UID: "2525cebc-5c18-4db0-ace9-fe9edee238c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:12:17.120186 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.120141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2525cebc-5c18-4db0-ace9-fe9edee238c9" (UID: "2525cebc-5c18-4db0-ace9-fe9edee238c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:12:17.219171 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.219070    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be94707-bdb2-4cb3-a6e8-da80e467e410-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:12:17.219171 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.219106    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kqp\" (UniqueName: \"kubernetes.io/projected/2525cebc-5c18-4db0-ace9-fe9edee238c9-kube-api-access-c9kqp\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:12:17.219171 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.219119    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plgcl\" (UniqueName: \"kubernetes.io/projected/2be94707-bdb2-4cb3-a6e8-da80e467e410-kube-api-access-plgcl\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:12:17.219171 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.219131    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:12:17.219171 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.219142    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2525cebc-5c18-4db0-ace9-fe9edee238c9-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:12:17.376092 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.376067    2560 generic.go:356] "Generic (PLEG): container finished" podID="2525cebc-5c18-4db0-ace9-fe9edee238c9" containerID="73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a" exitCode=0
Sep 07 12:12:17.376212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.376110    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"
Sep 07 12:12:17.376212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.376137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" event={"ID":"2525cebc-5c18-4db0-ace9-fe9edee238c9","Type":"ContainerDied","Data":"73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a"}
Sep 07 12:12:17.376212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.376176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f" event={"ID":"2525cebc-5c18-4db0-ace9-fe9edee238c9","Type":"ContainerDied","Data":"dbaed483606e8efabfeb31ceecd6962fa7ceb2de5b64612dffc3f2284c62bba4"}
Sep 07 12:12:17.376212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.376197    2560 scope.go:117] "RemoveContainer" containerID="73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a"
Sep 07 12:12:17.377944 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.377906    2560 generic.go:356] "Generic (PLEG): container finished" podID="2be94707-bdb2-4cb3-a6e8-da80e467e410" containerID="9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c" exitCode=0
Sep 07 12:12:17.377944 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.377942    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"
Sep 07 12:12:17.378117 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.378059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs" event={"ID":"2be94707-bdb2-4cb3-a6e8-da80e467e410","Type":"ContainerDied","Data":"9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c"}
Sep 07 12:12:17.378181 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.378123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs" event={"ID":"2be94707-bdb2-4cb3-a6e8-da80e467e410","Type":"ContainerDied","Data":"79601fc2ba789215dd1ea02a40900bed9f9cb5af8e21b7d4844040f09492ea4c"}
Sep 07 12:12:17.386675 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.386650    2560 scope.go:117] "RemoveContainer" containerID="73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a"
Sep 07 12:12:17.386965 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:12:17.386947    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a\": container with ID starting with 73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a not found: ID does not exist" containerID="73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a"
Sep 07 12:12:17.387050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.386976    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a"} err="failed to get container status \"73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a\": rpc error: code = NotFound desc = could not find container \"73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a\": container with ID starting with 73f74658e9338b7faa9feba3c005edc039102c5a49e37ef2d210e5920c799a8a not found: ID does not exist"
Sep 07 12:12:17.387050 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.386999    2560 scope.go:117] "RemoveContainer" containerID="9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c"
Sep 07 12:12:17.395738 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.395716    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"]
Sep 07 12:12:17.400768 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.400745    2560 scope.go:117] "RemoveContainer" containerID="9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c"
Sep 07 12:12:17.401074 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:12:17.401052    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c\": container with ID starting with 9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c not found: ID does not exist" containerID="9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c"
Sep 07 12:12:17.401146 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.401080    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c"} err="failed to get container status \"9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c\": rpc error: code = NotFound desc = could not find container \"9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c\": container with ID starting with 9ecd91821437c47f92a26e07340b0951d54e75d61ee3fa34665e86bbd4ddda9c not found: ID does not exist"
Sep 07 12:12:17.401498 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.401477    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-619f5b7c-7984b5776d-vvp6f"]
Sep 07 12:12:17.409430 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.409407    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"]
Sep 07 12:12:17.411882 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:17.411857    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-619f5b7c-f4cb59497-f68xs"]
Sep 07 12:12:19.361014 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:19.360979    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2525cebc-5c18-4db0-ace9-fe9edee238c9" path="/var/lib/kubelet/pods/2525cebc-5c18-4db0-ace9-fe9edee238c9/volumes"
Sep 07 12:12:19.361410 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:12:19.361359    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be94707-bdb2-4cb3-a6e8-da80e467e410" path="/var/lib/kubelet/pods/2be94707-bdb2-4cb3-a6e8-da80e467e410/volumes"
Sep 07 12:13:29.810542 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.810494    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7497-3e132c"]
Sep 07 12:13:29.811006 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.810959    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2525cebc-5c18-4db0-ace9-fe9edee238c9" containerName="maas-api"
Sep 07 12:13:29.811006 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.810975    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2525cebc-5c18-4db0-ace9-fe9edee238c9" containerName="maas-api"
Sep 07 12:13:29.811006 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.810992    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be94707-bdb2-4cb3-a6e8-da80e467e410" containerName="payload-processing"
Sep 07 12:13:29.811006 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.810999    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be94707-bdb2-4cb3-a6e8-da80e467e410" containerName="payload-processing"
Sep 07 12:13:29.811261 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.811123    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be94707-bdb2-4cb3-a6e8-da80e467e410" containerName="payload-processing"
Sep 07 12:13:29.811261 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.811166    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2525cebc-5c18-4db0-ace9-fe9edee238c9" containerName="maas-api"
Sep 07 12:13:29.814764 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.814740    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:29.817583 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.817563    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c7bf7\""
Sep 07 12:13:29.828527 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.828503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7497-3e132c"]
Sep 07 12:13:29.924627 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:29.924587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdmkc\" (UniqueName: \"kubernetes.io/projected/749a2689-ad16-4c9f-90a9-c70d855ccaf3-kube-api-access-jdmkc\") pod \"mt-curl-7497-3e132c\" (UID: \"749a2689-ad16-4c9f-90a9-c70d855ccaf3\") " pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:30.026002 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:30.025964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdmkc\" (UniqueName: \"kubernetes.io/projected/749a2689-ad16-4c9f-90a9-c70d855ccaf3-kube-api-access-jdmkc\") pod \"mt-curl-7497-3e132c\" (UID: \"749a2689-ad16-4c9f-90a9-c70d855ccaf3\") " pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:30.033552 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:30.033519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdmkc\" (UniqueName: \"kubernetes.io/projected/749a2689-ad16-4c9f-90a9-c70d855ccaf3-kube-api-access-jdmkc\") pod \"mt-curl-7497-3e132c\" (UID: \"749a2689-ad16-4c9f-90a9-c70d855ccaf3\") " pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:30.124578 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:30.124526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:30.411854 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:30.411826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7497-3e132c"]
Sep 07 12:13:30.413568 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:13:30.413542    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod749a2689_ad16_4c9f_90a9_c70d855ccaf3.slice/crio-dd72c166fc73d1eaceb3db68a1343142afd9a4a6a7637af726a88f7f954bd7ca WatchSource:0}: Error finding container dd72c166fc73d1eaceb3db68a1343142afd9a4a6a7637af726a88f7f954bd7ca: Status 404 returned error can't find the container with id dd72c166fc73d1eaceb3db68a1343142afd9a4a6a7637af726a88f7f954bd7ca
Sep 07 12:13:30.836723 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:30.836645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7497-3e132c" event={"ID":"749a2689-ad16-4c9f-90a9-c70d855ccaf3","Type":"ContainerStarted","Data":"dd72c166fc73d1eaceb3db68a1343142afd9a4a6a7637af726a88f7f954bd7ca"}
Sep 07 12:13:31.843950 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:31.843911    2560 generic.go:356] "Generic (PLEG): container finished" podID="749a2689-ad16-4c9f-90a9-c70d855ccaf3" containerID="e6f9ad1132482dd6ecd3a70095cf10554d74507a1c6864f8569b45c8fc33a052" exitCode=0
Sep 07 12:13:31.844326 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:31.843951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7497-3e132c" event={"ID":"749a2689-ad16-4c9f-90a9-c70d855ccaf3","Type":"ContainerDied","Data":"e6f9ad1132482dd6ecd3a70095cf10554d74507a1c6864f8569b45c8fc33a052"}
Sep 07 12:13:32.991142 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:32.991118    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:33.021146 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.021118    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7497-3e132c_749a2689-ad16-4c9f-90a9-c70d855ccaf3/mt-curl-7497-3e132c/0.log"
Sep 07 12:13:33.048041 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.048005    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7497-3e132c"]
Sep 07 12:13:33.052043 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.052017    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7497-3e132c"]
Sep 07 12:13:33.155086 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.155049    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdmkc\" (UniqueName: \"kubernetes.io/projected/749a2689-ad16-4c9f-90a9-c70d855ccaf3-kube-api-access-jdmkc\") pod \"749a2689-ad16-4c9f-90a9-c70d855ccaf3\" (UID: \"749a2689-ad16-4c9f-90a9-c70d855ccaf3\") "
Sep 07 12:13:33.157160 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.157129    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749a2689-ad16-4c9f-90a9-c70d855ccaf3-kube-api-access-jdmkc" (OuterVolumeSpecName: "kube-api-access-jdmkc") pod "749a2689-ad16-4c9f-90a9-c70d855ccaf3" (UID: "749a2689-ad16-4c9f-90a9-c70d855ccaf3"). InnerVolumeSpecName "kube-api-access-jdmkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:13:33.256358 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.256299    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdmkc\" (UniqueName: \"kubernetes.io/projected/749a2689-ad16-4c9f-90a9-c70d855ccaf3-kube-api-access-jdmkc\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:13:33.359745 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.359707    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="749a2689-ad16-4c9f-90a9-c70d855ccaf3" path="/var/lib/kubelet/pods/749a2689-ad16-4c9f-90a9-c70d855ccaf3/volumes"
Sep 07 12:13:33.857643 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.857608    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-3e132c"
Sep 07 12:13:33.857834 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:13:33.857659    2560 scope.go:117] "RemoveContainer" containerID="e6f9ad1132482dd6ecd3a70095cf10554d74507a1c6864f8569b45c8fc33a052"
Sep 07 12:14:12.439873 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.439828    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"]
Sep 07 12:14:12.440839 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.440813    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749a2689-ad16-4c9f-90a9-c70d855ccaf3" containerName="mt-curl-7497-3e132c"
Sep 07 12:14:12.440839 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.440840    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="749a2689-ad16-4c9f-90a9-c70d855ccaf3" containerName="mt-curl-7497-3e132c"
Sep 07 12:14:12.441023 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.440971    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="749a2689-ad16-4c9f-90a9-c70d855ccaf3" containerName="mt-curl-7497-3e132c"
Sep 07 12:14:12.444711 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.444686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.447202 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.447167    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f7f063-serving-cert\""
Sep 07 12:14:12.454772 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.454530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"]
Sep 07 12:14:12.628716 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.628677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db7655fa-8195-4136-8372-b6666716771c-openshift-service-ca\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.628896 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.628758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-metrics-certs\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.628896 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.628795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-maas-api-tls\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.628896 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.628818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srplt\" (UniqueName: \"kubernetes.io/projected/db7655fa-8195-4136-8372-b6666716771c-kube-api-access-srplt\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.730035 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.729942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-metrics-certs\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.730035 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.729988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-maas-api-tls\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.730035 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.730013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srplt\" (UniqueName: \"kubernetes.io/projected/db7655fa-8195-4136-8372-b6666716771c-kube-api-access-srplt\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.730329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.730077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db7655fa-8195-4136-8372-b6666716771c-openshift-service-ca\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.730720 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.730700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db7655fa-8195-4136-8372-b6666716771c-openshift-service-ca\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.732523 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.732493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-maas-api-tls\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.732622 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.732549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-metrics-certs\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.738085 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.738062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srplt\" (UniqueName: \"kubernetes.io/projected/db7655fa-8195-4136-8372-b6666716771c-kube-api-access-srplt\") pod \"maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:12.760511 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:12.760481    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:13.036779 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:13.036749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"]
Sep 07 12:14:13.038419 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:14:13.038390    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7655fa_8195_4136_8372_b6666716771c.slice/crio-82c440be71d72d46b8501c0d9f6673311a600ff35560b4a027930cd197490449 WatchSource:0}: Error finding container 82c440be71d72d46b8501c0d9f6673311a600ff35560b4a027930cd197490449: Status 404 returned error can't find the container with id 82c440be71d72d46b8501c0d9f6673311a600ff35560b4a027930cd197490449
Sep 07 12:14:13.110954 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:13.110914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk" event={"ID":"db7655fa-8195-4136-8372-b6666716771c","Type":"ContainerStarted","Data":"82c440be71d72d46b8501c0d9f6673311a600ff35560b4a027930cd197490449"}
Sep 07 12:14:14.119142 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:14.119109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk" event={"ID":"db7655fa-8195-4136-8372-b6666716771c","Type":"ContainerStarted","Data":"3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca"}
Sep 07 12:14:14.119599 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:14.119318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:14.138922 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:14.138871    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk" podStartSLOduration=1.632875847 podStartE2EDuration="2.138855868s" totalImagesPullingTime="505.980021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:14:14.13508567 +0000 UTC m=+1629.272836980" watchObservedRunningTime="2026-09-07 12:14:14.138855868 +0000 UTC m=+1629.276607178"
Sep 07 12:14:20.130973 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:20.130934    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:14:41.604697 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.604662    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"]
Sep 07 12:14:41.609271 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.609247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.611755 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.611731    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9e422b-serving-cert\""
Sep 07 12:14:41.617759 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.617735    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"]
Sep 07 12:14:41.703394 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.703358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-metrics-certs\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.703588 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.703472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bbwd\" (UniqueName: \"kubernetes.io/projected/efabc653-8a3a-47ad-8730-9245d6d858d0-kube-api-access-4bbwd\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.703588 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.703562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.703588 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.703586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efabc653-8a3a-47ad-8730-9245d6d858d0-openshift-service-ca\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.804769 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.804729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbwd\" (UniqueName: \"kubernetes.io/projected/efabc653-8a3a-47ad-8730-9245d6d858d0-kube-api-access-4bbwd\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.804967 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.804787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.804967 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.804806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efabc653-8a3a-47ad-8730-9245d6d858d0-openshift-service-ca\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.804967 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.804850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-metrics-certs\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.804967 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:14:41.804950    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-serving-cert: secret "maas-api-e2e-api-b-9e422b-serving-cert" not found
Sep 07 12:14:41.805205 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:14:41.805049    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls podName:efabc653-8a3a-47ad-8730-9245d6d858d0 nodeName:}" failed. No retries permitted until 2026-09-07 12:14:42.305025175 +0000 UTC m=+1657.442776481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls") pod "maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" (UID: "efabc653-8a3a-47ad-8730-9245d6d858d0") : secret "maas-api-e2e-api-b-9e422b-serving-cert" not found
Sep 07 12:14:41.805609 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.805588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efabc653-8a3a-47ad-8730-9245d6d858d0-openshift-service-ca\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.807557 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.807535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-metrics-certs\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:41.811915 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:41.811889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbwd\" (UniqueName: \"kubernetes.io/projected/efabc653-8a3a-47ad-8730-9245d6d858d0-kube-api-access-4bbwd\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:42.312640 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.312602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:42.315192 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.315152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls\") pod \"maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:42.351237 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.351194    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"]
Sep 07 12:14:42.355469 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.355425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.358525 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.358499    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9e422b\""
Sep 07 12:14:42.358661 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.358548    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9e422b-dockercfg-459v6\""
Sep 07 12:14:42.364460 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.364429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"]
Sep 07 12:14:42.514619 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.514578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.514805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.514635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sck49\" (UniqueName: \"kubernetes.io/projected/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-kube-api-access-sck49\") pod \"payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.524452 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.524423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:42.616029 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.615994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.616476 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.616047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sck49\" (UniqueName: \"kubernetes.io/projected/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-kube-api-access-sck49\") pod \"payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.616751 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.616729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.624273 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.624243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sck49\" (UniqueName: \"kubernetes.io/projected/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-kube-api-access-sck49\") pod \"payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.670100 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.670060    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:42.800390 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.800357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"]
Sep 07 12:14:42.801110 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:14:42.801081    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefabc653_8a3a_47ad_8730_9245d6d858d0.slice/crio-b8ec8a1e5ba13b6e3ac5a956e9ef3f0daa9b12764915c52fab6b3ee1148f5c1f WatchSource:0}: Error finding container b8ec8a1e5ba13b6e3ac5a956e9ef3f0daa9b12764915c52fab6b3ee1148f5c1f: Status 404 returned error can't find the container with id b8ec8a1e5ba13b6e3ac5a956e9ef3f0daa9b12764915c52fab6b3ee1148f5c1f
Sep 07 12:14:42.802477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.802456    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:14:42.947635 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:42.945367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"]
Sep 07 12:14:42.947635 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:14:42.946619    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c03d75a_31cb_40bf_bf7f_8780a7ae8d2e.slice/crio-8470b76ce69bcf697458d475d7214136d8ecf4ba11c8fbb25e447fc0f7ee7090 WatchSource:0}: Error finding container 8470b76ce69bcf697458d475d7214136d8ecf4ba11c8fbb25e447fc0f7ee7090: Status 404 returned error can't find the container with id 8470b76ce69bcf697458d475d7214136d8ecf4ba11c8fbb25e447fc0f7ee7090
Sep 07 12:14:43.316850 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.316806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz" event={"ID":"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e","Type":"ContainerStarted","Data":"ae124b9b9e48302420fbbea1357c5e0e6c037ef9687f10f7e776b15f40d25a61"}
Sep 07 12:14:43.317042 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.316877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:43.317042 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.316905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz" event={"ID":"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e","Type":"ContainerStarted","Data":"8470b76ce69bcf697458d475d7214136d8ecf4ba11c8fbb25e447fc0f7ee7090"}
Sep 07 12:14:43.318601 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.318576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" event={"ID":"efabc653-8a3a-47ad-8730-9245d6d858d0","Type":"ContainerStarted","Data":"ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9"}
Sep 07 12:14:43.318733 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.318621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" event={"ID":"efabc653-8a3a-47ad-8730-9245d6d858d0","Type":"ContainerStarted","Data":"b8ec8a1e5ba13b6e3ac5a956e9ef3f0daa9b12764915c52fab6b3ee1148f5c1f"}
Sep 07 12:14:43.318733 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.318664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:43.333713 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.333664    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz" podStartSLOduration=1.333648532 podStartE2EDuration="1.333648532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:14:43.331751574 +0000 UTC m=+1658.469502886" watchObservedRunningTime="2026-09-07 12:14:43.333648532 +0000 UTC m=+1658.471399842"
Sep 07 12:14:43.350126 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:43.350061    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" podStartSLOduration=1.941009577 podStartE2EDuration="2.350040912s" totalImagesPullingTime="409.031335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:14:43.348486901 +0000 UTC m=+1658.486238242" watchObservedRunningTime="2026-09-07 12:14:43.350040912 +0000 UTC m=+1658.487792237"
Sep 07 12:14:49.330227 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:49.330191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:14:54.327764 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:54.327721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:14:57.853373 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.853323    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7497-17782a"]
Sep 07 12:14:57.858553 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.858523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:14:57.861123 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.861096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-c7bf7\""
Sep 07 12:14:57.862768 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.862744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7497-17782a"]
Sep 07 12:14:57.868623 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.868598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kshl2\" (UniqueName: \"kubernetes.io/projected/81cbedd7-1186-46a1-b89e-49bb5d71f578-kube-api-access-kshl2\") pod \"mt-curl-7497-17782a\" (UID: \"81cbedd7-1186-46a1-b89e-49bb5d71f578\") " pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:14:57.969678 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.969641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kshl2\" (UniqueName: \"kubernetes.io/projected/81cbedd7-1186-46a1-b89e-49bb5d71f578-kube-api-access-kshl2\") pod \"mt-curl-7497-17782a\" (UID: \"81cbedd7-1186-46a1-b89e-49bb5d71f578\") " pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:14:57.977602 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:57.977572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kshl2\" (UniqueName: \"kubernetes.io/projected/81cbedd7-1186-46a1-b89e-49bb5d71f578-kube-api-access-kshl2\") pod \"mt-curl-7497-17782a\" (UID: \"81cbedd7-1186-46a1-b89e-49bb5d71f578\") " pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:14:58.170500 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:58.170409    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:14:58.441818 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:58.441788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7497-17782a"]
Sep 07 12:14:58.442881 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:14:58.442857    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81cbedd7_1186_46a1_b89e_49bb5d71f578.slice/crio-48453a4ff9bc294efde29efdb93ddd8ebb1bbd60aa6c9a1cb94c0046b7426389 WatchSource:0}: Error finding container 48453a4ff9bc294efde29efdb93ddd8ebb1bbd60aa6c9a1cb94c0046b7426389: Status 404 returned error can't find the container with id 48453a4ff9bc294efde29efdb93ddd8ebb1bbd60aa6c9a1cb94c0046b7426389
Sep 07 12:14:59.423700 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:59.423665    2560 generic.go:356] "Generic (PLEG): container finished" podID="81cbedd7-1186-46a1-b89e-49bb5d71f578" containerID="29b261c7f1276d4047d63e4109d8cef320768e4e675c9de94fedab948e72978a" exitCode=0
Sep 07 12:14:59.424100 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:59.423753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7497-17782a" event={"ID":"81cbedd7-1186-46a1-b89e-49bb5d71f578","Type":"ContainerDied","Data":"29b261c7f1276d4047d63e4109d8cef320768e4e675c9de94fedab948e72978a"}
Sep 07 12:14:59.424100 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:14:59.423801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7497-17782a" event={"ID":"81cbedd7-1186-46a1-b89e-49bb5d71f578","Type":"ContainerStarted","Data":"48453a4ff9bc294efde29efdb93ddd8ebb1bbd60aa6c9a1cb94c0046b7426389"}
Sep 07 12:15:00.571771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.571746    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:15:00.589299 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.589269    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7497-17782a_81cbedd7-1186-46a1-b89e-49bb5d71f578/mt-curl-7497-17782a/0.log"
Sep 07 12:15:00.596568 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.596540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kshl2\" (UniqueName: \"kubernetes.io/projected/81cbedd7-1186-46a1-b89e-49bb5d71f578-kube-api-access-kshl2\") pod \"81cbedd7-1186-46a1-b89e-49bb5d71f578\" (UID: \"81cbedd7-1186-46a1-b89e-49bb5d71f578\") "
Sep 07 12:15:00.598647 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.598618    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81cbedd7-1186-46a1-b89e-49bb5d71f578-kube-api-access-kshl2" (OuterVolumeSpecName: "kube-api-access-kshl2") pod "81cbedd7-1186-46a1-b89e-49bb5d71f578" (UID: "81cbedd7-1186-46a1-b89e-49bb5d71f578"). InnerVolumeSpecName "kube-api-access-kshl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:15:00.613196 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.613166    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7497-17782a"]
Sep 07 12:15:00.624412 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.617303    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7497-17782a"]
Sep 07 12:15:00.697790 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.697699    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kshl2\" (UniqueName: \"kubernetes.io/projected/81cbedd7-1186-46a1-b89e-49bb5d71f578-kube-api-access-kshl2\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:00.734322 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.734286    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7497-56e0a4"]
Sep 07 12:15:00.734815 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.734799    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cbedd7-1186-46a1-b89e-49bb5d71f578" containerName="mt-curl-7497-17782a"
Sep 07 12:15:00.734871 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.734817    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cbedd7-1186-46a1-b89e-49bb5d71f578" containerName="mt-curl-7497-17782a"
Sep 07 12:15:00.734913 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.734903    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="81cbedd7-1186-46a1-b89e-49bb5d71f578" containerName="mt-curl-7497-17782a"
Sep 07 12:15:00.738123 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.738098    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:00.740699 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.740670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7497-56e0a4"]
Sep 07 12:15:00.799011 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.798976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7f9\" (UniqueName: \"kubernetes.io/projected/ff996340-6cd3-4b17-a969-d00f5c28ef24-kube-api-access-2r7f9\") pod \"mt-curl-7497-56e0a4\" (UID: \"ff996340-6cd3-4b17-a969-d00f5c28ef24\") " pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:00.900646 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.900606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7f9\" (UniqueName: \"kubernetes.io/projected/ff996340-6cd3-4b17-a969-d00f5c28ef24-kube-api-access-2r7f9\") pod \"mt-curl-7497-56e0a4\" (UID: \"ff996340-6cd3-4b17-a969-d00f5c28ef24\") " pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:00.908060 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:00.908029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7f9\" (UniqueName: \"kubernetes.io/projected/ff996340-6cd3-4b17-a969-d00f5c28ef24-kube-api-access-2r7f9\") pod \"mt-curl-7497-56e0a4\" (UID: \"ff996340-6cd3-4b17-a969-d00f5c28ef24\") " pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:01.051060 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:01.050963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:01.320982 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:01.320950    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7497-56e0a4"]
Sep 07 12:15:01.322076 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:15:01.322049    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff996340_6cd3_4b17_a969_d00f5c28ef24.slice/crio-201d370266eb102f8310db60ae847a9f5726eee9338de7f7dc12fa346e61b587 WatchSource:0}: Error finding container 201d370266eb102f8310db60ae847a9f5726eee9338de7f7dc12fa346e61b587: Status 404 returned error can't find the container with id 201d370266eb102f8310db60ae847a9f5726eee9338de7f7dc12fa346e61b587
Sep 07 12:15:01.361182 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:01.361149    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81cbedd7-1186-46a1-b89e-49bb5d71f578" path="/var/lib/kubelet/pods/81cbedd7-1186-46a1-b89e-49bb5d71f578/volumes"
Sep 07 12:15:01.437033 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:01.436998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7497-56e0a4" event={"ID":"ff996340-6cd3-4b17-a969-d00f5c28ef24","Type":"ContainerStarted","Data":"201d370266eb102f8310db60ae847a9f5726eee9338de7f7dc12fa346e61b587"}
Sep 07 12:15:01.438405 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:01.438381    2560 scope.go:117] "RemoveContainer" containerID="29b261c7f1276d4047d63e4109d8cef320768e4e675c9de94fedab948e72978a"
Sep 07 12:15:01.438537 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:01.438416    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-17782a"
Sep 07 12:15:02.447749 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:02.447703    2560 generic.go:356] "Generic (PLEG): container finished" podID="ff996340-6cd3-4b17-a969-d00f5c28ef24" containerID="da0695ec1e91c8ca28880297c9f723b220d046372137477619fc4025785f0d97" exitCode=0
Sep 07 12:15:02.448163 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:02.447766    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7497-56e0a4" event={"ID":"ff996340-6cd3-4b17-a969-d00f5c28ef24","Type":"ContainerDied","Data":"da0695ec1e91c8ca28880297c9f723b220d046372137477619fc4025785f0d97"}
Sep 07 12:15:03.606810 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.606781    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:03.626121 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.626094    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7497-56e0a4_ff996340-6cd3-4b17-a969-d00f5c28ef24/mt-curl-7497-56e0a4/0.log"
Sep 07 12:15:03.627273 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.627238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r7f9\" (UniqueName: \"kubernetes.io/projected/ff996340-6cd3-4b17-a969-d00f5c28ef24-kube-api-access-2r7f9\") pod \"ff996340-6cd3-4b17-a969-d00f5c28ef24\" (UID: \"ff996340-6cd3-4b17-a969-d00f5c28ef24\") "
Sep 07 12:15:03.629612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.629588    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff996340-6cd3-4b17-a969-d00f5c28ef24-kube-api-access-2r7f9" (OuterVolumeSpecName: "kube-api-access-2r7f9") pod "ff996340-6cd3-4b17-a969-d00f5c28ef24" (UID: "ff996340-6cd3-4b17-a969-d00f5c28ef24"). InnerVolumeSpecName "kube-api-access-2r7f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:15:03.652587 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.652553    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7497-56e0a4"]
Sep 07 12:15:03.657217 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.657184    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7497-56e0a4"]
Sep 07 12:15:03.729394 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:03.729291    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r7f9\" (UniqueName: \"kubernetes.io/projected/ff996340-6cd3-4b17-a969-d00f5c28ef24-kube-api-access-2r7f9\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:04.465788 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:04.465750    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="201d370266eb102f8310db60ae847a9f5726eee9338de7f7dc12fa346e61b587"
Sep 07 12:15:04.465788 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:04.465760    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:04.481469 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:15:04.481416    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7497-56e0a4\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="ff996340-6cd3-4b17-a969-d00f5c28ef24" pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:05.359211 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:15:05.359174    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7497-56e0a4\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" podUID="ff996340-6cd3-4b17-a969-d00f5c28ef24" pod="opendatahub/mt-curl-7497-56e0a4"
Sep 07 12:15:05.361206 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:05.361179    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff996340-6cd3-4b17-a969-d00f5c28ef24" path="/var/lib/kubelet/pods/ff996340-6cd3-4b17-a969-d00f5c28ef24/volumes"
Sep 07 12:15:23.682272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:23.682229    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"]
Sep 07 12:15:23.682842 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:23.682527    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk" podUID="db7655fa-8195-4136-8372-b6666716771c" containerName="maas-api" containerID="cri-o://3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca" gracePeriod=30
Sep 07 12:15:23.933935 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:23.933873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:15:24.024528 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.024499    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-metrics-certs\") pod \"db7655fa-8195-4136-8372-b6666716771c\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") "
Sep 07 12:15:24.024730 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.024572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-maas-api-tls\") pod \"db7655fa-8195-4136-8372-b6666716771c\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") "
Sep 07 12:15:24.024730 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.024624    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srplt\" (UniqueName: \"kubernetes.io/projected/db7655fa-8195-4136-8372-b6666716771c-kube-api-access-srplt\") pod \"db7655fa-8195-4136-8372-b6666716771c\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") "
Sep 07 12:15:24.024730 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.024661    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db7655fa-8195-4136-8372-b6666716771c-openshift-service-ca\") pod \"db7655fa-8195-4136-8372-b6666716771c\" (UID: \"db7655fa-8195-4136-8372-b6666716771c\") "
Sep 07 12:15:24.025062 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.025034    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7655fa-8195-4136-8372-b6666716771c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db7655fa-8195-4136-8372-b6666716771c" (UID: "db7655fa-8195-4136-8372-b6666716771c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:15:24.026814 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.026790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7655fa-8195-4136-8372-b6666716771c-kube-api-access-srplt" (OuterVolumeSpecName: "kube-api-access-srplt") pod "db7655fa-8195-4136-8372-b6666716771c" (UID: "db7655fa-8195-4136-8372-b6666716771c"). InnerVolumeSpecName "kube-api-access-srplt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:15:24.026814 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.026795    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db7655fa-8195-4136-8372-b6666716771c" (UID: "db7655fa-8195-4136-8372-b6666716771c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:15:24.026935 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.026863    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "db7655fa-8195-4136-8372-b6666716771c" (UID: "db7655fa-8195-4136-8372-b6666716771c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:15:24.126314 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.126279    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:24.126314 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.126308    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db7655fa-8195-4136-8372-b6666716771c-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:24.126314 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.126318    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srplt\" (UniqueName: \"kubernetes.io/projected/db7655fa-8195-4136-8372-b6666716771c-kube-api-access-srplt\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:24.126574 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.126327    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db7655fa-8195-4136-8372-b6666716771c-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:24.605674 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.605636    2560 generic.go:356] "Generic (PLEG): container finished" podID="db7655fa-8195-4136-8372-b6666716771c" containerID="3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca" exitCode=0
Sep 07 12:15:24.605867 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.605691    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"
Sep 07 12:15:24.605867 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.605729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk" event={"ID":"db7655fa-8195-4136-8372-b6666716771c","Type":"ContainerDied","Data":"3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca"}
Sep 07 12:15:24.605867 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.605793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk" event={"ID":"db7655fa-8195-4136-8372-b6666716771c","Type":"ContainerDied","Data":"82c440be71d72d46b8501c0d9f6673311a600ff35560b4a027930cd197490449"}
Sep 07 12:15:24.605867 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.605823    2560 scope.go:117] "RemoveContainer" containerID="3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca"
Sep 07 12:15:24.616176 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.616161    2560 scope.go:117] "RemoveContainer" containerID="3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca"
Sep 07 12:15:24.616545 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:15:24.616486    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca\": container with ID starting with 3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca not found: ID does not exist" containerID="3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca"
Sep 07 12:15:24.616545 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.616512    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca"} err="failed to get container status \"3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca\": rpc error: code = NotFound desc = could not find container \"3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca\": container with ID starting with 3c9b69b93a3ba108ce32baee5e30ffda062a57f94e7fc65290d23cae2003faca not found: ID does not exist"
Sep 07 12:15:24.628600 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.628578    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"]
Sep 07 12:15:24.635398 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:24.635376    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f7f063-76f76dfc54-fz5xk"]
Sep 07 12:15:25.362188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:25.362150    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db7655fa-8195-4136-8372-b6666716771c" path="/var/lib/kubelet/pods/db7655fa-8195-4136-8372-b6666716771c/volumes"
Sep 07 12:15:46.415626 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.415592    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"]
Sep 07 12:15:46.416067 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.415787    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" podUID="efabc653-8a3a-47ad-8730-9245d6d858d0" containerName="maas-api" containerID="cri-o://ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9" gracePeriod=30
Sep 07 12:15:46.467908 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.467876    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"]
Sep 07 12:15:46.468119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.468084    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz" podUID="4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" containerName="payload-processing" containerID="cri-o://ae124b9b9e48302420fbbea1357c5e0e6c037ef9687f10f7e776b15f40d25a61" gracePeriod=30
Sep 07 12:15:46.737683 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.737657    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:15:46.758505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.758469    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" containerID="ae124b9b9e48302420fbbea1357c5e0e6c037ef9687f10f7e776b15f40d25a61" exitCode=0
Sep 07 12:15:46.758658 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.758524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz" event={"ID":"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e","Type":"ContainerDied","Data":"ae124b9b9e48302420fbbea1357c5e0e6c037ef9687f10f7e776b15f40d25a61"}
Sep 07 12:15:46.758658 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.758578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz" event={"ID":"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e","Type":"ContainerDied","Data":"8470b76ce69bcf697458d475d7214136d8ecf4ba11c8fbb25e447fc0f7ee7090"}
Sep 07 12:15:46.758658 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.758599    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8470b76ce69bcf697458d475d7214136d8ecf4ba11c8fbb25e447fc0f7ee7090"
Sep 07 12:15:46.760767 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.760737    2560 generic.go:356] "Generic (PLEG): container finished" podID="efabc653-8a3a-47ad-8730-9245d6d858d0" containerID="ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9" exitCode=0
Sep 07 12:15:46.760906 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.760787    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"
Sep 07 12:15:46.760906 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.760806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" event={"ID":"efabc653-8a3a-47ad-8730-9245d6d858d0","Type":"ContainerDied","Data":"ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9"}
Sep 07 12:15:46.760906 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.760855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw" event={"ID":"efabc653-8a3a-47ad-8730-9245d6d858d0","Type":"ContainerDied","Data":"b8ec8a1e5ba13b6e3ac5a956e9ef3f0daa9b12764915c52fab6b3ee1148f5c1f"}
Sep 07 12:15:46.760906 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.760877    2560 scope.go:117] "RemoveContainer" containerID="ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9"
Sep 07 12:15:46.764863 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.764836    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:15:46.771894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.771866    2560 scope.go:117] "RemoveContainer" containerID="ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9"
Sep 07 12:15:46.772222 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:15:46.772203    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9\": container with ID starting with ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9 not found: ID does not exist" containerID="ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9"
Sep 07 12:15:46.772311 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.772230    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9"} err="failed to get container status \"ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9\": rpc error: code = NotFound desc = could not find container \"ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9\": container with ID starting with ee7a0b121e5555455e9b96486a965dca13d116ec96387ddc775811023b4bd4a9 not found: ID does not exist"
Sep 07 12:15:46.836533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-plugins-config-volume\") pod \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") "
Sep 07 12:15:46.836777 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836552    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-metrics-certs\") pod \"efabc653-8a3a-47ad-8730-9245d6d858d0\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") "
Sep 07 12:15:46.836777 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836595    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sck49\" (UniqueName: \"kubernetes.io/projected/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-kube-api-access-sck49\") pod \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\" (UID: \"4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e\") "
Sep 07 12:15:46.836777 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836626    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efabc653-8a3a-47ad-8730-9245d6d858d0-openshift-service-ca\") pod \"efabc653-8a3a-47ad-8730-9245d6d858d0\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") "
Sep 07 12:15:46.836777 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bbwd\" (UniqueName: \"kubernetes.io/projected/efabc653-8a3a-47ad-8730-9245d6d858d0-kube-api-access-4bbwd\") pod \"efabc653-8a3a-47ad-8730-9245d6d858d0\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") "
Sep 07 12:15:46.836777 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836701    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls\") pod \"efabc653-8a3a-47ad-8730-9245d6d858d0\" (UID: \"efabc653-8a3a-47ad-8730-9245d6d858d0\") "
Sep 07 12:15:46.837072 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.836962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" (UID: "4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:15:46.837072 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.837037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efabc653-8a3a-47ad-8730-9245d6d858d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efabc653-8a3a-47ad-8730-9245d6d858d0" (UID: "efabc653-8a3a-47ad-8730-9245d6d858d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:15:46.837174 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.837080    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:46.838832 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.838807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-kube-api-access-sck49" (OuterVolumeSpecName: "kube-api-access-sck49") pod "4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" (UID: "4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e"). InnerVolumeSpecName "kube-api-access-sck49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:15:46.838926 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.838815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efabc653-8a3a-47ad-8730-9245d6d858d0-kube-api-access-4bbwd" (OuterVolumeSpecName: "kube-api-access-4bbwd") pod "efabc653-8a3a-47ad-8730-9245d6d858d0" (UID: "efabc653-8a3a-47ad-8730-9245d6d858d0"). InnerVolumeSpecName "kube-api-access-4bbwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:15:46.839220 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.839193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efabc653-8a3a-47ad-8730-9245d6d858d0" (UID: "efabc653-8a3a-47ad-8730-9245d6d858d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:15:46.839265 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.839205    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "efabc653-8a3a-47ad-8730-9245d6d858d0" (UID: "efabc653-8a3a-47ad-8730-9245d6d858d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:15:46.937612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.937527    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sck49\" (UniqueName: \"kubernetes.io/projected/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e-kube-api-access-sck49\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:46.937612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.937557    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efabc653-8a3a-47ad-8730-9245d6d858d0-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:46.937612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.937566    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bbwd\" (UniqueName: \"kubernetes.io/projected/efabc653-8a3a-47ad-8730-9245d6d858d0-kube-api-access-4bbwd\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:46.937612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.937576    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:46.937612 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:46.937584    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efabc653-8a3a-47ad-8730-9245d6d858d0-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:15:47.086220 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:47.086186    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"]
Sep 07 12:15:47.089972 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:47.089947    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9e422b-5c489cb449-sg5pw"]
Sep 07 12:15:47.360320 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:47.360282    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efabc653-8a3a-47ad-8730-9245d6d858d0" path="/var/lib/kubelet/pods/efabc653-8a3a-47ad-8730-9245d6d858d0/volumes"
Sep 07 12:15:47.768305 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:47.768213    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"
Sep 07 12:15:47.785173 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:47.785140    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"]
Sep 07 12:15:47.789176 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:47.789150    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9e422b-67697c46f7-4z8mz"]
Sep 07 12:15:49.360570 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:15:49.360529    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" path="/var/lib/kubelet/pods/4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e/volumes"
Sep 07 12:16:03.938021 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:03.937982    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"]
Sep 07 12:16:03.938652 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:03.938228    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l" podUID="e8d45c65-c6dc-4051-8559-acf9255b8005" containerName="payload-processing" containerID="cri-o://2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257" gracePeriod=30
Sep 07 12:16:03.949002 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:03.948971    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"]
Sep 07 12:16:03.949250 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:03.949220    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx" podUID="a37625e3-de14-460f-b5f3-d885708c5825" containerName="payload-pre-processing" containerID="cri-o://0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed" gracePeriod=30
Sep 07 12:16:04.236213 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.236181    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:16:04.239165 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.239141    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:16:04.300899 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.300860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8d45c65-c6dc-4051-8559-acf9255b8005-plugins-config-volume\") pod \"e8d45c65-c6dc-4051-8559-acf9255b8005\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") "
Sep 07 12:16:04.301097 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a37625e3-de14-460f-b5f3-d885708c5825-plugins-config-volume\") pod \"a37625e3-de14-460f-b5f3-d885708c5825\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") "
Sep 07 12:16:04.301097 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301064    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pskr\" (UniqueName: \"kubernetes.io/projected/e8d45c65-c6dc-4051-8559-acf9255b8005-kube-api-access-4pskr\") pod \"e8d45c65-c6dc-4051-8559-acf9255b8005\" (UID: \"e8d45c65-c6dc-4051-8559-acf9255b8005\") "
Sep 07 12:16:04.301212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301094    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-595fk\" (UniqueName: \"kubernetes.io/projected/a37625e3-de14-460f-b5f3-d885708c5825-kube-api-access-595fk\") pod \"a37625e3-de14-460f-b5f3-d885708c5825\" (UID: \"a37625e3-de14-460f-b5f3-d885708c5825\") "
Sep 07 12:16:04.301263 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d45c65-c6dc-4051-8559-acf9255b8005-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8d45c65-c6dc-4051-8559-acf9255b8005" (UID: "e8d45c65-c6dc-4051-8559-acf9255b8005"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:16:04.301518 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301476    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a37625e3-de14-460f-b5f3-d885708c5825-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a37625e3-de14-460f-b5f3-d885708c5825" (UID: "a37625e3-de14-460f-b5f3-d885708c5825"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:16:04.301643 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301578    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a37625e3-de14-460f-b5f3-d885708c5825-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:04.301643 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.301597    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8d45c65-c6dc-4051-8559-acf9255b8005-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:04.303181 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.303160    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37625e3-de14-460f-b5f3-d885708c5825-kube-api-access-595fk" (OuterVolumeSpecName: "kube-api-access-595fk") pod "a37625e3-de14-460f-b5f3-d885708c5825" (UID: "a37625e3-de14-460f-b5f3-d885708c5825"). InnerVolumeSpecName "kube-api-access-595fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:16:04.303308 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.303286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d45c65-c6dc-4051-8559-acf9255b8005-kube-api-access-4pskr" (OuterVolumeSpecName: "kube-api-access-4pskr") pod "e8d45c65-c6dc-4051-8559-acf9255b8005" (UID: "e8d45c65-c6dc-4051-8559-acf9255b8005"). InnerVolumeSpecName "kube-api-access-4pskr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:16:04.402497 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.402461    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pskr\" (UniqueName: \"kubernetes.io/projected/e8d45c65-c6dc-4051-8559-acf9255b8005-kube-api-access-4pskr\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:04.402497 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.402494    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-595fk\" (UniqueName: \"kubernetes.io/projected/a37625e3-de14-460f-b5f3-d885708c5825-kube-api-access-595fk\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:04.876901 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.876862    2560 generic.go:356] "Generic (PLEG): container finished" podID="a37625e3-de14-460f-b5f3-d885708c5825" containerID="0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed" exitCode=0
Sep 07 12:16:04.877119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.876904    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"
Sep 07 12:16:04.877119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.876949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx" event={"ID":"a37625e3-de14-460f-b5f3-d885708c5825","Type":"ContainerDied","Data":"0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed"}
Sep 07 12:16:04.877119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.877008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx" event={"ID":"a37625e3-de14-460f-b5f3-d885708c5825","Type":"ContainerDied","Data":"763be9d105550aaf7f9d1e4d57d1c8f0d36279179426f33d4e658e7f1bfd1340"}
Sep 07 12:16:04.877119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.877037    2560 scope.go:117] "RemoveContainer" containerID="0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed"
Sep 07 12:16:04.878518 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.878454    2560 generic.go:356] "Generic (PLEG): container finished" podID="e8d45c65-c6dc-4051-8559-acf9255b8005" containerID="2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257" exitCode=0
Sep 07 12:16:04.878518 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.878492    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"
Sep 07 12:16:04.878681 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.878586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l" event={"ID":"e8d45c65-c6dc-4051-8559-acf9255b8005","Type":"ContainerDied","Data":"2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257"}
Sep 07 12:16:04.878681 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.878630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l" event={"ID":"e8d45c65-c6dc-4051-8559-acf9255b8005","Type":"ContainerDied","Data":"f7efbc52f043483b3aa2ead3a14fee925d481e812c9739aad923ea85af4be7f0"}
Sep 07 12:16:04.887116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.887090    2560 scope.go:117] "RemoveContainer" containerID="0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed"
Sep 07 12:16:04.887514 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:16:04.887496    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed\": container with ID starting with 0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed not found: ID does not exist" containerID="0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed"
Sep 07 12:16:04.887598 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.887522    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed"} err="failed to get container status \"0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed\": rpc error: code = NotFound desc = could not find container \"0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed\": container with ID starting with 0ad363f1c72fc05caf62024ec0917e70f30bb55b9278f81442b60385d09166ed not found: ID does not exist"
Sep 07 12:16:04.887598 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.887538    2560 scope.go:117] "RemoveContainer" containerID="2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257"
Sep 07 12:16:04.896790 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.896773    2560 scope.go:117] "RemoveContainer" containerID="2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257"
Sep 07 12:16:04.897062 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:16:04.897043    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257\": container with ID starting with 2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257 not found: ID does not exist" containerID="2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257"
Sep 07 12:16:04.897131 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.897071    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257"} err="failed to get container status \"2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257\": rpc error: code = NotFound desc = could not find container \"2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257\": container with ID starting with 2ae5d7cdc91174ff14ace79375025624197e85b0da900859e414390819fde257 not found: ID does not exist"
Sep 07 12:16:04.903172 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.903149    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"]
Sep 07 12:16:04.906696 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.906676    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3a0bb2-648697d578-rcmrx"]
Sep 07 12:16:04.916438 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.916417    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"]
Sep 07 12:16:04.919923 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:04.919901    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3a0bb2-7975497dd5-gl69l"]
Sep 07 12:16:05.364582 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:05.364548    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a37625e3-de14-460f-b5f3-d885708c5825" path="/var/lib/kubelet/pods/a37625e3-de14-460f-b5f3-d885708c5825/volumes"
Sep 07 12:16:05.364963 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:05.364902    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8d45c65-c6dc-4051-8559-acf9255b8005" path="/var/lib/kubelet/pods/e8d45c65-c6dc-4051-8559-acf9255b8005/volumes"
Sep 07 12:16:21.488051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.488007    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"]
Sep 07 12:16:21.488538 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.488267    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" podUID="c6b32b18-c19f-4efd-aadc-2b925d1b08df" containerName="maas-api" containerID="cri-o://214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075" gracePeriod=30
Sep 07 12:16:21.751095 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.751025    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:16:21.872205 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.872165    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls\") pod \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") "
Sep 07 12:16:21.872428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.872243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n6jv\" (UniqueName: \"kubernetes.io/projected/c6b32b18-c19f-4efd-aadc-2b925d1b08df-kube-api-access-9n6jv\") pod \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") "
Sep 07 12:16:21.872428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.872274    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-metrics-certs\") pod \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") "
Sep 07 12:16:21.872428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.872375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b32b18-c19f-4efd-aadc-2b925d1b08df-openshift-service-ca\") pod \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\" (UID: \"c6b32b18-c19f-4efd-aadc-2b925d1b08df\") "
Sep 07 12:16:21.872791 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.872756    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b32b18-c19f-4efd-aadc-2b925d1b08df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6b32b18-c19f-4efd-aadc-2b925d1b08df" (UID: "c6b32b18-c19f-4efd-aadc-2b925d1b08df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:16:21.874284 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.874257    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6b32b18-c19f-4efd-aadc-2b925d1b08df" (UID: "c6b32b18-c19f-4efd-aadc-2b925d1b08df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:16:21.874416 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.874320    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b32b18-c19f-4efd-aadc-2b925d1b08df-kube-api-access-9n6jv" (OuterVolumeSpecName: "kube-api-access-9n6jv") pod "c6b32b18-c19f-4efd-aadc-2b925d1b08df" (UID: "c6b32b18-c19f-4efd-aadc-2b925d1b08df"). InnerVolumeSpecName "kube-api-access-9n6jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:16:21.874488 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.874469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c6b32b18-c19f-4efd-aadc-2b925d1b08df" (UID: "c6b32b18-c19f-4efd-aadc-2b925d1b08df"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:16:21.974091 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.974050    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:21.974091 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.974087    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n6jv\" (UniqueName: \"kubernetes.io/projected/c6b32b18-c19f-4efd-aadc-2b925d1b08df-kube-api-access-9n6jv\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:21.974317 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.974101    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b32b18-c19f-4efd-aadc-2b925d1b08df-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:21.974317 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.974116    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6b32b18-c19f-4efd-aadc-2b925d1b08df-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:16:21.988683 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.988645    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6b32b18-c19f-4efd-aadc-2b925d1b08df" containerID="214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075" exitCode=0
Sep 07 12:16:21.988825 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.988686    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"
Sep 07 12:16:21.988825 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.988696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" event={"ID":"c6b32b18-c19f-4efd-aadc-2b925d1b08df","Type":"ContainerDied","Data":"214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075"}
Sep 07 12:16:21.988825 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.988748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc" event={"ID":"c6b32b18-c19f-4efd-aadc-2b925d1b08df","Type":"ContainerDied","Data":"b3549e0a4ded426e5e62c4416d44cd4e951f4ca1c240d014c793f4beedfae4be"}
Sep 07 12:16:21.988825 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.988770    2560 scope.go:117] "RemoveContainer" containerID="214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075"
Sep 07 12:16:21.998558 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.998539    2560 scope.go:117] "RemoveContainer" containerID="214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075"
Sep 07 12:16:21.998826 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:16:21.998802    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075\": container with ID starting with 214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075 not found: ID does not exist" containerID="214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075"
Sep 07 12:16:21.998905 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:21.998839    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075"} err="failed to get container status \"214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075\": rpc error: code = NotFound desc = could not find container \"214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075\": container with ID starting with 214c884acf710ed425e456fdc109a496ea06aab76622652f828d5b065ce06075 not found: ID does not exist"
Sep 07 12:16:22.010524 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:22.010378    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"]
Sep 07 12:16:22.014636 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:22.014613    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff0c9-5b685594b4-jkzvc"]
Sep 07 12:16:23.360273 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:23.360238    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b32b18-c19f-4efd-aadc-2b925d1b08df" path="/var/lib/kubelet/pods/c6b32b18-c19f-4efd-aadc-2b925d1b08df/volumes"
Sep 07 12:16:47.415966 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.415932    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"]
Sep 07 12:16:47.416413 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416371    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7655fa-8195-4136-8372-b6666716771c" containerName="maas-api"
Sep 07 12:16:47.416413 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416398    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7655fa-8195-4136-8372-b6666716771c" containerName="maas-api"
Sep 07 12:16:47.416413 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416414    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37625e3-de14-460f-b5f3-d885708c5825" containerName="payload-pre-processing"
Sep 07 12:16:47.416413 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416420    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37625e3-de14-460f-b5f3-d885708c5825" containerName="payload-pre-processing"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416430    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff996340-6cd3-4b17-a969-d00f5c28ef24" containerName="mt-curl-7497-56e0a4"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416436    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff996340-6cd3-4b17-a969-d00f5c28ef24" containerName="mt-curl-7497-56e0a4"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416445    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" containerName="payload-processing"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416451    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" containerName="payload-processing"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416461    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efabc653-8a3a-47ad-8730-9245d6d858d0" containerName="maas-api"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416466    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="efabc653-8a3a-47ad-8730-9245d6d858d0" containerName="maas-api"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416476    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d45c65-c6dc-4051-8559-acf9255b8005" containerName="payload-processing"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416482    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d45c65-c6dc-4051-8559-acf9255b8005" containerName="payload-processing"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416492    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b32b18-c19f-4efd-aadc-2b925d1b08df" containerName="maas-api"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416497    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b32b18-c19f-4efd-aadc-2b925d1b08df" containerName="maas-api"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416560    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff996340-6cd3-4b17-a969-d00f5c28ef24" containerName="mt-curl-7497-56e0a4"
Sep 07 12:16:47.416563 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416569    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="efabc653-8a3a-47ad-8730-9245d6d858d0" containerName="maas-api"
Sep 07 12:16:47.416920 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416577    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="db7655fa-8195-4136-8372-b6666716771c" containerName="maas-api"
Sep 07 12:16:47.416920 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416583    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c03d75a-31cb-40bf-bf7f-8780a7ae8d2e" containerName="payload-processing"
Sep 07 12:16:47.416920 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416590    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a37625e3-de14-460f-b5f3-d885708c5825" containerName="payload-pre-processing"
Sep 07 12:16:47.416920 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416597    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d45c65-c6dc-4051-8559-acf9255b8005" containerName="payload-processing"
Sep 07 12:16:47.416920 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.416602    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b32b18-c19f-4efd-aadc-2b925d1b08df" containerName="maas-api"
Sep 07 12:16:47.419873 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.419852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.422586 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.422561    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-aab734-serving-cert\""
Sep 07 12:16:47.430683 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.430651    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"]
Sep 07 12:16:47.522109 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.522067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.522316 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.522139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc2329a-9eba-415b-a06f-4e7a936fabb4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.522316 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.522199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbjt\" (UniqueName: \"kubernetes.io/projected/9dc2329a-9eba-415b-a06f-4e7a936fabb4-kube-api-access-mwbjt\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.522316 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.522290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-metrics-certs\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.623449 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.623417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-metrics-certs\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.623650 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.623462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.623650 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.623525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc2329a-9eba-415b-a06f-4e7a936fabb4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.623650 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.623598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbjt\" (UniqueName: \"kubernetes.io/projected/9dc2329a-9eba-415b-a06f-4e7a936fabb4-kube-api-access-mwbjt\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.624213 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.624183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc2329a-9eba-415b-a06f-4e7a936fabb4-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.626124 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.626098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-maas-api-tls\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.626224 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.626138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-metrics-certs\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.631313 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.631295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbjt\" (UniqueName: \"kubernetes.io/projected/9dc2329a-9eba-415b-a06f-4e7a936fabb4-kube-api-access-mwbjt\") pod \"maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:47.734214 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:47.734129    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:48.010879 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:48.010852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"]
Sep 07 12:16:48.013434 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:16:48.013405    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc2329a_9eba_415b_a06f_4e7a936fabb4.slice/crio-d614f3da804df2516e4aa4a7b59d0d0bab794de3306d672f7de4d4220cbf9eda WatchSource:0}: Error finding container d614f3da804df2516e4aa4a7b59d0d0bab794de3306d672f7de4d4220cbf9eda: Status 404 returned error can't find the container with id d614f3da804df2516e4aa4a7b59d0d0bab794de3306d672f7de4d4220cbf9eda
Sep 07 12:16:48.154422 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:48.154377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf" event={"ID":"9dc2329a-9eba-415b-a06f-4e7a936fabb4","Type":"ContainerStarted","Data":"d614f3da804df2516e4aa4a7b59d0d0bab794de3306d672f7de4d4220cbf9eda"}
Sep 07 12:16:49.163117 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:49.163077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf" event={"ID":"9dc2329a-9eba-415b-a06f-4e7a936fabb4","Type":"ContainerStarted","Data":"5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076"}
Sep 07 12:16:49.163537 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:49.163244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:16:49.178930 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:49.178876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf" podStartSLOduration=1.6685417949999999 podStartE2EDuration="2.178858183s" totalImagesPullingTime="510.316388ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:16:49.178083398 +0000 UTC m=+1784.315834708" watchObservedRunningTime="2026-09-07 12:16:49.178858183 +0000 UTC m=+1784.316609515"
Sep 07 12:16:55.175615 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:16:55.175582    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:17:05.974768 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:05.974736    2560 scope.go:117] "RemoveContainer" containerID="4ed1618d7ea9a94c83bed4d255ddfd0a36ff7b1e987711d7afaa2d39161e3d2c"
Sep 07 12:17:16.470378 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.470323    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"]
Sep 07 12:17:16.474589 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.474568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.477188 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.477156    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-3e7ca1-serving-cert\""
Sep 07 12:17:16.482634 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.482607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"]
Sep 07 12:17:16.608844 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.608804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmmx\" (UniqueName: \"kubernetes.io/projected/543be75a-1d59-4145-9192-81ab38a69094-kube-api-access-cgmmx\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.609049 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.608889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/543be75a-1d59-4145-9192-81ab38a69094-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.609049 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.608947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-metrics-certs\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.609049 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.608980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.709964 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.709922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmmx\" (UniqueName: \"kubernetes.io/projected/543be75a-1d59-4145-9192-81ab38a69094-kube-api-access-cgmmx\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.710148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.710001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/543be75a-1d59-4145-9192-81ab38a69094-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.710148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.710025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-metrics-certs\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.710148 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.710053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.710274 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:17:16.710169    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-serving-cert: secret "maas-api-e2e-ipp-b-3e7ca1-serving-cert" not found
Sep 07 12:17:16.710274 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:17:16.710233    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls podName:543be75a-1d59-4145-9192-81ab38a69094 nodeName:}" failed. No retries permitted until 2026-09-07 12:17:17.21021569 +0000 UTC m=+1812.347966979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls") pod "maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" (UID: "543be75a-1d59-4145-9192-81ab38a69094") : secret "maas-api-e2e-ipp-b-3e7ca1-serving-cert" not found
Sep 07 12:17:16.710725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.710703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/543be75a-1d59-4145-9192-81ab38a69094-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.712555 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.712531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-metrics-certs\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:16.718691 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:16.718668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmmx\" (UniqueName: \"kubernetes.io/projected/543be75a-1d59-4145-9192-81ab38a69094-kube-api-access-cgmmx\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:17.215991 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.215945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:17.218315 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.218295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls\") pod \"maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:17.268732 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.268693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"]
Sep 07 12:17:17.272574 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.272556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.274946 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.274924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-3e7ca1\""
Sep 07 12:17:17.275068 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.274925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-3e7ca1-dockercfg-98t2z\""
Sep 07 12:17:17.282001 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.281975    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"]
Sep 07 12:17:17.317006 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.316947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ed0928-35dc-4737-875e-d2577307b0e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.317164 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.317072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4p89\" (UniqueName: \"kubernetes.io/projected/61ed0928-35dc-4737-875e-d2577307b0e3-kube-api-access-d4p89\") pod \"payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.391185 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.391149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:17.418361 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.418312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4p89\" (UniqueName: \"kubernetes.io/projected/61ed0928-35dc-4737-875e-d2577307b0e3-kube-api-access-d4p89\") pod \"payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.418587 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.418561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ed0928-35dc-4737-875e-d2577307b0e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.419449 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.419422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ed0928-35dc-4737-875e-d2577307b0e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.426205 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.426181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4p89\" (UniqueName: \"kubernetes.io/projected/61ed0928-35dc-4737-875e-d2577307b0e3-kube-api-access-d4p89\") pod \"payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.584354 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.584233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:17.671824 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.671779    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"]
Sep 07 12:17:17.673151 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:17:17.673116    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543be75a_1d59_4145_9192_81ab38a69094.slice/crio-011fb41ac49468b887a21da07695a77948d5b4d90270aab624214ca954910d19 WatchSource:0}: Error finding container 011fb41ac49468b887a21da07695a77948d5b4d90270aab624214ca954910d19: Status 404 returned error can't find the container with id 011fb41ac49468b887a21da07695a77948d5b4d90270aab624214ca954910d19
Sep 07 12:17:17.859514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:17.859481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"]
Sep 07 12:17:17.860006 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:17:17.859981    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ed0928_35dc_4737_875e_d2577307b0e3.slice/crio-bf9ba66a65e7fda9c5c1122678a36f24cf458714f1344223c369814d4885da47 WatchSource:0}: Error finding container bf9ba66a65e7fda9c5c1122678a36f24cf458714f1344223c369814d4885da47: Status 404 returned error can't find the container with id bf9ba66a65e7fda9c5c1122678a36f24cf458714f1344223c369814d4885da47
Sep 07 12:17:18.345488 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.345388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d" event={"ID":"61ed0928-35dc-4737-875e-d2577307b0e3","Type":"ContainerStarted","Data":"83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992"}
Sep 07 12:17:18.345662 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.345551    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:17:18.345662 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.345584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d" event={"ID":"61ed0928-35dc-4737-875e-d2577307b0e3","Type":"ContainerStarted","Data":"bf9ba66a65e7fda9c5c1122678a36f24cf458714f1344223c369814d4885da47"}
Sep 07 12:17:18.347231 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.347195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" event={"ID":"543be75a-1d59-4145-9192-81ab38a69094","Type":"ContainerStarted","Data":"c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0"}
Sep 07 12:17:18.347381 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.347251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" event={"ID":"543be75a-1d59-4145-9192-81ab38a69094","Type":"ContainerStarted","Data":"011fb41ac49468b887a21da07695a77948d5b4d90270aab624214ca954910d19"}
Sep 07 12:17:18.347381 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.347280    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:18.361141 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.361086    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d" podStartSLOduration=1.361068429 podStartE2EDuration="1.361068429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:17:18.360283059 +0000 UTC m=+1813.498034371" watchObservedRunningTime="2026-09-07 12:17:18.361068429 +0000 UTC m=+1813.498819740"
Sep 07 12:17:18.379802 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:18.379742    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" podStartSLOduration=2.076385273 podStartE2EDuration="2.379721292s" totalImagesPullingTime="303.336019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:17:18.375767772 +0000 UTC m=+1813.513519096" watchObservedRunningTime="2026-09-07 12:17:18.379721292 +0000 UTC m=+1813.517472604"
Sep 07 12:17:24.361352 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:24.361303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:17:29.360771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:17:29.360740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:18:28.493371 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.493260    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"]
Sep 07 12:18:28.497373 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.497353    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.500001 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.499977    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-845d36\""
Sep 07 12:18:28.500134 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.500032    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-845d36-dockercfg-p4z9w\""
Sep 07 12:18:28.505428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.505216    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"]
Sep 07 12:18:28.595760 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.595726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8vmx\" (UniqueName: \"kubernetes.io/projected/962c9fc9-b25e-4e54-8336-e834650a1aeb-kube-api-access-n8vmx\") pod \"payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.595941 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.595875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962c9fc9-b25e-4e54-8336-e834650a1aeb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.697141 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.697094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962c9fc9-b25e-4e54-8336-e834650a1aeb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.697369 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.697156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vmx\" (UniqueName: \"kubernetes.io/projected/962c9fc9-b25e-4e54-8336-e834650a1aeb-kube-api-access-n8vmx\") pod \"payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.697827 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.697804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962c9fc9-b25e-4e54-8336-e834650a1aeb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.705199 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.705175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8vmx\" (UniqueName: \"kubernetes.io/projected/962c9fc9-b25e-4e54-8336-e834650a1aeb-kube-api-access-n8vmx\") pod \"payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:28.810646 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:28.810557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:29.089281 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:29.089249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"]
Sep 07 12:18:29.090839 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:18:29.090814    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962c9fc9_b25e_4e54_8336_e834650a1aeb.slice/crio-811c25c1f9d525d520c6993910025446ffaf3d2901cbc1b1ce5c8212f34762ed WatchSource:0}: Error finding container 811c25c1f9d525d520c6993910025446ffaf3d2901cbc1b1ce5c8212f34762ed: Status 404 returned error can't find the container with id 811c25c1f9d525d520c6993910025446ffaf3d2901cbc1b1ce5c8212f34762ed
Sep 07 12:18:29.792225 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:29.792185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf" event={"ID":"962c9fc9-b25e-4e54-8336-e834650a1aeb","Type":"ContainerStarted","Data":"4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e"}
Sep 07 12:18:29.792692 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:29.792241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf" event={"ID":"962c9fc9-b25e-4e54-8336-e834650a1aeb","Type":"ContainerStarted","Data":"811c25c1f9d525d520c6993910025446ffaf3d2901cbc1b1ce5c8212f34762ed"}
Sep 07 12:18:29.792692 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:29.792306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:29.809071 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:29.809029    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf" podStartSLOduration=1.809014133 podStartE2EDuration="1.809014133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:18:29.807164383 +0000 UTC m=+1884.944915695" watchObservedRunningTime="2026-09-07 12:18:29.809014133 +0000 UTC m=+1884.946765456"
Sep 07 12:18:40.801897 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:40.801866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:58.434042 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.434001    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"]
Sep 07 12:18:58.434615 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.434292    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf" podUID="962c9fc9-b25e-4e54-8336-e834650a1aeb" containerName="payload-pre-processing" containerID="cri-o://4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e" gracePeriod=30
Sep 07 12:18:58.704934 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.704905    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:58.788134 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.788094    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962c9fc9-b25e-4e54-8336-e834650a1aeb-plugins-config-volume\") pod \"962c9fc9-b25e-4e54-8336-e834650a1aeb\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") "
Sep 07 12:18:58.788314 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.788284    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8vmx\" (UniqueName: \"kubernetes.io/projected/962c9fc9-b25e-4e54-8336-e834650a1aeb-kube-api-access-n8vmx\") pod \"962c9fc9-b25e-4e54-8336-e834650a1aeb\" (UID: \"962c9fc9-b25e-4e54-8336-e834650a1aeb\") "
Sep 07 12:18:58.788549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.788523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/962c9fc9-b25e-4e54-8336-e834650a1aeb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "962c9fc9-b25e-4e54-8336-e834650a1aeb" (UID: "962c9fc9-b25e-4e54-8336-e834650a1aeb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:18:58.790329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.790307    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962c9fc9-b25e-4e54-8336-e834650a1aeb-kube-api-access-n8vmx" (OuterVolumeSpecName: "kube-api-access-n8vmx") pod "962c9fc9-b25e-4e54-8336-e834650a1aeb" (UID: "962c9fc9-b25e-4e54-8336-e834650a1aeb"). InnerVolumeSpecName "kube-api-access-n8vmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:18:58.889815 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.889769    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8vmx\" (UniqueName: \"kubernetes.io/projected/962c9fc9-b25e-4e54-8336-e834650a1aeb-kube-api-access-n8vmx\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:18:58.889815 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.889805    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962c9fc9-b25e-4e54-8336-e834650a1aeb-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:18:58.973187 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.973094    2560 generic.go:356] "Generic (PLEG): container finished" podID="962c9fc9-b25e-4e54-8336-e834650a1aeb" containerID="4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e" exitCode=0
Sep 07 12:18:58.973187 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.973142    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"
Sep 07 12:18:58.973470 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.973182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf" event={"ID":"962c9fc9-b25e-4e54-8336-e834650a1aeb","Type":"ContainerDied","Data":"4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e"}
Sep 07 12:18:58.973470 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.973243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf" event={"ID":"962c9fc9-b25e-4e54-8336-e834650a1aeb","Type":"ContainerDied","Data":"811c25c1f9d525d520c6993910025446ffaf3d2901cbc1b1ce5c8212f34762ed"}
Sep 07 12:18:58.973470 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.973272    2560 scope.go:117] "RemoveContainer" containerID="4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e"
Sep 07 12:18:58.984303 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.984280    2560 scope.go:117] "RemoveContainer" containerID="4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e"
Sep 07 12:18:58.984606 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:18:58.984585    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e\": container with ID starting with 4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e not found: ID does not exist" containerID="4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e"
Sep 07 12:18:58.984678 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.984619    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e"} err="failed to get container status \"4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e\": rpc error: code = NotFound desc = could not find container \"4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e\": container with ID starting with 4473ff14499cc727a667bc5b5a431b050794887cacea2d19e1d58037222d404e not found: ID does not exist"
Sep 07 12:18:58.997548 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:58.997525    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"]
Sep 07 12:18:59.001549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:59.001525    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-845d36-67d7f48fd-tt9sf"]
Sep 07 12:18:59.361318 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:18:59.361282    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="962c9fc9-b25e-4e54-8336-e834650a1aeb" path="/var/lib/kubelet/pods/962c9fc9-b25e-4e54-8336-e834650a1aeb/volumes"
Sep 07 12:19:24.241617 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.241580    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"]
Sep 07 12:19:24.242084 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.241787    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf" podUID="9dc2329a-9eba-415b-a06f-4e7a936fabb4" containerName="maas-api" containerID="cri-o://5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076" gracePeriod=30
Sep 07 12:19:24.510449 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.510425    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:19:24.630256 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.630220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc2329a-9eba-415b-a06f-4e7a936fabb4-openshift-service-ca\") pod \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") "
Sep 07 12:19:24.630514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.630281    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-maas-api-tls\") pod \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") "
Sep 07 12:19:24.630514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.630365    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwbjt\" (UniqueName: \"kubernetes.io/projected/9dc2329a-9eba-415b-a06f-4e7a936fabb4-kube-api-access-mwbjt\") pod \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") "
Sep 07 12:19:24.630514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.630388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-metrics-certs\") pod \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\" (UID: \"9dc2329a-9eba-415b-a06f-4e7a936fabb4\") "
Sep 07 12:19:24.630705 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.630681    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc2329a-9eba-415b-a06f-4e7a936fabb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9dc2329a-9eba-415b-a06f-4e7a936fabb4" (UID: "9dc2329a-9eba-415b-a06f-4e7a936fabb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:19:24.632531 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.632499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9dc2329a-9eba-415b-a06f-4e7a936fabb4" (UID: "9dc2329a-9eba-415b-a06f-4e7a936fabb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:19:24.632649 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.632529    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9dc2329a-9eba-415b-a06f-4e7a936fabb4" (UID: "9dc2329a-9eba-415b-a06f-4e7a936fabb4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:19:24.632649 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.632566    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc2329a-9eba-415b-a06f-4e7a936fabb4-kube-api-access-mwbjt" (OuterVolumeSpecName: "kube-api-access-mwbjt") pod "9dc2329a-9eba-415b-a06f-4e7a936fabb4" (UID: "9dc2329a-9eba-415b-a06f-4e7a936fabb4"). InnerVolumeSpecName "kube-api-access-mwbjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:19:24.731771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.731737    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc2329a-9eba-415b-a06f-4e7a936fabb4-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:19:24.731771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.731765    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:19:24.731771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.731776    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwbjt\" (UniqueName: \"kubernetes.io/projected/9dc2329a-9eba-415b-a06f-4e7a936fabb4-kube-api-access-mwbjt\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:19:24.732000 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:24.731784    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9dc2329a-9eba-415b-a06f-4e7a936fabb4-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:19:25.139676 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.139632    2560 generic.go:356] "Generic (PLEG): container finished" podID="9dc2329a-9eba-415b-a06f-4e7a936fabb4" containerID="5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076" exitCode=0
Sep 07 12:19:25.139866 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.139681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf" event={"ID":"9dc2329a-9eba-415b-a06f-4e7a936fabb4","Type":"ContainerDied","Data":"5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076"}
Sep 07 12:19:25.139866 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.139701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"
Sep 07 12:19:25.139866 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.139777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf" event={"ID":"9dc2329a-9eba-415b-a06f-4e7a936fabb4","Type":"ContainerDied","Data":"d614f3da804df2516e4aa4a7b59d0d0bab794de3306d672f7de4d4220cbf9eda"}
Sep 07 12:19:25.139866 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.139801    2560 scope.go:117] "RemoveContainer" containerID="5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076"
Sep 07 12:19:25.151155 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.151124    2560 scope.go:117] "RemoveContainer" containerID="5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076"
Sep 07 12:19:25.151517 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:19:25.151483    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076\": container with ID starting with 5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076 not found: ID does not exist" containerID="5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076"
Sep 07 12:19:25.151620 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.151527    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076"} err="failed to get container status \"5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076\": rpc error: code = NotFound desc = could not find container \"5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076\": container with ID starting with 5510732d8b9cdcca5199c7916253a609c63cbb37ccfbe4894e937c958794b076 not found: ID does not exist"
Sep 07 12:19:25.165029 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.165005    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"]
Sep 07 12:19:25.173012 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.172989    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-aab734-78fd999bd9-p6gkf"]
Sep 07 12:19:25.362852 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:19:25.362820    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc2329a-9eba-415b-a06f-4e7a936fabb4" path="/var/lib/kubelet/pods/9dc2329a-9eba-415b-a06f-4e7a936fabb4/volumes"
Sep 07 12:20:46.860883 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:46.860846    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"]
Sep 07 12:20:46.861565 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:46.861099    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" podUID="543be75a-1d59-4145-9192-81ab38a69094" containerName="maas-api" containerID="cri-o://c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0" gracePeriod=30
Sep 07 12:20:46.933578 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:46.933535    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"]
Sep 07 12:20:46.933909 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:46.933857    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d" podUID="61ed0928-35dc-4737-875e-d2577307b0e3" containerName="payload-pre-processing" containerID="cri-o://83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992" gracePeriod=30
Sep 07 12:20:47.186129 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.186092    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:20:47.222586 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.222559    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:20:47.317700 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.317665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-metrics-certs\") pod \"543be75a-1d59-4145-9192-81ab38a69094\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") "
Sep 07 12:20:47.317894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.317747    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ed0928-35dc-4737-875e-d2577307b0e3-plugins-config-volume\") pod \"61ed0928-35dc-4737-875e-d2577307b0e3\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") "
Sep 07 12:20:47.317894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.317776    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgmmx\" (UniqueName: \"kubernetes.io/projected/543be75a-1d59-4145-9192-81ab38a69094-kube-api-access-cgmmx\") pod \"543be75a-1d59-4145-9192-81ab38a69094\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") "
Sep 07 12:20:47.317894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.317822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/543be75a-1d59-4145-9192-81ab38a69094-openshift-service-ca\") pod \"543be75a-1d59-4145-9192-81ab38a69094\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") "
Sep 07 12:20:47.317894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.317839    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4p89\" (UniqueName: \"kubernetes.io/projected/61ed0928-35dc-4737-875e-d2577307b0e3-kube-api-access-d4p89\") pod \"61ed0928-35dc-4737-875e-d2577307b0e3\" (UID: \"61ed0928-35dc-4737-875e-d2577307b0e3\") "
Sep 07 12:20:47.317894 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.317859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls\") pod \"543be75a-1d59-4145-9192-81ab38a69094\" (UID: \"543be75a-1d59-4145-9192-81ab38a69094\") "
Sep 07 12:20:47.318234 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.318192    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543be75a-1d59-4145-9192-81ab38a69094-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "543be75a-1d59-4145-9192-81ab38a69094" (UID: "543be75a-1d59-4145-9192-81ab38a69094"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:20:47.318234 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.318219    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ed0928-35dc-4737-875e-d2577307b0e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61ed0928-35dc-4737-875e-d2577307b0e3" (UID: "61ed0928-35dc-4737-875e-d2577307b0e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:20:47.319864 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.319836    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "543be75a-1d59-4145-9192-81ab38a69094" (UID: "543be75a-1d59-4145-9192-81ab38a69094"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:20:47.319955 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.319924    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "543be75a-1d59-4145-9192-81ab38a69094" (UID: "543be75a-1d59-4145-9192-81ab38a69094"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:20:47.320351 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.320320    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ed0928-35dc-4737-875e-d2577307b0e3-kube-api-access-d4p89" (OuterVolumeSpecName: "kube-api-access-d4p89") pod "61ed0928-35dc-4737-875e-d2577307b0e3" (UID: "61ed0928-35dc-4737-875e-d2577307b0e3"). InnerVolumeSpecName "kube-api-access-d4p89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:20:47.320399 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.320372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543be75a-1d59-4145-9192-81ab38a69094-kube-api-access-cgmmx" (OuterVolumeSpecName: "kube-api-access-cgmmx") pod "543be75a-1d59-4145-9192-81ab38a69094" (UID: "543be75a-1d59-4145-9192-81ab38a69094"). InnerVolumeSpecName "kube-api-access-cgmmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:20:47.419403 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.419316    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:20:47.419403 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.419371    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61ed0928-35dc-4737-875e-d2577307b0e3-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:20:47.419403 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.419387    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgmmx\" (UniqueName: \"kubernetes.io/projected/543be75a-1d59-4145-9192-81ab38a69094-kube-api-access-cgmmx\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:20:47.419403 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.419400    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/543be75a-1d59-4145-9192-81ab38a69094-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:20:47.419625 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.419414    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4p89\" (UniqueName: \"kubernetes.io/projected/61ed0928-35dc-4737-875e-d2577307b0e3-kube-api-access-d4p89\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:20:47.419625 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.419427    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/543be75a-1d59-4145-9192-81ab38a69094-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:20:47.652905 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.652868    2560 generic.go:356] "Generic (PLEG): container finished" podID="61ed0928-35dc-4737-875e-d2577307b0e3" containerID="83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992" exitCode=0
Sep 07 12:20:47.653081 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.652925    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"
Sep 07 12:20:47.653081 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.652951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d" event={"ID":"61ed0928-35dc-4737-875e-d2577307b0e3","Type":"ContainerDied","Data":"83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992"}
Sep 07 12:20:47.653081 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.653003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d" event={"ID":"61ed0928-35dc-4737-875e-d2577307b0e3","Type":"ContainerDied","Data":"bf9ba66a65e7fda9c5c1122678a36f24cf458714f1344223c369814d4885da47"}
Sep 07 12:20:47.653081 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.653033    2560 scope.go:117] "RemoveContainer" containerID="83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992"
Sep 07 12:20:47.654426 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.654403    2560 generic.go:356] "Generic (PLEG): container finished" podID="543be75a-1d59-4145-9192-81ab38a69094" containerID="c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0" exitCode=0
Sep 07 12:20:47.654549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.654455    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"
Sep 07 12:20:47.654549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.654474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" event={"ID":"543be75a-1d59-4145-9192-81ab38a69094","Type":"ContainerDied","Data":"c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0"}
Sep 07 12:20:47.654549 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.654522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq" event={"ID":"543be75a-1d59-4145-9192-81ab38a69094","Type":"ContainerDied","Data":"011fb41ac49468b887a21da07695a77948d5b4d90270aab624214ca954910d19"}
Sep 07 12:20:47.662754 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.662715    2560 scope.go:117] "RemoveContainer" containerID="83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992"
Sep 07 12:20:47.663025 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:20:47.663005    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992\": container with ID starting with 83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992 not found: ID does not exist" containerID="83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992"
Sep 07 12:20:47.663089 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.663034    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992"} err="failed to get container status \"83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992\": rpc error: code = NotFound desc = could not find container \"83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992\": container with ID starting with 83b944ce041692eb70b3e06981e7645dfdf7862726558ae200c5670b33814992 not found: ID does not exist"
Sep 07 12:20:47.663089 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.663050    2560 scope.go:117] "RemoveContainer" containerID="c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0"
Sep 07 12:20:47.671531 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.671516    2560 scope.go:117] "RemoveContainer" containerID="c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0"
Sep 07 12:20:47.671798 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:20:47.671781    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0\": container with ID starting with c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0 not found: ID does not exist" containerID="c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0"
Sep 07 12:20:47.671855 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.671807    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0"} err="failed to get container status \"c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0\": rpc error: code = NotFound desc = could not find container \"c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0\": container with ID starting with c3b4a90be7c2cdc84546517bb8a7530810fb16a0403b60155987f138a95de4a0 not found: ID does not exist"
Sep 07 12:20:47.673256 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.673236    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"]
Sep 07 12:20:47.677169 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.677150    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-3e7ca1-5bfc679f58-w5kvq"]
Sep 07 12:20:47.688278 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.688256    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"]
Sep 07 12:20:47.690620 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:47.690603    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3e7ca1-68854d6d74-cjg7d"]
Sep 07 12:20:49.360924 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:49.360889    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543be75a-1d59-4145-9192-81ab38a69094" path="/var/lib/kubelet/pods/543be75a-1d59-4145-9192-81ab38a69094/volumes"
Sep 07 12:20:49.361471 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:20:49.361450    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61ed0928-35dc-4737-875e-d2577307b0e3" path="/var/lib/kubelet/pods/61ed0928-35dc-4737-875e-d2577307b0e3/volumes"
Sep 07 12:21:04.307258 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.307218    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"]
Sep 07 12:21:04.307805 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.307444    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5" podUID="e8677a80-b8bb-40c7-a6df-792c83ed007d" containerName="payload-processing" containerID="cri-o://d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1" gracePeriod=30
Sep 07 12:21:04.570147 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.570086    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:21:04.574275 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.574253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8dgd\" (UniqueName: \"kubernetes.io/projected/e8677a80-b8bb-40c7-a6df-792c83ed007d-kube-api-access-q8dgd\") pod \"e8677a80-b8bb-40c7-a6df-792c83ed007d\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") "
Sep 07 12:21:04.574421 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.574405    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8677a80-b8bb-40c7-a6df-792c83ed007d-plugins-config-volume\") pod \"e8677a80-b8bb-40c7-a6df-792c83ed007d\" (UID: \"e8677a80-b8bb-40c7-a6df-792c83ed007d\") "
Sep 07 12:21:04.574744 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.574721    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8677a80-b8bb-40c7-a6df-792c83ed007d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8677a80-b8bb-40c7-a6df-792c83ed007d" (UID: "e8677a80-b8bb-40c7-a6df-792c83ed007d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:21:04.576289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.576265    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8677a80-b8bb-40c7-a6df-792c83ed007d-kube-api-access-q8dgd" (OuterVolumeSpecName: "kube-api-access-q8dgd") pod "e8677a80-b8bb-40c7-a6df-792c83ed007d" (UID: "e8677a80-b8bb-40c7-a6df-792c83ed007d"). InnerVolumeSpecName "kube-api-access-q8dgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:21:04.675244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.675206    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8dgd\" (UniqueName: \"kubernetes.io/projected/e8677a80-b8bb-40c7-a6df-792c83ed007d-kube-api-access-q8dgd\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:04.675244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.675237    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8677a80-b8bb-40c7-a6df-792c83ed007d-plugins-config-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:04.757393 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.757359    2560 generic.go:356] "Generic (PLEG): container finished" podID="e8677a80-b8bb-40c7-a6df-792c83ed007d" containerID="d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1" exitCode=0
Sep 07 12:21:04.757554 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.757413    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"
Sep 07 12:21:04.757554 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.757456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5" event={"ID":"e8677a80-b8bb-40c7-a6df-792c83ed007d","Type":"ContainerDied","Data":"d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1"}
Sep 07 12:21:04.757554 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.757517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5" event={"ID":"e8677a80-b8bb-40c7-a6df-792c83ed007d","Type":"ContainerDied","Data":"090ef4afe6bf27b5fc8ffcddd939e6dfb8998b9fa0fa92741b6a620464be55a7"}
Sep 07 12:21:04.757554 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.757543    2560 scope.go:117] "RemoveContainer" containerID="d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1"
Sep 07 12:21:04.769190 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.769171    2560 scope.go:117] "RemoveContainer" containerID="d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1"
Sep 07 12:21:04.769485 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:21:04.769455    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1\": container with ID starting with d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1 not found: ID does not exist" containerID="d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1"
Sep 07 12:21:04.769584 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.769491    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1"} err="failed to get container status \"d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1\": rpc error: code = NotFound desc = could not find container \"d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1\": container with ID starting with d273fed0ef844b72285614a74b8fdd17d9bd51ebcfa41786679b32cac0a811b1 not found: ID does not exist"
Sep 07 12:21:04.783442 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.783421    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"]
Sep 07 12:21:04.789799 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:04.789777    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-491296-ff4b6d445-tdng5"]
Sep 07 12:21:05.362020 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:05.361980    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8677a80-b8bb-40c7-a6df-792c83ed007d" path="/var/lib/kubelet/pods/e8677a80-b8bb-40c7-a6df-792c83ed007d/volumes"
Sep 07 12:21:06.040336 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:06.040310    2560 scope.go:117] "RemoveContainer" containerID="da0695ec1e91c8ca28880297c9f723b220d046372137477619fc4025785f0d97"
Sep 07 12:21:06.049199 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:06.049178    2560 scope.go:117] "RemoveContainer" containerID="ae124b9b9e48302420fbbea1357c5e0e6c037ef9687f10f7e776b15f40d25a61"
Sep 07 12:21:32.116669 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.116585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"]
Sep 07 12:21:32.117222 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.116835    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf" podUID="c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" containerName="maas-api" containerID="cri-o://2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd" gracePeriod=30
Sep 07 12:21:32.377385 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.377321    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:21:32.523238 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.523205    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqgbt\" (UniqueName: \"kubernetes.io/projected/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-kube-api-access-tqgbt\") pod \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") "
Sep 07 12:21:32.523428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.523261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-metrics-certs\") pod \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") "
Sep 07 12:21:32.523428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.523314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-openshift-service-ca\") pod \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") "
Sep 07 12:21:32.523428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.523334    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-maas-api-tls\") pod \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\" (UID: \"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a\") "
Sep 07 12:21:32.523754 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.523726    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" (UID: "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:21:32.525269 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.525235    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" (UID: "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:21:32.525269 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.525261    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-kube-api-access-tqgbt" (OuterVolumeSpecName: "kube-api-access-tqgbt") pod "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" (UID: "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a"). InnerVolumeSpecName "kube-api-access-tqgbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:21:32.525468 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.525305    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" (UID: "c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:21:32.624424 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.624395    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:32.624424 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.624423    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:32.624606 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.624437    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:32.624606 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.624448    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqgbt\" (UniqueName: \"kubernetes.io/projected/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a-kube-api-access-tqgbt\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:32.923881 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.923849    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" containerID="2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd" exitCode=0
Sep 07 12:21:32.924078 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.923906    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"
Sep 07 12:21:32.924078 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.923927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf" event={"ID":"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a","Type":"ContainerDied","Data":"2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd"}
Sep 07 12:21:32.924078 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.923984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf" event={"ID":"c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a","Type":"ContainerDied","Data":"480c8d869d34bc33d664a40ce88994b544ed70edc9918ec5dbba299a755dec18"}
Sep 07 12:21:32.924078 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.924007    2560 scope.go:117] "RemoveContainer" containerID="2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd"
Sep 07 12:21:32.933296 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.933284    2560 scope.go:117] "RemoveContainer" containerID="2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd"
Sep 07 12:21:32.933635 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:21:32.933618    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd\": container with ID starting with 2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd not found: ID does not exist" containerID="2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd"
Sep 07 12:21:32.933707 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.933643    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd"} err="failed to get container status \"2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd\": rpc error: code = NotFound desc = could not find container \"2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd\": container with ID starting with 2d26d7f3057142c1a1d15191cc792669ec3c3806249b62332303f49e8ccb33fd not found: ID does not exist"
Sep 07 12:21:32.946208 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.946184    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"]
Sep 07 12:21:32.951212 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:32.951190    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-613886-6f67cf6d97-9vwqf"]
Sep 07 12:21:33.361582 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:33.361550    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" path="/var/lib/kubelet/pods/c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a/volumes"
Sep 07 12:21:41.378893 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.378845    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-xrprp"]
Sep 07 12:21:41.379451 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.379093    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85c8f7b977-xrprp" podUID="68415ef1-7cb7-47e7-b012-a838616d14fc" containerName="manager" containerID="cri-o://64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998" gracePeriod=30
Sep 07 12:21:41.445519 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:21:41.445483    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68415ef1_7cb7_47e7_b012_a838616d14fc.slice/crio-conmon-64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998.scope\": RecentStats: unable to find data in memory cache]"
Sep 07 12:21:41.633184 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.633116    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:21:41.806061 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.806029    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g6ns\" (UniqueName: \"kubernetes.io/projected/68415ef1-7cb7-47e7-b012-a838616d14fc-kube-api-access-9g6ns\") pod \"68415ef1-7cb7-47e7-b012-a838616d14fc\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") "
Sep 07 12:21:41.806061 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.806075    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs\") pod \"68415ef1-7cb7-47e7-b012-a838616d14fc\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") "
Sep 07 12:21:41.806297 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.806137    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert\") pod \"68415ef1-7cb7-47e7-b012-a838616d14fc\" (UID: \"68415ef1-7cb7-47e7-b012-a838616d14fc\") "
Sep 07 12:21:41.808255 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.808226    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "68415ef1-7cb7-47e7-b012-a838616d14fc" (UID: "68415ef1-7cb7-47e7-b012-a838616d14fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:21:41.808255 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.808241    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "68415ef1-7cb7-47e7-b012-a838616d14fc" (UID: "68415ef1-7cb7-47e7-b012-a838616d14fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:21:41.808439 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.808323    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68415ef1-7cb7-47e7-b012-a838616d14fc-kube-api-access-9g6ns" (OuterVolumeSpecName: "kube-api-access-9g6ns") pod "68415ef1-7cb7-47e7-b012-a838616d14fc" (UID: "68415ef1-7cb7-47e7-b012-a838616d14fc"). InnerVolumeSpecName "kube-api-access-9g6ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:21:41.907811 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.907732    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-webhook-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:41.907811 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.907758    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g6ns\" (UniqueName: \"kubernetes.io/projected/68415ef1-7cb7-47e7-b012-a838616d14fc-kube-api-access-9g6ns\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:41.907811 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.907767    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68415ef1-7cb7-47e7-b012-a838616d14fc-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:21:41.977850 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.977819    2560 generic.go:356] "Generic (PLEG): container finished" podID="68415ef1-7cb7-47e7-b012-a838616d14fc" containerID="64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998" exitCode=0
Sep 07 12:21:41.978010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.977870    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-xrprp"
Sep 07 12:21:41.978010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.977914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-xrprp" event={"ID":"68415ef1-7cb7-47e7-b012-a838616d14fc","Type":"ContainerDied","Data":"64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998"}
Sep 07 12:21:41.978010 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.977999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-xrprp" event={"ID":"68415ef1-7cb7-47e7-b012-a838616d14fc","Type":"ContainerDied","Data":"c5a336383bb6e07276993172a1f7fd78891879fb84e21676e0ed7fed76b6dfc3"}
Sep 07 12:21:41.978115 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.978026    2560 scope.go:117] "RemoveContainer" containerID="64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998"
Sep 07 12:21:41.988610 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.988590    2560 scope.go:117] "RemoveContainer" containerID="64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998"
Sep 07 12:21:41.988886 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:21:41.988866    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998\": container with ID starting with 64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998 not found: ID does not exist" containerID="64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998"
Sep 07 12:21:41.988962 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:41.988899    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998"} err="failed to get container status \"64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998\": rpc error: code = NotFound desc = could not find container \"64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998\": container with ID starting with 64e98913903415027a9c33322b7112636795daf80f343e3279cb332f9c269998 not found: ID does not exist"
Sep 07 12:21:42.003052 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:42.003027    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-xrprp"]
Sep 07 12:21:42.006152 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:42.006129    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-xrprp"]
Sep 07 12:21:43.359715 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:21:43.359682    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68415ef1-7cb7-47e7-b012-a838616d14fc" path="/var/lib/kubelet/pods/68415ef1-7cb7-47e7-b012-a838616d14fc/volumes"
Sep 07 12:22:42.792566 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.792528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c8f7b977-mhm8v"]
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793048    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ed0928-35dc-4737-875e-d2577307b0e3" containerName="payload-pre-processing"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793066    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ed0928-35dc-4737-875e-d2577307b0e3" containerName="payload-pre-processing"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793079    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc2329a-9eba-415b-a06f-4e7a936fabb4" containerName="maas-api"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793085    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc2329a-9eba-415b-a06f-4e7a936fabb4" containerName="maas-api"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793092    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962c9fc9-b25e-4e54-8336-e834650a1aeb" containerName="payload-pre-processing"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793098    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="962c9fc9-b25e-4e54-8336-e834650a1aeb" containerName="payload-pre-processing"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793109    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68415ef1-7cb7-47e7-b012-a838616d14fc" containerName="manager"
Sep 07 12:22:42.793116 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793118    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68415ef1-7cb7-47e7-b012-a838616d14fc" containerName="manager"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793129    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543be75a-1d59-4145-9192-81ab38a69094" containerName="maas-api"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793135    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="543be75a-1d59-4145-9192-81ab38a69094" containerName="maas-api"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793151    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" containerName="maas-api"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793156    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" containerName="maas-api"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793166    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8677a80-b8bb-40c7-a6df-792c83ed007d" containerName="payload-processing"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793171    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8677a80-b8bb-40c7-a6df-792c83ed007d" containerName="payload-processing"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793234    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68415ef1-7cb7-47e7-b012-a838616d14fc" containerName="manager"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793243    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc2329a-9eba-415b-a06f-4e7a936fabb4" containerName="maas-api"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793250    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8677a80-b8bb-40c7-a6df-792c83ed007d" containerName="payload-processing"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793256    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="962c9fc9-b25e-4e54-8336-e834650a1aeb" containerName="payload-pre-processing"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793262    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61ed0928-35dc-4737-875e-d2577307b0e3" containerName="payload-pre-processing"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793269    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="543be75a-1d59-4145-9192-81ab38a69094" containerName="maas-api"
Sep 07 12:22:42.793406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.793278    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f2c49c-bddc-4fcd-9ac9-4d904ebb111a" containerName="maas-api"
Sep 07 12:22:42.796236 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.796220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:42.799813 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.799756    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zmfq\""
Sep 07 12:22:42.799813 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.799776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 12:22:42.800025 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.799828    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 12:22:42.800025 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.799873    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 12:22:42.809105 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:22:42.809062    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:42.945440 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.945398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-metrics-certs\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:42.945638 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.945519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl92s\" (UniqueName: \"kubernetes.io/projected/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-kube-api-access-gl92s\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:42.945638 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:42.945613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-webhook-cert\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.046329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.046222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-webhook-cert\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.046329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.046274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-metrics-certs\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.046329 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.046324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl92s\" (UniqueName: \"kubernetes.io/projected/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-kube-api-access-gl92s\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.048818 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.048793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-metrics-certs\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.048948 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.048831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-webhook-cert\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.054119 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.054094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl92s\" (UniqueName: \"kubernetes.io/projected/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-kube-api-access-gl92s\") pod \"maas-controller-85c8f7b977-mhm8v\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") " pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:43.106735 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:22:43.106699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:45.368077 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:22:45.368027    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:22:55.368278 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:22:55.368224    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:03.942928 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:03.942889    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-4zxhs"]
Sep 07 12:23:03.947900 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:03.947876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:03.950914 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:03.950890    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-sysctl-allowlist\""
Sep 07 12:23:03.960256 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:03.960214    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:03.972163 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:03.972119    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"39a47c29-63fd-4812-8b13-060d2013591f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wktwz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"podIP\\\":\\\"10.0.138.55\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"startTime\\\":\\\"2026-09-07T12:23:03Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-4zxhs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.030614 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.030571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/39a47c29-63fd-4812-8b13-060d2013591f-ready\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.030614 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.030613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wktwz\" (UniqueName: \"kubernetes.io/projected/39a47c29-63fd-4812-8b13-060d2013591f-kube-api-access-wktwz\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.030819 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.030700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39a47c29-63fd-4812-8b13-060d2013591f-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.030819 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.030782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a47c29-63fd-4812-8b13-060d2013591f-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.131427 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/39a47c29-63fd-4812-8b13-060d2013591f-ready\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.131641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wktwz\" (UniqueName: \"kubernetes.io/projected/39a47c29-63fd-4812-8b13-060d2013591f-kube-api-access-wktwz\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.131641 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39a47c29-63fd-4812-8b13-060d2013591f-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.131760 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a47c29-63fd-4812-8b13-060d2013591f-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.131813 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a47c29-63fd-4812-8b13-060d2013591f-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.131813 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/39a47c29-63fd-4812-8b13-060d2013591f-ready\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.132017 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.131998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39a47c29-63fd-4812-8b13-060d2013591f-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.138788 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.138766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wktwz\" (UniqueName: \"kubernetes.io/projected/39a47c29-63fd-4812-8b13-060d2013591f-kube-api-access-wktwz\") pod \"cni-sysctl-allowlist-ds-4zxhs\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") " pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.257951 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.257868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.271733 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:23:04.271707    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a47c29_63fd_4812_8b13_060d2013591f.slice/crio-1095e688436ae8d1db022f0d22782065db6e6d9bea8af650265bc103c83ca291 WatchSource:0}: Error finding container 1095e688436ae8d1db022f0d22782065db6e6d9bea8af650265bc103c83ca291: Status 404 returned error can't find the container with id 1095e688436ae8d1db022f0d22782065db6e6d9bea8af650265bc103c83ca291
Sep 07 12:23:04.445203 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.445168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" event={"ID":"39a47c29-63fd-4812-8b13-060d2013591f","Type":"ContainerStarted","Data":"a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9"}
Sep 07 12:23:04.445411 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.445231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" event={"ID":"39a47c29-63fd-4812-8b13-060d2013591f","Type":"ContainerStarted","Data":"1095e688436ae8d1db022f0d22782065db6e6d9bea8af650265bc103c83ca291"}
Sep 07 12:23:04.445411 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:04.445395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.456388 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:04.456308    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"39a47c29-63fd-4812-8b13-060d2013591f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:04Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T12:23:04Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wktwz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.0.138.55\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"startTime\\\":\\\"2026-09-07T12:23:03Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-4zxhs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:04.466827 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:04.466776    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:05.367995 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:05.367946    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:05.378669 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:05.378620    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"39a47c29-63fd-4812-8b13-060d2013591f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:04Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T12:23:04Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wktwz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.0.138.55\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"startTime\\\":\\\"2026-09-07T12:23:03Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-4zxhs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:05.461335 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:05.461222    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:05.472206 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:05.472159    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"39a47c29-63fd-4812-8b13-060d2013591f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:04Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:03Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:05Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:23:05Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T12:23:04Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wktwz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.0.138.55\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"startTime\\\":\\\"2026-09-07T12:23:03Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-4zxhs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:05.482923 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:05.482880    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-07T12:22:42Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:71d261aa83d34e42e9ea131a045adc19cdad574367bf15f141e9938c63f69e7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gl92s\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.138.55\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.138.55\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-07T12:22:42Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-85c8f7b977-mhm8v\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-70737425-554b-4289-aebf-e53ca32b3bc0.svc:9743/pod?timeout=10s\": dial tcp 172.30.186.39:9743: connect: connection refused" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:15.376558 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:15.376509    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" podStartSLOduration=12.376492569 podStartE2EDuration="12.376492569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:23:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:23:15.372972046 +0000 UTC m=+2170.510723358" watchObservedRunningTime="2026-09-07 12:23:15.376492569 +0000 UTC m=+2170.514243900"
Sep 07 12:23:15.404191 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:15.404163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-mhm8v"]
Sep 07 12:23:15.645686 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:15.645659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-mhm8v"]
Sep 07 12:23:15.646785 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:23:15.646758    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe8eac0_53c9_4fd8_aa25_e19c6db02536.slice/crio-7de413bd3888067305459c08d39ce7ff61d1ab197db3c744dce92f2c38a31b5f WatchSource:0}: Error finding container 7de413bd3888067305459c08d39ce7ff61d1ab197db3c744dce92f2c38a31b5f: Status 404 returned error can't find the container with id 7de413bd3888067305459c08d39ce7ff61d1ab197db3c744dce92f2c38a31b5f
Sep 07 12:23:15.648011 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:15.647992    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:23:15.936931 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:15.936843    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-4zxhs"]
Sep 07 12:23:15.937131 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:15.937043    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins" containerID="cri-o://a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" gracePeriod=30
Sep 07 12:23:16.267406 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:16.267385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 12:23:16.515710 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:16.515611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-mhm8v" event={"ID":"6fe8eac0-53c9-4fd8-aa25-e19c6db02536","Type":"ContainerStarted","Data":"dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121"}
Sep 07 12:23:16.515710 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:16.515673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-mhm8v" event={"ID":"6fe8eac0-53c9-4fd8-aa25-e19c6db02536","Type":"ContainerStarted","Data":"7de413bd3888067305459c08d39ce7ff61d1ab197db3c744dce92f2c38a31b5f"}
Sep 07 12:23:16.516167 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:16.515802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:16.535477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:16.535429    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c8f7b977-mhm8v" podStartSLOduration=33.918856186 podStartE2EDuration="34.535414761s" totalImagesPullingTime="616.558575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:23:16.534223776 +0000 UTC m=+2171.671975088" watchObservedRunningTime="2026-09-07 12:23:16.535414761 +0000 UTC m=+2171.673166083"
Sep 07 12:23:25.453125 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:25.453076    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:25.454077 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:25.454049    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:25.454976 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:25.454945    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:25.455052 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:25.454990    2560 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins" probeResult="unknown"
Sep 07 12:23:27.523606 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:27.523569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:35.453255 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:35.453209    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:35.454180 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:35.454145    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:35.455121 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:35.455092    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:35.455245 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:35.455135    2560 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins" probeResult="unknown"
Sep 07 12:23:38.932300 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:38.932258    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-mhm8v"]
Sep 07 12:23:38.932725 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:38.932498    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85c8f7b977-mhm8v" podUID="6fe8eac0-53c9-4fd8-aa25-e19c6db02536" containerName="manager" containerID="cri-o://dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121" gracePeriod=30
Sep 07 12:23:39.187065 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.187006    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:39.257018 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.256988    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-webhook-cert\") pod \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") "
Sep 07 12:23:39.257198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.257060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl92s\" (UniqueName: \"kubernetes.io/projected/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-kube-api-access-gl92s\") pod \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") "
Sep 07 12:23:39.257198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.257088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-metrics-certs\") pod \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\" (UID: \"6fe8eac0-53c9-4fd8-aa25-e19c6db02536\") "
Sep 07 12:23:39.259314 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.259276    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6fe8eac0-53c9-4fd8-aa25-e19c6db02536" (UID: "6fe8eac0-53c9-4fd8-aa25-e19c6db02536"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:23:39.259477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.259400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6fe8eac0-53c9-4fd8-aa25-e19c6db02536" (UID: "6fe8eac0-53c9-4fd8-aa25-e19c6db02536"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:23:39.259477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.259422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-kube-api-access-gl92s" (OuterVolumeSpecName: "kube-api-access-gl92s") pod "6fe8eac0-53c9-4fd8-aa25-e19c6db02536" (UID: "6fe8eac0-53c9-4fd8-aa25-e19c6db02536"). InnerVolumeSpecName "kube-api-access-gl92s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:23:39.357762 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.357728    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-webhook-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:39.357762 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.357757    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl92s\" (UniqueName: \"kubernetes.io/projected/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-kube-api-access-gl92s\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:39.357762 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.357769    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe8eac0-53c9-4fd8-aa25-e19c6db02536-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:39.654421 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.654388    2560 generic.go:356] "Generic (PLEG): container finished" podID="6fe8eac0-53c9-4fd8-aa25-e19c6db02536" containerID="dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121" exitCode=0
Sep 07 12:23:39.654603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.654448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-mhm8v" event={"ID":"6fe8eac0-53c9-4fd8-aa25-e19c6db02536","Type":"ContainerDied","Data":"dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121"}
Sep 07 12:23:39.654603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.654469    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-mhm8v"
Sep 07 12:23:39.654603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.654489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-mhm8v" event={"ID":"6fe8eac0-53c9-4fd8-aa25-e19c6db02536","Type":"ContainerDied","Data":"7de413bd3888067305459c08d39ce7ff61d1ab197db3c744dce92f2c38a31b5f"}
Sep 07 12:23:39.654603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.654513    2560 scope.go:117] "RemoveContainer" containerID="dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121"
Sep 07 12:23:39.663927 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.663905    2560 scope.go:117] "RemoveContainer" containerID="dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121"
Sep 07 12:23:39.664210 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:39.664188    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121\": container with ID starting with dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121 not found: ID does not exist" containerID="dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121"
Sep 07 12:23:39.664290 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.664217    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121"} err="failed to get container status \"dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121\": rpc error: code = NotFound desc = could not find container \"dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121\": container with ID starting with dbc8470b136441719aa3c246ebc08cf2fb21f8fb79dc8c0d14bba30233ab4121 not found: ID does not exist"
Sep 07 12:23:39.671187 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.671164    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-mhm8v"]
Sep 07 12:23:39.676404 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:39.676381    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-mhm8v"]
Sep 07 12:23:40.482908 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.482875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c8f7b977-k486w"]
Sep 07 12:23:40.483413 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.483385    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe8eac0-53c9-4fd8-aa25-e19c6db02536" containerName="manager"
Sep 07 12:23:40.483413 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.483405    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe8eac0-53c9-4fd8-aa25-e19c6db02536" containerName="manager"
Sep 07 12:23:40.483593 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.483572    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe8eac0-53c9-4fd8-aa25-e19c6db02536" containerName="manager"
Sep 07 12:23:40.488006 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.487989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.491570 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.491547    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 12:23:40.491853 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.491838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 12:23:40.491914 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.491896    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zmfq\""
Sep 07 12:23:40.491959 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.491902    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 12:23:40.496529 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.496508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-k486w"]
Sep 07 12:23:40.570971 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.570933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33dd7c2f-787d-4683-a1a6-44661e114d36-metrics-certs\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.570971 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.570969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33dd7c2f-787d-4683-a1a6-44661e114d36-webhook-cert\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.571167 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.570988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftgps\" (UniqueName: \"kubernetes.io/projected/33dd7c2f-787d-4683-a1a6-44661e114d36-kube-api-access-ftgps\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.672304 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.672269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33dd7c2f-787d-4683-a1a6-44661e114d36-metrics-certs\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.672304 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.672306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33dd7c2f-787d-4683-a1a6-44661e114d36-webhook-cert\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.672587 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.672324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftgps\" (UniqueName: \"kubernetes.io/projected/33dd7c2f-787d-4683-a1a6-44661e114d36-kube-api-access-ftgps\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.674800 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.674776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33dd7c2f-787d-4683-a1a6-44661e114d36-webhook-cert\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.674926 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.674832    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33dd7c2f-787d-4683-a1a6-44661e114d36-metrics-certs\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.680603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.680578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftgps\" (UniqueName: \"kubernetes.io/projected/33dd7c2f-787d-4683-a1a6-44661e114d36-kube-api-access-ftgps\") pod \"maas-controller-85c8f7b977-k486w\" (UID: \"33dd7c2f-787d-4683-a1a6-44661e114d36\") " pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:40.800133 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:40.800050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:41.071229 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:41.071202    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c8f7b977-k486w"]
Sep 07 12:23:41.072751 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:23:41.072724    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33dd7c2f_787d_4683_a1a6_44661e114d36.slice/crio-0cc20ac84a04fe8d71820d8375686b0e082af3c4df160bc9e9dc5535135afd49 WatchSource:0}: Error finding container 0cc20ac84a04fe8d71820d8375686b0e082af3c4df160bc9e9dc5535135afd49: Status 404 returned error can't find the container with id 0cc20ac84a04fe8d71820d8375686b0e082af3c4df160bc9e9dc5535135afd49
Sep 07 12:23:41.360053 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:41.360026    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe8eac0-53c9-4fd8-aa25-e19c6db02536" path="/var/lib/kubelet/pods/6fe8eac0-53c9-4fd8-aa25-e19c6db02536/volumes"
Sep 07 12:23:41.672891 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:41.672852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-k486w" event={"ID":"33dd7c2f-787d-4683-a1a6-44661e114d36","Type":"ContainerStarted","Data":"25b1d1156132ef83f0899b0ed760fb96846cf73961b64e4dae5f042724b5ccef"}
Sep 07 12:23:41.673376 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:41.672916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c8f7b977-k486w" event={"ID":"33dd7c2f-787d-4683-a1a6-44661e114d36","Type":"ContainerStarted","Data":"0cc20ac84a04fe8d71820d8375686b0e082af3c4df160bc9e9dc5535135afd49"}
Sep 07 12:23:41.673376 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:41.672944    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:23:41.690414 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:41.690361    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c8f7b977-k486w" podStartSLOduration=1.177419016 podStartE2EDuration="1.690321686s" totalImagesPullingTime="512.90267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:23:41.68964306 +0000 UTC m=+2196.827394373" watchObservedRunningTime="2026-09-07 12:23:41.690321686 +0000 UTC m=+2196.828072998"
Sep 07 12:23:45.453396 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:45.453328    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:45.454373 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:45.454322    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:45.455235 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:45.455209    2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" cmd=["/bin/bash","-c","test -f /ready/ready"]
Sep 07 12:23:45.455303 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:45.455247    2560 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins" probeResult="unknown"
Sep 07 12:23:46.021943 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.021918    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-4zxhs_39a47c29-63fd-4812-8b13-060d2013591f/kube-multus-additional-cni-plugins/0.log"
Sep 07 12:23:46.024447 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.024430    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:46.124689 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.124651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39a47c29-63fd-4812-8b13-060d2013591f-cni-sysctl-allowlist\") pod \"39a47c29-63fd-4812-8b13-060d2013591f\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") "
Sep 07 12:23:46.124892 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.124755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/39a47c29-63fd-4812-8b13-060d2013591f-ready\") pod \"39a47c29-63fd-4812-8b13-060d2013591f\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") "
Sep 07 12:23:46.124892 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.124800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wktwz\" (UniqueName: \"kubernetes.io/projected/39a47c29-63fd-4812-8b13-060d2013591f-kube-api-access-wktwz\") pod \"39a47c29-63fd-4812-8b13-060d2013591f\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") "
Sep 07 12:23:46.124892 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.124823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a47c29-63fd-4812-8b13-060d2013591f-tuning-conf-dir\") pod \"39a47c29-63fd-4812-8b13-060d2013591f\" (UID: \"39a47c29-63fd-4812-8b13-060d2013591f\") "
Sep 07 12:23:46.125080 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.124950    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/39a47c29-63fd-4812-8b13-060d2013591f-tuning-conf-dir" (OuterVolumeSpecName: "tuning-conf-dir") pod "39a47c29-63fd-4812-8b13-060d2013591f" (UID: "39a47c29-63fd-4812-8b13-060d2013591f"). InnerVolumeSpecName "tuning-conf-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Sep 07 12:23:46.125080 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.125020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a47c29-63fd-4812-8b13-060d2013591f-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "39a47c29-63fd-4812-8b13-060d2013591f" (UID: "39a47c29-63fd-4812-8b13-060d2013591f"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:23:46.125080 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.125062    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a47c29-63fd-4812-8b13-060d2013591f-ready" (OuterVolumeSpecName: "ready") pod "39a47c29-63fd-4812-8b13-060d2013591f" (UID: "39a47c29-63fd-4812-8b13-060d2013591f"). InnerVolumeSpecName "ready". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:23:46.125272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.125157    2560 reconciler_common.go:299] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39a47c29-63fd-4812-8b13-060d2013591f-cni-sysctl-allowlist\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:46.125272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.125176    2560 reconciler_common.go:299] "Volume detached for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/39a47c29-63fd-4812-8b13-060d2013591f-ready\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:46.125272 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.125190    2560 reconciler_common.go:299] "Volume detached for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a47c29-63fd-4812-8b13-060d2013591f-tuning-conf-dir\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:46.127033 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.127008    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a47c29-63fd-4812-8b13-060d2013591f-kube-api-access-wktwz" (OuterVolumeSpecName: "kube-api-access-wktwz") pod "39a47c29-63fd-4812-8b13-060d2013591f" (UID: "39a47c29-63fd-4812-8b13-060d2013591f"). InnerVolumeSpecName "kube-api-access-wktwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:23:46.225856 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.225792    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wktwz\" (UniqueName: \"kubernetes.io/projected/39a47c29-63fd-4812-8b13-060d2013591f-kube-api-access-wktwz\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:23:46.709371 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.709329    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-4zxhs_39a47c29-63fd-4812-8b13-060d2013591f/kube-multus-additional-cni-plugins/0.log"
Sep 07 12:23:46.709795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.709386    2560 generic.go:356] "Generic (PLEG): container finished" podID="39a47c29-63fd-4812-8b13-060d2013591f" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9" exitCode=137
Sep 07 12:23:46.709795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.709437    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs"
Sep 07 12:23:46.709795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.709482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" event={"ID":"39a47c29-63fd-4812-8b13-060d2013591f","Type":"ContainerDied","Data":"a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9"}
Sep 07 12:23:46.709795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.709536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-4zxhs" event={"ID":"39a47c29-63fd-4812-8b13-060d2013591f","Type":"ContainerDied","Data":"1095e688436ae8d1db022f0d22782065db6e6d9bea8af650265bc103c83ca291"}
Sep 07 12:23:46.709795 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.709559    2560 scope.go:117] "RemoveContainer" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9"
Sep 07 12:23:46.719113 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.719095    2560 scope.go:117] "RemoveContainer" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9"
Sep 07 12:23:46.719394 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:23:46.719376    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9\": container with ID starting with a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9 not found: ID does not exist" containerID="a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9"
Sep 07 12:23:46.719453 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.719404    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9"} err="failed to get container status \"a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9\": rpc error: code = NotFound desc = could not find container \"a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9\": container with ID starting with a4646fd581190470ab8516079049de17556351e37a8317e1ebbf80e8f9a2a4f9 not found: ID does not exist"
Sep 07 12:23:46.730375 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.730355    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-4zxhs"]
Sep 07 12:23:46.734214 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:46.734193    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-4zxhs"]
Sep 07 12:23:47.359163 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:47.359117    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a47c29-63fd-4812-8b13-060d2013591f" path="/var/lib/kubelet/pods/39a47c29-63fd-4812-8b13-060d2013591f/volumes"
Sep 07 12:23:52.688799 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:23:52.688763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c8f7b977-k486w"
Sep 07 12:25:02.016254 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.016213    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"]
Sep 07 12:25:02.016775 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.016448    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8" podUID="956a6fff-e6dc-46cd-8f32-ea033d88072e" containerName="manager" containerID="cri-o://a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11" gracePeriod=10
Sep 07 12:25:02.773302 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.773279    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 12:25:02.913882 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.913846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/956a6fff-e6dc-46cd-8f32-ea033d88072e-extensions-socket-volume\") pod \"956a6fff-e6dc-46cd-8f32-ea033d88072e\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") "
Sep 07 12:25:02.914060 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.913993    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tznx6\" (UniqueName: \"kubernetes.io/projected/956a6fff-e6dc-46cd-8f32-ea033d88072e-kube-api-access-tznx6\") pod \"956a6fff-e6dc-46cd-8f32-ea033d88072e\" (UID: \"956a6fff-e6dc-46cd-8f32-ea033d88072e\") "
Sep 07 12:25:02.914280 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.914247    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956a6fff-e6dc-46cd-8f32-ea033d88072e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "956a6fff-e6dc-46cd-8f32-ea033d88072e" (UID: "956a6fff-e6dc-46cd-8f32-ea033d88072e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:25:02.915963 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:02.915942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956a6fff-e6dc-46cd-8f32-ea033d88072e-kube-api-access-tznx6" (OuterVolumeSpecName: "kube-api-access-tznx6") pod "956a6fff-e6dc-46cd-8f32-ea033d88072e" (UID: "956a6fff-e6dc-46cd-8f32-ea033d88072e"). InnerVolumeSpecName "kube-api-access-tznx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:25:03.015388 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.015332    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tznx6\" (UniqueName: \"kubernetes.io/projected/956a6fff-e6dc-46cd-8f32-ea033d88072e-kube-api-access-tznx6\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:25:03.015388 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.015391    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/956a6fff-e6dc-46cd-8f32-ea033d88072e-extensions-socket-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:25:03.150828 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.150795    2560 generic.go:356] "Generic (PLEG): container finished" podID="956a6fff-e6dc-46cd-8f32-ea033d88072e" containerID="a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11" exitCode=0
Sep 07 12:25:03.150828 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.150830    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"
Sep 07 12:25:03.151296 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.150869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8" event={"ID":"956a6fff-e6dc-46cd-8f32-ea033d88072e","Type":"ContainerDied","Data":"a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11"}
Sep 07 12:25:03.151296 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.150916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8" event={"ID":"956a6fff-e6dc-46cd-8f32-ea033d88072e","Type":"ContainerDied","Data":"4ac913a112e7541843aac7a9b1bb051a6d55cd63e4ea183f3a99d254da8de123"}
Sep 07 12:25:03.151296 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.150939    2560 scope.go:117] "RemoveContainer" containerID="a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11"
Sep 07 12:25:03.162022 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.162004    2560 scope.go:117] "RemoveContainer" containerID="a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11"
Sep 07 12:25:03.162315 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:25:03.162295    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11\": container with ID starting with a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11 not found: ID does not exist" containerID="a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11"
Sep 07 12:25:03.162774 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.162324    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11"} err="failed to get container status \"a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11\": rpc error: code = NotFound desc = could not find container \"a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11\": container with ID starting with a62e18277f6e47f2065560c77d21c5e33eeff265fe21704fba55d5bf6c716a11 not found: ID does not exist"
Sep 07 12:25:03.181454 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.181384    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"]
Sep 07 12:25:03.185502 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.185479    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p4hg8"]
Sep 07 12:25:03.359499 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:25:03.359465    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956a6fff-e6dc-46cd-8f32-ea033d88072e" path="/var/lib/kubelet/pods/956a6fff-e6dc-46cd-8f32-ea033d88072e/volumes"
Sep 07 12:26:02.718382 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718320    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"]
Sep 07 12:26:02.718846 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718775    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins"
Sep 07 12:26:02.718846 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718791    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins"
Sep 07 12:26:02.718846 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718801    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956a6fff-e6dc-46cd-8f32-ea033d88072e" containerName="manager"
Sep 07 12:26:02.718846 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718808    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="956a6fff-e6dc-46cd-8f32-ea033d88072e" containerName="manager"
Sep 07 12:26:02.718983 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718874    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="956a6fff-e6dc-46cd-8f32-ea033d88072e" containerName="manager"
Sep 07 12:26:02.718983 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.718885    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a47c29-63fd-4812-8b13-060d2013591f" containerName="kube-multus-additional-cni-plugins"
Sep 07 12:26:02.721051 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.721031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:02.723384 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.723364    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2dg9j\""
Sep 07 12:26:02.739428 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.739388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"]
Sep 07 12:26:02.837761 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.837716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snfr9\" (UniqueName: \"kubernetes.io/projected/591811cb-0dea-4cab-b9b5-511ae7eaefcd-kube-api-access-snfr9\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-lcvn8\" (UID: \"591811cb-0dea-4cab-b9b5-511ae7eaefcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:02.837940 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.837798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/591811cb-0dea-4cab-b9b5-511ae7eaefcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-lcvn8\" (UID: \"591811cb-0dea-4cab-b9b5-511ae7eaefcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:02.939034 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.938987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/591811cb-0dea-4cab-b9b5-511ae7eaefcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-lcvn8\" (UID: \"591811cb-0dea-4cab-b9b5-511ae7eaefcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:02.939233 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.939101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snfr9\" (UniqueName: \"kubernetes.io/projected/591811cb-0dea-4cab-b9b5-511ae7eaefcd-kube-api-access-snfr9\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-lcvn8\" (UID: \"591811cb-0dea-4cab-b9b5-511ae7eaefcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:02.939441 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.939417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/591811cb-0dea-4cab-b9b5-511ae7eaefcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-lcvn8\" (UID: \"591811cb-0dea-4cab-b9b5-511ae7eaefcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:02.947001 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:02.946970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snfr9\" (UniqueName: \"kubernetes.io/projected/591811cb-0dea-4cab-b9b5-511ae7eaefcd-kube-api-access-snfr9\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-lcvn8\" (UID: \"591811cb-0dea-4cab-b9b5-511ae7eaefcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:03.036057 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:03.035956    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:03.311273 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:03.311229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"]
Sep 07 12:26:03.312460 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:26:03.312434    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591811cb_0dea_4cab_b9b5_511ae7eaefcd.slice/crio-2da1be3162350d6a7bfab17d50111ba9a6e0fa8252f8b5edc206918208de504d WatchSource:0}: Error finding container 2da1be3162350d6a7bfab17d50111ba9a6e0fa8252f8b5edc206918208de504d: Status 404 returned error can't find the container with id 2da1be3162350d6a7bfab17d50111ba9a6e0fa8252f8b5edc206918208de504d
Sep 07 12:26:03.493090 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:03.493055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8" event={"ID":"591811cb-0dea-4cab-b9b5-511ae7eaefcd","Type":"ContainerStarted","Data":"7a4a76aa056862cfd651e87e02d28828780a069b04bce742b2f78eaf8f759563"}
Sep 07 12:26:03.493270 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:03.493111    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8" event={"ID":"591811cb-0dea-4cab-b9b5-511ae7eaefcd","Type":"ContainerStarted","Data":"2da1be3162350d6a7bfab17d50111ba9a6e0fa8252f8b5edc206918208de504d"}
Sep 07 12:26:03.493270 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:03.493196    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:26:03.516691 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:03.516633    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8" podStartSLOduration=1.516615109 podStartE2EDuration="1.516615109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:26:03.513702784 +0000 UTC m=+2338.651454086" watchObservedRunningTime="2026-09-07 12:26:03.516615109 +0000 UTC m=+2338.654366420"
Sep 07 12:26:14.501195 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:26:14.501161    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-lcvn8"
Sep 07 12:27:39.710445 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.710393    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"]
Sep 07 12:27:39.714153 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.714130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.726571 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.726541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"]
Sep 07 12:27:39.833929 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.833889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-metrics-certs\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.834115 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.833945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2zdf\" (UniqueName: \"kubernetes.io/projected/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-kube-api-access-x2zdf\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.834115 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.834032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-openshift-service-ca\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.834115 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.834066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-maas-api-tls\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.935445 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.935409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-openshift-service-ca\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.935628 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.935457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-maas-api-tls\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.935628 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.935521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-metrics-certs\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.935628 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.935549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2zdf\" (UniqueName: \"kubernetes.io/projected/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-kube-api-access-x2zdf\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.936113 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.936088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-openshift-service-ca\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.937996 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.937969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-maas-api-tls\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.938104 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.938064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-metrics-certs\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:39.942505 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:39.942479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2zdf\" (UniqueName: \"kubernetes.io/projected/1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8-kube-api-access-x2zdf\") pod \"maas-api-59894548fc-7hkdd\" (UID: \"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8\") " pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:40.028180 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:40.028070    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:40.305990 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:40.305957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"]
Sep 07 12:27:40.308164 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:27:40.308129    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bafbfa5_3aaa_4634_a2f5_3ce4c5cf8fa8.slice/crio-3664c422a66ba89d86188e24dcf2a0e1b8965254383038b942c635ea1d3e8254 WatchSource:0}: Error finding container 3664c422a66ba89d86188e24dcf2a0e1b8965254383038b942c635ea1d3e8254: Status 404 returned error can't find the container with id 3664c422a66ba89d86188e24dcf2a0e1b8965254383038b942c635ea1d3e8254
Sep 07 12:27:41.069065 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:41.068988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd" event={"ID":"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8","Type":"ContainerStarted","Data":"b70682305a3e9b96a1d88a77cf040d6e4949b1700d95fa60779e8a55711239a9"}
Sep 07 12:27:41.069065 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:41.069043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd" event={"ID":"1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8","Type":"ContainerStarted","Data":"3664c422a66ba89d86188e24dcf2a0e1b8965254383038b942c635ea1d3e8254"}
Sep 07 12:27:41.069479 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:41.069117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:41.087085 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:41.087034    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd" podStartSLOduration=1.680183624 podStartE2EDuration="2.08701917s" totalImagesPullingTime="406.835546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:27:41.084200651 +0000 UTC m=+2436.221951962" watchObservedRunningTime="2026-09-07 12:27:41.08701917 +0000 UTC m=+2436.224770481"
Sep 07 12:27:47.081038 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:47.081001    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59894548fc-7hkdd"
Sep 07 12:27:56.380860 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:56.380817    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"]
Sep 07 12:27:56.381289 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:56.381053    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9" podUID="cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" containerName="maas-api" containerID="cri-o://2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf" gracePeriod=30
Sep 07 12:27:57.626936 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.626906    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:27:57.816244 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.816133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-openshift-service-ca\") pod \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") "
Sep 07 12:27:57.816461 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.816285    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msktn\" (UniqueName: \"kubernetes.io/projected/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-kube-api-access-msktn\") pod \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") "
Sep 07 12:27:57.816461 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.816391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs\") pod \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") "
Sep 07 12:27:57.816461 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.816434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-maas-api-tls\") pod \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\" (UID: \"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f\") "
Sep 07 12:27:57.816636 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.816499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" (UID: "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:27:57.816781 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.816762    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-openshift-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:27:57.818611 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.818569    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" (UID: "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:27:57.818611 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.818600    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-kube-api-access-msktn" (OuterVolumeSpecName: "kube-api-access-msktn") pod "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" (UID: "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f"). InnerVolumeSpecName "kube-api-access-msktn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:27:57.818771 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.818647    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" (UID: "cdc6ed91-8b22-4b3a-a2ef-884d92fd578f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:27:57.917714 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.917674    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-maas-api-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:27:57.917714 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.917707    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msktn\" (UniqueName: \"kubernetes.io/projected/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-kube-api-access-msktn\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:27:57.917714 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:57.917717    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f-metrics-certs\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\""
Sep 07 12:27:58.183558 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.183518    2560 generic.go:356] "Generic (PLEG): container finished" podID="cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" containerID="2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf" exitCode=0
Sep 07 12:27:58.183739 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.183565    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"
Sep 07 12:27:58.183739 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.183601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9" event={"ID":"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f","Type":"ContainerDied","Data":"2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf"}
Sep 07 12:27:58.183739 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.183660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9" event={"ID":"cdc6ed91-8b22-4b3a-a2ef-884d92fd578f","Type":"ContainerDied","Data":"05886b01e6fd34147d3b1da50ccb0e3a1b996961f73e09093db45bfee6a0bdd7"}
Sep 07 12:27:58.183739 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.183683    2560 scope.go:117] "RemoveContainer" containerID="2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf"
Sep 07 12:27:58.194021 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.194000    2560 scope.go:117] "RemoveContainer" containerID="2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf"
Sep 07 12:27:58.194332 ip-10-0-138-55 kubenswrapper[2560]: E0907 12:27:58.194313    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf\": container with ID starting with 2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf not found: ID does not exist" containerID="2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf"
Sep 07 12:27:58.194412 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.194379    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf"} err="failed to get container status \"2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf\": rpc error: code = NotFound desc = could not find container \"2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf\": container with ID starting with 2f9d7c979b8faccce69d81f58950cc5f4717be6d917dfe373b17383faf7da7cf not found: ID does not exist"
Sep 07 12:27:58.205707 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.205676    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"]
Sep 07 12:27:58.208853 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:58.208828    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8cd4c9f7c-q2cf9"]
Sep 07 12:27:59.359872 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:27:59.359840    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" path="/var/lib/kubelet/pods/cdc6ed91-8b22-4b3a-a2ef-884d92fd578f/volumes"
Sep 07 12:28:16.615477 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:16.615440    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dkgmc_c3191588-9590-4330-97bb-23cf395c37ac/manager/0.log"
Sep 07 12:28:16.726082 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:16.726033    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xnpf2_d8ec3208-7aac-4ea8-a4c3-d82921e60d12/manager/0.log"
Sep 07 12:28:16.839209 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:16.839174    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85c8f7b977-k486w_33dd7c2f-787d-4683-a1a6-44661e114d36/manager/0.log"
Sep 07 12:28:16.946536 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:16.946464    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-f2xzf_8b64b71e-492a-4480-ae60-79c883d6e074/server/0.log"
Sep 07 12:28:17.064807 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:17.064772    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pnggk_d87168b8-505c-409f-98d6-9e7a9ed8ae48/manager/0.log"
Sep 07 12:28:17.433150 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:17.433122    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-648db6df7b-xr9bt_52c11e2e-1b68-4905-a009-48ec0453249a/copy-manifests/0.log"
Sep 07 12:28:17.438039 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:17.438018    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-648db6df7b-xr9bt_52c11e2e-1b68-4905-a009-48ec0453249a/manager/0.log"
Sep 07 12:28:17.864294 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:17.864270    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59894548fc-7hkdd_1bafbfa5-3aaa-4634-a2f5-3ce4c5cf8fa8/maas-api/0.log"
Sep 07 12:28:18.078615 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:18.078583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-66zk9_610b7e87-bd6f-4403-ae83-b92320a0d6e6/postgres/0.log"
Sep 07 12:28:18.939963 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:18.939926    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-jnhtv_6a747e2b-6040-4feb-a546-4529d5257788/manager/0.log"
Sep 07 12:28:19.047240 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:19.047211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-247b6_9dc39ce9-2ba3-4287-a5a4-99e5a936599e/manager/0.log"
Sep 07 12:28:19.154972 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:19.154946    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-b26pp_ed0af58a-879d-4d9d-a0aa-279d1f0f193c/kuadrant-console-plugin/0.log"
Sep 07 12:28:19.270767 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:19.270683    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-lcvn8_591811cb-0dea-4cab-b9b5-511ae7eaefcd/manager/0.log"
Sep 07 12:28:19.515060 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:19.515026    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-8nb2k_e1bdb821-c0ef-4dff-9bc4-fd04407660db/manager/0.log"
Sep 07 12:28:20.182721 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:20.182687    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6777d477-m8cjc_fb860421-e6dc-42f8-ac6e-92eafe6e46f8/kube-auth-proxy/0.log"
Sep 07 12:28:20.415321 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:20.415293    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-krsvl_25a67076-12d5-4178-9e36-05bef0704c2a/payload-pre-processing/0.log"
Sep 07 12:28:20.645046 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:20.645002    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55cf46dd-927gj_7235ec47-e695-43e9-8166-b826e9a950f3/router/0.log"
Sep 07 12:28:20.981701 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:20.981618    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2z7c4_7c037955-5473-434d-aeb6-ea57d62eea36/main/0.log"
Sep 07 12:28:21.407533 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:21.407496    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc5jk4_1dc5de84-1f8f-4670-8091-1bdeb09bff3d/main/0.log"
Sep 07 12:28:26.685036 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.685002    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzv24/must-gather-c52ks"]
Sep 07 12:28:26.685464 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.685450    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" containerName="maas-api"
Sep 07 12:28:26.685514 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.685465    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" containerName="maas-api"
Sep 07 12:28:26.685557 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.685547    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc6ed91-8b22-4b3a-a2ef-884d92fd578f" containerName="maas-api"
Sep 07 12:28:26.688803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.688786    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.691236 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.691210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzv24\"/\"kube-root-ca.crt\""
Sep 07 12:28:26.691416 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.691208    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzv24\"/\"openshift-service-ca.crt\""
Sep 07 12:28:26.692115 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.692098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bzv24\"/\"default-dockercfg-fprf9\""
Sep 07 12:28:26.697573 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.697552    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzv24/must-gather-c52ks"]
Sep 07 12:28:26.789680 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.789640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhqv\" (UniqueName: \"kubernetes.io/projected/5cf5d01f-1905-40d0-b92f-a32c2b679775-kube-api-access-jhhqv\") pod \"must-gather-c52ks\" (UID: \"5cf5d01f-1905-40d0-b92f-a32c2b679775\") " pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.789862 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.789695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5cf5d01f-1905-40d0-b92f-a32c2b679775-must-gather-output\") pod \"must-gather-c52ks\" (UID: \"5cf5d01f-1905-40d0-b92f-a32c2b679775\") " pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.890360 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.890290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhqv\" (UniqueName: \"kubernetes.io/projected/5cf5d01f-1905-40d0-b92f-a32c2b679775-kube-api-access-jhhqv\") pod \"must-gather-c52ks\" (UID: \"5cf5d01f-1905-40d0-b92f-a32c2b679775\") " pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.890546 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.890387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5cf5d01f-1905-40d0-b92f-a32c2b679775-must-gather-output\") pod \"must-gather-c52ks\" (UID: \"5cf5d01f-1905-40d0-b92f-a32c2b679775\") " pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.890792 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.890767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5cf5d01f-1905-40d0-b92f-a32c2b679775-must-gather-output\") pod \"must-gather-c52ks\" (UID: \"5cf5d01f-1905-40d0-b92f-a32c2b679775\") " pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.897658 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.897630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhqv\" (UniqueName: \"kubernetes.io/projected/5cf5d01f-1905-40d0-b92f-a32c2b679775-kube-api-access-jhhqv\") pod \"must-gather-c52ks\" (UID: \"5cf5d01f-1905-40d0-b92f-a32c2b679775\") " pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:26.999493 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:26.999396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzv24/must-gather-c52ks"
Sep 07 12:28:27.274582 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:27.274554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzv24/must-gather-c52ks"]
Sep 07 12:28:27.275681 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:28:27.275657    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cf5d01f_1905_40d0_b92f_a32c2b679775.slice/crio-f36000265ec4907177f1bb9886da9cc61b10bb75f4855a6ebb68eff8b91a4d61 WatchSource:0}: Error finding container f36000265ec4907177f1bb9886da9cc61b10bb75f4855a6ebb68eff8b91a4d61: Status 404 returned error can't find the container with id f36000265ec4907177f1bb9886da9cc61b10bb75f4855a6ebb68eff8b91a4d61
Sep 07 12:28:27.277803 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:27.277786    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:28:27.359779 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:27.359745    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzv24/must-gather-c52ks" event={"ID":"5cf5d01f-1905-40d0-b92f-a32c2b679775","Type":"ContainerStarted","Data":"f36000265ec4907177f1bb9886da9cc61b10bb75f4855a6ebb68eff8b91a4d61"}
Sep 07 12:28:29.371673 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:29.371634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzv24/must-gather-c52ks" event={"ID":"5cf5d01f-1905-40d0-b92f-a32c2b679775","Type":"ContainerStarted","Data":"0542fd0641f163de1056c4b50369e2ed8641f8d01de59313c53eb75d7a8c0d9a"}
Sep 07 12:28:29.372114 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:29.371686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzv24/must-gather-c52ks" event={"ID":"5cf5d01f-1905-40d0-b92f-a32c2b679775","Type":"ContainerStarted","Data":"c347de8828508a5f54c7f5836dcc050b664a9e4dfae43515920336c56a768e2f"}
Sep 07 12:28:29.391252 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:29.391185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bzv24/must-gather-c52ks" podStartSLOduration=2.322464564 podStartE2EDuration="3.39116324s" totalImagesPullingTime="1.068698676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:28:29.387105347 +0000 UTC m=+2484.524856659" watchObservedRunningTime="2026-09-07 12:28:29.39116324 +0000 UTC m=+2484.528914552"
Sep 07 12:28:29.969511 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:29.969478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gzsd2_143741c1-926c-4aa7-bc16-798a7755855e/global-pull-secret-syncer/0.log"
Sep 07 12:28:30.124683 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:30.124650    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vmzt4_3c055eba-e3d2-4351-85f5-ce751ca99cd9/konnectivity-agent/0.log"
Sep 07 12:28:30.185995 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:30.185958    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-55.ec2.internal_dd0fc6289a29b5498b2afc90aad27f10/haproxy/0.log"
Sep 07 12:28:35.000071 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:35.000029    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-jnhtv_6a747e2b-6040-4feb-a546-4529d5257788/manager/0.log"
Sep 07 12:28:35.027583 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:35.027544    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-247b6_9dc39ce9-2ba3-4287-a5a4-99e5a936599e/manager/0.log"
Sep 07 12:28:35.055261 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:35.055215    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-b26pp_ed0af58a-879d-4d9d-a0aa-279d1f0f193c/kuadrant-console-plugin/0.log"
Sep 07 12:28:35.112130 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:35.112095    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-lcvn8_591811cb-0dea-4cab-b9b5-511ae7eaefcd/manager/0.log"
Sep 07 12:28:35.227759 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:35.225841    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-8nb2k_e1bdb821-c0ef-4dff-9bc4-fd04407660db/manager/0.log"
Sep 07 12:28:36.889877 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:36.889844    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-ldq2c_eeedb772-4594-4a22-bb4f-8b766d74b52e/cluster-monitoring-operator/0.log"
Sep 07 12:28:37.009979 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.009928    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-545fc5c959-wwv97_38f061c2-b2ad-4b4c-8db7-353f12102745/metrics-server/0.log"
Sep 07 12:28:37.219672 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.219542    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xwmnw_74f36382-e944-4561-9de7-e5cd212c0ef9/node-exporter/0.log"
Sep 07 12:28:37.252529 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.252484    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xwmnw_74f36382-e944-4561-9de7-e5cd212c0ef9/kube-rbac-proxy/0.log"
Sep 07 12:28:37.281095 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.281069    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xwmnw_74f36382-e944-4561-9de7-e5cd212c0ef9/init-textfile/0.log"
Sep 07 12:28:37.577330 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.577166    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-s267g_701ba2fd-0aa9-43c8-8105-50deaab41b59/prometheus-operator/0.log"
Sep 07 12:28:37.596316 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.596282    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-s267g_701ba2fd-0aa9-43c8-8105-50deaab41b59/kube-rbac-proxy/0.log"
Sep 07 12:28:37.623784 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:37.623754    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-z6l6z_8051e533-8967-4dfc-a489-f5183a4f73ec/prometheus-operator-admission-webhook/0.log"
Sep 07 12:28:39.266714 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:39.266683    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-74krb_5e198839-97a7-48df-b13e-3f2f216bff60/networking-console-plugin/0.log"
Sep 07 12:28:40.429014 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.428968    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"]
Sep 07 12:28:40.432902 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.432870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.440853 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.440789    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"]
Sep 07 12:28:40.467042 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.467004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bkjd\" (UniqueName: \"kubernetes.io/projected/b84af899-2c19-44ce-bdd4-8d7a29f177c8-kube-api-access-5bkjd\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.467042 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.467046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-lib-modules\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.467331 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.467098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-podres\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.467331 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.467131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-sys\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.467331 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.467154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-proc\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.495285 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.495257    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ddfb5445d-bxpcd_2444a14d-9a3f-4ad1-9a7a-204d59316c81/console/0.log"
Sep 07 12:28:40.540292 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.540246    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-89nmh_bb185c32-718c-41a6-aba4-45261affdab6/download-server/0.log"
Sep 07 12:28:40.568324 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.568284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-podres\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.568628 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.568593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-podres\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.568742 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.568722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-sys\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.568892 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.568872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-proc\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.569120 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.569104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bkjd\" (UniqueName: \"kubernetes.io/projected/b84af899-2c19-44ce-bdd4-8d7a29f177c8-kube-api-access-5bkjd\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.569625 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.569605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-lib-modules\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.569954 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.568760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-sys\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.570061 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.569028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-proc\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.570143 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.569838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b84af899-2c19-44ce-bdd4-8d7a29f177c8-lib-modules\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.578055 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.578031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bkjd\" (UniqueName: \"kubernetes.io/projected/b84af899-2c19-44ce-bdd4-8d7a29f177c8-kube-api-access-5bkjd\") pod \"perf-node-gather-daemonset-r4d2j\" (UID: \"b84af899-2c19-44ce-bdd4-8d7a29f177c8\") " pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:40.746207 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:40.746105    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:41.038358 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:41.038288    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"]
Sep 07 12:28:41.043322 ip-10-0-138-55 kubenswrapper[2560]: W0907 12:28:41.042967    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb84af899_2c19_44ce_bdd4_8d7a29f177c8.slice/crio-5aea7bbd47287c7e17ab4ffa144e692cd4b5b395d8253c6e3b59ea6ec6ac2f00 WatchSource:0}: Error finding container 5aea7bbd47287c7e17ab4ffa144e692cd4b5b395d8253c6e3b59ea6ec6ac2f00: Status 404 returned error can't find the container with id 5aea7bbd47287c7e17ab4ffa144e692cd4b5b395d8253c6e3b59ea6ec6ac2f00
Sep 07 12:28:41.495095 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:41.495046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j" event={"ID":"b84af899-2c19-44ce-bdd4-8d7a29f177c8","Type":"ContainerStarted","Data":"6afc21355cf7112122028b58b2caa76cedad72720ae53c3e22f23fa3cbcfff4f"}
Sep 07 12:28:41.495603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:41.495122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:41.495603 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:41.495141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j" event={"ID":"b84af899-2c19-44ce-bdd4-8d7a29f177c8","Type":"ContainerStarted","Data":"5aea7bbd47287c7e17ab4ffa144e692cd4b5b395d8253c6e3b59ea6ec6ac2f00"}
Sep 07 12:28:41.513088 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:41.513018    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j" podStartSLOduration=1.512995088 podStartE2EDuration="1.512995088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:28:41.509459927 +0000 UTC m=+2496.647211240" watchObservedRunningTime="2026-09-07 12:28:41.512995088 +0000 UTC m=+2496.650746400"
Sep 07 12:28:42.430133 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:42.430104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvqpd_d4ec4b8f-28d1-4159-968f-b8c6f7265c34/dns/0.log"
Sep 07 12:28:42.450459 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:42.450420    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvqpd_d4ec4b8f-28d1-4159-968f-b8c6f7265c34/kube-rbac-proxy/0.log"
Sep 07 12:28:42.598511 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:42.598478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w5x8s_5bcbbe64-545e-4ab3-bf23-fc83244bfde3/dns-node-resolver/0.log"
Sep 07 12:28:43.208736 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:43.208707    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r5258_b9a433b1-a66c-40bd-a086-d4910afe958d/node-ca/0.log"
Sep 07 12:28:44.796299 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:44.796254    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6777d477-m8cjc_fb860421-e6dc-42f8-ac6e-92eafe6e46f8/kube-auth-proxy/0.log"
Sep 07 12:28:44.883248 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:44.883213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-krsvl_25a67076-12d5-4178-9e36-05bef0704c2a/payload-pre-processing/0.log"
Sep 07 12:28:44.951659 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:44.951619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55cf46dd-927gj_7235ec47-e695-43e9-8166-b826e9a950f3/router/0.log"
Sep 07 12:28:45.887979 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:45.887948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qglkr_6fa5a7e1-e148-4ec9-9da2-9549e4100826/serve-healthcheck-canary/0.log"
Sep 07 12:28:46.510098 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:46.510070    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5vkr_3dee941a-c72f-4a59-82c6-3baf53cbfe3c/kube-rbac-proxy/0.log"
Sep 07 12:28:46.529512 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:46.529478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5vkr_3dee941a-c72f-4a59-82c6-3baf53cbfe3c/exporter/0.log"
Sep 07 12:28:46.554867 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:46.554834    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5vkr_3dee941a-c72f-4a59-82c6-3baf53cbfe3c/extractor/0.log"
Sep 07 12:28:47.514281 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:47.514251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bzv24/perf-node-gather-daemonset-r4d2j"
Sep 07 12:28:48.717198 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:48.717164    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dkgmc_c3191588-9590-4330-97bb-23cf395c37ac/manager/0.log"
Sep 07 12:28:48.973791 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:48.973699    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xnpf2_d8ec3208-7aac-4ea8-a4c3-d82921e60d12/manager/0.log"
Sep 07 12:28:49.028701 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:49.028658    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85c8f7b977-k486w_33dd7c2f-787d-4683-a1a6-44661e114d36/manager/0.log"
Sep 07 12:28:49.050266 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:49.050226    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-f2xzf_8b64b71e-492a-4480-ae60-79c883d6e074/server/0.log"
Sep 07 12:28:49.150918 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:49.150885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pnggk_d87168b8-505c-409f-98d6-9e7a9ed8ae48/manager/0.log"
Sep 07 12:28:49.370191 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:49.370138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-648db6df7b-xr9bt_52c11e2e-1b68-4905-a009-48ec0453249a/manager/0.log"
Sep 07 12:28:49.391534 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:49.391506    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-648db6df7b-xr9bt_52c11e2e-1b68-4905-a009-48ec0453249a/copy-manifests/0.log"
Sep 07 12:28:51.474496 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:51.474466    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6777d477-m8cjc_fb860421-e6dc-42f8-ac6e-92eafe6e46f8/kube-auth-proxy/0.log"
Sep 07 12:28:51.543791 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:51.543756    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-krsvl_25a67076-12d5-4178-9e36-05bef0704c2a/payload-pre-processing/0.log"
Sep 07 12:28:51.597452 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:51.597416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55cf46dd-927gj_7235ec47-e695-43e9-8166-b826e9a950f3/router/0.log"
Sep 07 12:28:53.705511 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:53.705482    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6777d477-m8cjc_fb860421-e6dc-42f8-ac6e-92eafe6e46f8/kube-auth-proxy/0.log"
Sep 07 12:28:53.820793 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:53.820761    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-krsvl_25a67076-12d5-4178-9e36-05bef0704c2a/payload-pre-processing/0.log"
Sep 07 12:28:53.900762 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:53.900721    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55cf46dd-927gj_7235ec47-e695-43e9-8166-b826e9a950f3/router/0.log"
Sep 07 12:28:56.017529 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:56.017497    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-xsfrh_125b673a-f309-41cf-9aa8-eb3dd59d68df/migrator/0.log"
Sep 07 12:28:56.036208 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:56.036176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-xsfrh_125b673a-f309-41cf-9aa8-eb3dd59d68df/graceful-termination/0.log"
Sep 07 12:28:56.396807 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:56.396773    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c9x4g_e429c41e-8a91-41a3-961d-79c41b75df6e/kube-storage-version-migrator-operator/1.log"
Sep 07 12:28:56.397645 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:56.397626    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-c9x4g_e429c41e-8a91-41a3-961d-79c41b75df6e/kube-storage-version-migrator-operator/0.log"
Sep 07 12:28:57.741622 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.741511    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/kube-multus-additional-cni-plugins/0.log"
Sep 07 12:28:57.764153 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.764115    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/egress-router-binary-copy/0.log"
Sep 07 12:28:57.783261 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.783232    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/cni-plugins/0.log"
Sep 07 12:28:57.802098 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.802070    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/bond-cni-plugin/0.log"
Sep 07 12:28:57.820848 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.820820    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/routeoverride-cni/0.log"
Sep 07 12:28:57.839448 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.839418    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/whereabouts-cni-bincopy/0.log"
Sep 07 12:28:57.860917 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:57.860889    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpnfg_73337008-191e-4f5b-af2d-78d7a15904d3/whereabouts-cni/0.log"
Sep 07 12:28:58.016224 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:58.016139    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rdr2z_0232e709-d8fb-4854-a213-bdcf33d05175/kube-multus/0.log"
Sep 07 12:28:58.039645 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:58.039616    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2pg2r_38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c/network-metrics-daemon/0.log"
Sep 07 12:28:58.059426 ip-10-0-138-55 kubenswrapper[2560]: I0907 12:28:58.059398    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2pg2r_38e2941a-a8ea-4fe2-9dc9-c9deba0ecb3c/kube-rbac-proxy/0.log"