Jul 24 17:36:40.857275 ip-10-0-139-114 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:36:41.230181 ip-10-0-139-114 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:36:41.230181 ip-10-0-139-114 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:36:41.230181 ip-10-0-139-114 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:36:41.230181 ip-10-0-139-114 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:36:41.230181 ip-10-0-139-114 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:36:41.232527 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.232359    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:36:41.236116 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236101    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:36:41.236116 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236114    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236118    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236122    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236125    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236128    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236130    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236133    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236137    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236139    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236142    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236145    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236147    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236150    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236153    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236155    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236158    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236161    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236164    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236166    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236169    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:36:41.236178 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236176    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236179    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236183    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236185    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236188    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236192    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236194    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236197    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236199    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236202    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236205    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236207    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236210    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236213    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236215    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236218    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236221    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236223    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236226    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236234    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:36:41.236651 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236237    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236240    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236244    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236248    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236250    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236253    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236257    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236259    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236262    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236265    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236267    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236270    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236272    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236275    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236278    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236280    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236285    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236288    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236291    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:36:41.237143 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236293    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236296    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236298    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236302    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236304    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236307    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236309    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236312    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236314    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236317    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236319    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236322    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236325    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236327    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236330    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236332    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236334    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236337    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236339    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236342    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:36:41.237602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236345    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236348    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236350    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236353    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236356    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236358    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236361    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236364    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236366    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236369    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236372    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236376    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236378    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236381    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236384    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236387    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236389    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236392    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.236394    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:36:41.238085 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237103    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237110    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237113    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237116    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237119    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237122    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237126    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237130    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237134    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237137    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237140    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237143    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237146    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237149    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237152    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237155    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237158    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237160    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237163    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237165    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:36:41.238544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237169    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237172    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237174    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237178    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237180    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237183    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237185    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237188    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237191    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237193    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237195    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237198    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237200    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237203    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237206    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237208    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237211    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237213    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237216    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:36:41.239040 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237219    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237221    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237225    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237229    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237232    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237235    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237238    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237241    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237243    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237246    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237249    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237251    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237254    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237257    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237259    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237262    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237264    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237267    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237269    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:36:41.239516 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237272    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237274    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237277    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237279    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237282    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237284    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237287    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237289    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237292    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237294    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237296    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237299    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237301    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237304    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237307    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237309    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237313    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237316    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237320    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237323    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:36:41.239992 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237327    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237330    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237333    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237335    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237338    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237340    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237343    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237346    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237349    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237351    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237354    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237356    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237359    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237361    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237363    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237366    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237368    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237371    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237374    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237376    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:36:41.240502 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237379    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237734    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237740    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237743    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237747    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237751    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237754    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237758    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237760    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237763    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237766    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237768    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237771    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237774    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237777    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237779    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237782    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237784    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:36:41.241010 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237788    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237792    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237794    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237797    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237799    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237802    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237804    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237807    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237809    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237812    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237814    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237816    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237819    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237822    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237824    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237827    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237830    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237832    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237835    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237837    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:36:41.241465 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237841    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237844    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237846    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237848    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237852    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237854    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237857    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237859    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237861    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237864    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237866    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237869    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237874    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237877    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237879    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237882    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237885    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237887    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237890    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237892    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:36:41.241985 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237895    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237898    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237900    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237903    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237905    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237908    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237910    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237913    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237916    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237919    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237921    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237923    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237926    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237929    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237932    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237934    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237937    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237940    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237943    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237945    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:36:41.242550 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237948    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237950    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237953    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237955    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237959    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237962    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237964    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237967    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237969    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237972    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237974    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237977    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237979    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237981    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237984    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237986    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237989    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237991    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237994    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237996    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:36:41.243044 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.237998    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238001    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238084    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238091    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238097    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238101    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238106    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238109    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238115    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238119    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238122    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238125    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238129    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238132    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238135    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238138    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238141    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238144    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238147    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238150    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238154    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238157    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238160    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238163    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:36:41.243521 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238166    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238170    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238173    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238176    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238179    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238182    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238185    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238188    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238191    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238194    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238197    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238200    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238203    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238206    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238209    2564 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238212    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238217    2564 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238221    2564 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238223    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238226    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238229    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238233    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238236    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238239    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238242    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:36:41.244170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238245    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238248    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238251    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238254    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238257    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238260    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238263    2564 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238267    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238270    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238273    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238276    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238279    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238282    2564 flags.go:64] FLAG: --help="false"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238285    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238288    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238291    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238294    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238297    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238301    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238304    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238307    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238310    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238312    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:36:41.244808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238317    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238321    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238324    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238327    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238329    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238332    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238335    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238338    2564 flags.go:64] FLAG: --lock-file=""
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238341    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238344    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238347    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238352    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238355    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238358    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238361    2564 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238364    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238367    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238370    2564 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238373    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238377    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238380    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238384    2564 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238387    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238390    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238393    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:36:41.245409 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238395    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238398    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238401    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238405    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238412    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238415    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238418    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238422    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238425    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238431    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238434    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238437    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238440    2564 flags.go:64] FLAG: --port="10250"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238443    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238446    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e45dc543e7cbfb08"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238449    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238452    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238455    2564 flags.go:64] FLAG: --register-node="true"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238457    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238461    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238464    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238466    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238469    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238473    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238476    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:36:41.246012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238479    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238481    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238484    2564 flags.go:64] FLAG: --runonce="false"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238487    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238490    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238493    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238496    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238499    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238501    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238504    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238507    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238510    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238513    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238516    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238518    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238523    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238526    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238529    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238535    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238537    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238540    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238545    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238549    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238552    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238555    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:36:41.246628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238558    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238561    2564 flags.go:64] FLAG: --v="2"
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238566    2564 flags.go:64] FLAG: --version="false"
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238570    2564 flags.go:64] FLAG: --vmodule=""
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238574    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.238577    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238685    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238689    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238692    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238695    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238698    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238700    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238703    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238706    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238708    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238711    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238714    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238716    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238719    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238722    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:36:41.247255 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238724    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238727    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238731    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238734    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238737    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238739    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238742    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238745    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238748    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238752    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238754    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238757    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238759    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238762    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238764    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238767    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238770    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238772    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238774    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238777    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:36:41.247765 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238779    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238782    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238785    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238787    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238790    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238792    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238796    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238800    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238803    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238805    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238808    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238810    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238813    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238816    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238819    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238822    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238825    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238828    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238830    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238833    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:36:41.248270 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238835    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238839    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238842    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238844    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238847    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238849    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238852    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238854    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238857    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238859    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238862    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238865    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238867    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238870    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238872    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238874    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238877    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238879    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238882    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238884    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:36:41.248748 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238888    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238892    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238895    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238897    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238900    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238902    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238906    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238909    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238911    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238914    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238917    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238920    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238923    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238928    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238931    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238934    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238937    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238939    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238942    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:36:41.249248 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238945    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238948    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238950    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238953    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238955    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.238958    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.239499    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.246127    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.246142    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.246805    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.246812    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246869    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246874    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246878    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246881    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:36:41.249711 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246884    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246887    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246890    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246893    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246896    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246899    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246901    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246906    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246910    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246913    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246917    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246920    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246922    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246925    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246928    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246931    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246933    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246936    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246939    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:36:41.250131 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246941    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246944    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246946    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246949    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246952    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246954    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246961    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246964    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246967    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246969    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246972    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246975    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246977    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246980    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246983    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246985    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246988    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246991    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246993    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246996    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:36:41.250579 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.246998    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247001    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247004    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247006    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247009    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247011    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247014    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247017    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247019    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247036    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247040    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247043    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247045    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247049    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247051    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247054    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247056    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247059    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247062    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247065    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:36:41.251068 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247068    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247071    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247073    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247076    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247078    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247081    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247083    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247086    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247089    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247091    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247094    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247096    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247099    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247101    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247104    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247106    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247109    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247111    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247114    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:36:41.251557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247117    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247121    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247125    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247127    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247130    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247133    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247136    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247138    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247141    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247143    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247146    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247149    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247155    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247157    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247160    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:36:41.252011 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247163    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.247168    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247277    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247282    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247285    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247288    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247291    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247294    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247297    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247300    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247303    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247305    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247308    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247310    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247313    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247316    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:36:41.252475 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247319    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247321    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247324    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247326    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247329    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247331    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247334    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247336    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247339    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247341    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247344    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247347    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247349    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247351    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247354    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247357    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247360    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247362    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247364    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247367    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:36:41.253135 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247369    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247372    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247375    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247377    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247380    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247382    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247386    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247388    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247391    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247393    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247395    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247398    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247401    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247403    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247406    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247408    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247411    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247413    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247416    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:36:41.254005 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247418    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247422    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247425    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247428    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247431    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247433    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247436    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247439    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247442    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247445    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247447    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247450    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247453    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247456    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247458    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247461    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247463    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247466    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:36:41.254797 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247469    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247472    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247475    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247478    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247481    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247484    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247486    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247489    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247491    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247494    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247496    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247499    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247502    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247504    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247507    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247509    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247512    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247514    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247517    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:36:41.255329 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247519    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247523    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247527    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247529    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247532    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247535    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247537    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247540    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:41.247542    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.247547    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.247649    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.249595    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.250796    2564 server.go:1019] "Starting client certificate rotation"
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.250891    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:36:41.255956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.250957    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:36:41.256363 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.253837    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:36:41.256985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.256966    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:36:41.266342 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.266327    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:36:41.268232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.268216    2564 log.go:25] "Validated CRI v1 image API"
Jul 24 17:36:41.269684 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.269670    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:36:41.271858 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.271840    2564 fs.go:135] Filesystem UUIDs: map[3f1adc30-d9a1-4607-afaf-fa20bee5553b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9bc969ab-d216-4adb-98f5-1c621f342724:/dev/nvme0n1p4]
Jul 24 17:36:41.271917 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.271857    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:36:41.277715 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.277610    2564 manager.go:216] Machine: {Timestamp:2026-07-24 17:36:41.276110448 +0000 UTC m=+0.308490797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098358 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2318979824e2454f75bc8762ef8928 SystemUUID:ec231897-9824-e245-4f75-bc8762ef8928 BootID:5c009144-8cfa-4d63-b487-7f35177267d7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:f9:3f:42:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:f9:3f:42:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:5d:66:de:ad:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:36:41.277715 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.277713    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:36:41.277827 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.277787    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:36:41.280547 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.280519    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:36:41.280672 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.280548    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:36:41.281676 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.281666    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:36:41.281717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.281679    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:36:41.281717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.281686    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:36:41.282342 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.282325    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:36:41.282342 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.282337    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:36:41.283091 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.283080    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:36:41.284750 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284739    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:36:41.284857 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284848    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:36:41.284890 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284876    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:36:41.284890 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284888    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:36:41.284945 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284903    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:36:41.284945 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284917    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:36:41.284945 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.284927    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:36:41.285260 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.285249    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:36:41.285304 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.285278    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:36:41.286937 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.286919    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:36:41.288604 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.288587    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:36:41.288688 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.288626    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:36:41.290223 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290208    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290229    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290238    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290247    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290261    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290269    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290280    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290289    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290299    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290311    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:36:41.290323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290323    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:36:41.290590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.290331    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:36:41.291059 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.291047    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:36:41.291108 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.291062    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:36:41.296070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.295213    2564 server.go:1268] "Started kubelet"
Jul 24 17:36:41.296070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.295856    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:36:41.296070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.295787    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:36:41.296070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.295929    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:36:41.296286 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.296081    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:36:41.296286 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.296106    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:36:41.296324 ip-10-0-139-114 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:36:41.296916 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.295992    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:36:41.297994 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.297870    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:36:41.298730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.298714    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:36:41.301750 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.301729    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:36:41.304279 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.303402    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-114.ec2.internal.18c54a5f7c99dc37  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-114.ec2.internal,UID:ip-10-0-139-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-114.ec2.internal,},FirstTimestamp:2026-07-24 17:36:41.295076407 +0000 UTC m=+0.327456761,LastTimestamp:2026-07-24 17:36:41.295076407 +0000 UTC m=+0.327456761,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-114.ec2.internal,}"
Jul 24 17:36:41.306692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.306624    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:36:41.306692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.306634    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:36:41.306967 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.306946    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.307435 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307417    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:36:41.307435 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307425    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:36:41.307571 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307444    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:36:41.307662 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307647    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:36:41.307662 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307662    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:36:41.307819 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307806    2564 factory.go:153] Registering CRI-O factory
Jul 24 17:36:41.307865 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307822    2564 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:36:41.307902 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307870    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:36:41.307902 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307879    2564 factory.go:55] Registering systemd factory
Jul 24 17:36:41.307902 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307886    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:36:41.307902 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307903    2564 factory.go:103] Registering Raw factory
Jul 24 17:36:41.308038 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.307912    2564 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:36:41.308491 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.308478    2564 manager.go:349] Starting recovery of all containers
Jul 24 17:36:41.313440 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.313411    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:36:41.313595 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.313565    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:36:41.318636 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.318621    2564 manager.go:354] Recovery completed
Jul 24 17:36:41.322483 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.322368    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlgnh"
Jul 24 17:36:41.323502 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.323487    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.326218 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.326201    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.326294 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.326231    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.326294 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.326241    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.327397 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.327106    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:36:41.327397 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.327133    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:36:41.327397 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.327159    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:36:41.327397 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.327309    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.328249 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.328142    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-114.ec2.internal.18c54a5f7e750c08  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-114.ec2.internal,UID:ip-10-0-139-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-114.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-114.ec2.internal,},FirstTimestamp:2026-07-24 17:36:41.326218248 +0000 UTC m=+0.358598597,LastTimestamp:2026-07-24 17:36:41.326218248 +0000 UTC m=+0.358598597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-114.ec2.internal,}"
Jul 24 17:36:41.329039 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.329013    2564 policy_none.go:49] "None policy: Start"
Jul 24 17:36:41.329122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.329053    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:36:41.329302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.329287    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:36:41.329713 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.329697    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.329797 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.329729    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.329797 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.329745    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.330356 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.330344    2564 policy_none.go:47] "Start"
Jul 24 17:36:41.332197 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.332177    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlgnh"
Jul 24 17:36:41.340474 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.340349    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-114.ec2.internal.18c54a5f7e754f92  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-114.ec2.internal,UID:ip-10-0-139-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-114.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-114.ec2.internal,},FirstTimestamp:2026-07-24 17:36:41.326235538 +0000 UTC m=+0.358615887,LastTimestamp:2026-07-24 17:36:41.326235538 +0000 UTC m=+0.358615887,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-114.ec2.internal,}"
Jul 24 17:36:41.370586 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.370570    2564 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:36:41.370681 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.370602    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:36:41.370681 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.370611    2564 server.go:87] "Starting device plugin registration server"
Jul 24 17:36:41.370906 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.370892    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:36:41.370948 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.370909    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:36:41.371392 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.371060    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:36:41.371392 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.371132    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:36:41.371392 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.371142    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:36:41.371871 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.371843    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:36:41.371928 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.371897    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.451966 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.451929    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:36:41.453040 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.453007    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:36:41.453147 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.453067    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:36:41.453147 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.453093    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:36:41.453147 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.453134    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:36:41.455578 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.455561    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:36:41.471558 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.471545    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.472526 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.472506    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.472603 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.472533    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.472603 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.472547    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.472603 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.472567    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.482172 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.482121    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.482172 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.482144    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-114.ec2.internal\": node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.501957 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.501940    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.553979 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.553957    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"]
Jul 24 17:36:41.554107 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.554017    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.556528 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.556512    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.556590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.556550    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.556590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.556564    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.557810 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.557798    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.557931 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.557917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.557966 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.557951    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.558727 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.558709    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.558814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.558738    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.558814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.558750    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.559481 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.559464    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.559597 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.559489    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.559597 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.559500    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.560664 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.560650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.560719 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.560675    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:41.563488 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.563462    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:41.563488 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.563488    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:41.563637 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.563499    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:41.587727 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.587707    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-114.ec2.internal\" not found" node="ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.592561 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.592547    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-114.ec2.internal\" not found" node="ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.602607 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.602587    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.609924 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.609908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c0b0ea39991f2367c86ab864e372477-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal\" (UID: \"9c0b0ea39991f2367c86ab864e372477\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.609998 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.609937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c0b0ea39991f2367c86ab864e372477-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal\" (UID: \"9c0b0ea39991f2367c86ab864e372477\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.609998 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.609962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e324f28c574bcb525044f52d56737e58-config\") pod \"kube-apiserver-proxy-ip-10-0-139-114.ec2.internal\" (UID: \"e324f28c574bcb525044f52d56737e58\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.702675 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.702646    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.710503 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.710486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e324f28c574bcb525044f52d56737e58-config\") pod \"kube-apiserver-proxy-ip-10-0-139-114.ec2.internal\" (UID: \"e324f28c574bcb525044f52d56737e58\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.710572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.710509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c0b0ea39991f2367c86ab864e372477-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal\" (UID: \"9c0b0ea39991f2367c86ab864e372477\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.710572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.710528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c0b0ea39991f2367c86ab864e372477-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal\" (UID: \"9c0b0ea39991f2367c86ab864e372477\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.710572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.710564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c0b0ea39991f2367c86ab864e372477-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal\" (UID: \"9c0b0ea39991f2367c86ab864e372477\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.710705 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.710595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e324f28c574bcb525044f52d56737e58-config\") pod \"kube-apiserver-proxy-ip-10-0-139-114.ec2.internal\" (UID: \"e324f28c574bcb525044f52d56737e58\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.710705 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.710618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c0b0ea39991f2367c86ab864e372477-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal\" (UID: \"9c0b0ea39991f2367c86ab864e372477\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.803151 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.803070    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:41.890664 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.890618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.896416 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:41.896392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:41.904107 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:41.904086    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:42.004687 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:42.004654    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:42.105208 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:42.105135    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:42.205791 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:42.205767    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:42.210841 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.210823    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:36:42.251906 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.251874    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:36:42.252572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.252009    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:36:42.252572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.252057    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:36:42.305902 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:42.305876    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:42.338580 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.338521    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 17:31:41 +0000 UTC" deadline="2028-03-08 10:50:01.906849262 +0000 UTC"
Jul 24 17:36:42.338580 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.338575    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14225h13m19.568278092s"
Jul 24 17:36:42.384859 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:42.384820    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode324f28c574bcb525044f52d56737e58.slice/crio-88726579fdec3b7ed2bf2b929ed3837faf45e160fdad7a0c02915360049a5bd1 WatchSource:0}: Error finding container 88726579fdec3b7ed2bf2b929ed3837faf45e160fdad7a0c02915360049a5bd1: Status 404 returned error can't find the container with id 88726579fdec3b7ed2bf2b929ed3837faf45e160fdad7a0c02915360049a5bd1
Jul 24 17:36:42.389026 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.389009    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:36:42.406817 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:42.406791    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-114.ec2.internal\" not found"
Jul 24 17:36:42.420558 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:42.420524    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0b0ea39991f2367c86ab864e372477.slice/crio-97f31f8a9bbde5ce729a2b0d3a22588ce7ca4908954d8233e5682a8763473ebb WatchSource:0}: Error finding container 97f31f8a9bbde5ce729a2b0d3a22588ce7ca4908954d8233e5682a8763473ebb: Status 404 returned error can't find the container with id 97f31f8a9bbde5ce729a2b0d3a22588ce7ca4908954d8233e5682a8763473ebb
Jul 24 17:36:42.437339 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.437321    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:36:42.439258 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.439242    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:36:42.439323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.439272    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:36:42.439323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.439286    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:36:42.456854 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.456802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal" event={"ID":"9c0b0ea39991f2367c86ab864e372477","Type":"ContainerStarted","Data":"97f31f8a9bbde5ce729a2b0d3a22588ce7ca4908954d8233e5682a8763473ebb"}
Jul 24 17:36:42.457890 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.457861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal" event={"ID":"e324f28c574bcb525044f52d56737e58","Type":"ContainerStarted","Data":"88726579fdec3b7ed2bf2b929ed3837faf45e160fdad7a0c02915360049a5bd1"}
Jul 24 17:36:42.480863 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.480842    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:36:42.507174 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.507151    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:42.519449 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.519429    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:36:42.521282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.521267    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal"
Jul 24 17:36:42.530908 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.530890    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:36:42.580221 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:42.580198    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:36:43.285828 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.285796    2564 apiserver.go:52] "Watching apiserver"
Jul 24 17:36:43.295260 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.294322    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:36:43.295260 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.294826    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-bwn98","kube-system/konnectivity-agent-fbfsh","kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kl2mh","openshift-image-registry/node-ca-9xwrq","openshift-multus/network-metrics-daemon-4d5j5","openshift-network-diagnostics/network-check-target-x9s76","openshift-network-operator/iptables-alerter-c6x6l","openshift-ovn-kubernetes/ovnkube-node-5j9pp","kube-system/global-pull-secret-syncer-wx8pj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw","openshift-dns/node-resolver-npt2z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal","openshift-multus/multus-additional-cni-plugins-787mq"]
Jul 24 17:36:43.296635 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.296611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:43.296776 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.296696    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:43.298009 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.297987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.299549 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.299525    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.300635 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.300612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:36:43.300752 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.300726    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.300940 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.300915    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.301121 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.300919    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-trs78\""
Jul 24 17:36:43.302104 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.302068    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.302519 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.302480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:36:43.302603 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.302529    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:36:43.302603 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.302480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nm6jb\""
Jul 24 17:36:43.303386 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.303202    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.309864 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.309845    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:36:43.311703 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.311683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.313100 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.312605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.314143 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.314120    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.314459    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.315303    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dvz5p\""
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.315295    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.315639    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.316037    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.316187    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v6t7j\""
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.316200    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.317084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.316833    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.319531 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.319512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-systemd\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbec540a-1614-4eb9-b71b-fee45693436a-tmp\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-cni-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-cni-multus\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-hostroot\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-conf-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-run\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.320366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-lib-modules\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.320883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-var-lib-kubelet\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.320883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-daemon-config\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.320883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-modprobe-d\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.320883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-sys\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.320499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-socket-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-socket-dir-parent\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-device-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-sys-fs\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-etc-kubernetes\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-host\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-registration-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-os-release\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7db9c912-abc9-4682-a5a4-3f598bee3123-cni-binary-copy\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-netns\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-cni-bin\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysctl-d\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysctl-conf\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-k8s-cni-cncf-io\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.322590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-multus-certs\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysconfig\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbec540a-1614-4eb9-b71b-fee45693436a-etc-tuned\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55pv4\" (UniqueName: \"kubernetes.io/projected/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-kube-api-access-55pv4\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-system-cni-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-kubelet\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-kubernetes\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngxr5\" (UniqueName: \"kubernetes.io/projected/fbec540a-1614-4eb9-b71b-fee45693436a-kube-api-access-ngxr5\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-cnibin\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.321789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7sbm\" (UniqueName: \"kubernetes.io/projected/7db9c912-abc9-4682-a5a4-3f598bee3123-kube-api-access-k7sbm\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.323268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.323540 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.323323    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:43.324523 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.324497    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.324662 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.324503    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rzdqp\""
Jul 24 17:36:43.324799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.324783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.325020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.324954    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:36:43.325454 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325419    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:36:43.325541 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325504    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.325611 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325543    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pkxb6\""
Jul 24 17:36:43.325690 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325668    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:36:43.325792 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325746    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:36:43.325853 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325808    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:36:43.325899 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.325872    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:36:43.326506 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.326489    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:36:43.327119 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.327087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.327722 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.327615    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.328503 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.328482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.328680 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.328534    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.328680 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.328567    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dcwnb\""
Jul 24 17:36:43.329666 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.329648    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:36:43.331535 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.331435    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:36:43.332323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.331985    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:36:43.332782 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.332562    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c7fpk\""
Jul 24 17:36:43.332782 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.332729    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:36:43.332782 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.332778    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:36:43.333426 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.333406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x7qwt\""
Jul 24 17:36:43.350633 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.350611    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dqszz"
Jul 24 17:36:43.358042 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.357600    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dqszz"
Jul 24 17:36:43.408865 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.408779    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:36:43.422483 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-kubernetes\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.422623 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngxr5\" (UniqueName: \"kubernetes.io/projected/fbec540a-1614-4eb9-b71b-fee45693436a-kube-api-access-ngxr5\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.422623 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-cni-binary-copy\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.422623 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.422825 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-kubernetes\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.422825 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-ovn\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.422825 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7sbm\" (UniqueName: \"kubernetes.io/projected/7db9c912-abc9-4682-a5a4-3f598bee3123-kube-api-access-k7sbm\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.422825 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-os-release\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.422973 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.422973 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.423086 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.422984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-cni-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423086 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-hostroot\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423160 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-run\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423160 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-var-lib-kubelet\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-socket-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.423282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-hostroot\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc5014fb-4c2f-4b12-b725-4e614956d342-dbus\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.423282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e4beacc-551c-44fe-ad2e-4be857a1709c-iptables-alerter-script\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.423282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-run\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-daemon-config\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-cni-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-modprobe-d\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-socket-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqq6w\" (UniqueName: \"kubernetes.io/projected/26f06874-5a2f-4aab-980d-e27099e40f32-kube-api-access-zqq6w\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k76kt\" (UniqueName: \"kubernetes.io/projected/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-kube-api-access-k76kt\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e4beacc-551c-44fe-ad2e-4be857a1709c-host-slash\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-device-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-modprobe-d\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-sys-fs\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-etc-kubernetes\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36c1d58b-4ae3-4185-8609-a30eb99d7c39-serviceca\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-var-lib-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-etc-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-os-release\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-cni-bin\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysctl-d\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysctl-conf\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-cnibin\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovnkube-script-lib\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/42e19666-20c4-42a5-bec9-37a0c8b3aa6e-konnectivity-ca\") pod \"konnectivity-agent-fbfsh\" (UID: \"42e19666-20c4-42a5-bec9-37a0c8b3aa6e\") " pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.423886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-multus-certs\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbec540a-1614-4eb9-b71b-fee45693436a-etc-tuned\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-kubelet\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.423997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-node-log\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-cni-bin\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-daemon-config\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovn-node-metrics-cert\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-system-cni-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-kubelet\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab61a84-5482-4cb5-8241-a7cb3d83d326-tmp-dir\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-system-cni-dir\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-systemd\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-cnibin\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-systemd\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-etc-kubernetes\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-device-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.424497 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-var-lib-kubelet\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-sys-fs\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-system-cni-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-kubelet\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-os-release\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-cni-bin\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-cnibin\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-multus-certs\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbec540a-1614-4eb9-b71b-fee45693436a-tmp\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c1d58b-4ae3-4185-8609-a30eb99d7c39-host\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-systemd\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysctl-d\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-log-socket\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysctl-conf\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovnkube-config\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/42e19666-20c4-42a5-bec9-37a0c8b3aa6e-agent-certs\") pod \"konnectivity-agent-fbfsh\" (UID: \"42e19666-20c4-42a5-bec9-37a0c8b3aa6e\") " pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-cni-multus\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.425405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-conf-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-var-lib-cni-multus\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424912    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.424993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-conf-dir\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-lib-modules\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-env-overrides\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-sys\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfnk2\" (UniqueName: \"kubernetes.io/projected/5ab61a84-5482-4cb5-8241-a7cb3d83d326-kube-api-access-tfnk2\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-socket-dir-parent\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-sys\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-lib-modules\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-run-netns\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-cni-netd\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624m4\" (UniqueName: \"kubernetes.io/projected/9e4beacc-551c-44fe-ad2e-4be857a1709c-kube-api-access-624m4\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425362    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-host\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-multus-socket-dir-parent\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-registration-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.426318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-host\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab61a84-5482-4cb5-8241-a7cb3d83d326-hosts-file\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-registration-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbfj5\" (UniqueName: \"kubernetes.io/projected/39726eac-a819-439a-a511-3c067cae4a0d-kube-api-access-hbfj5\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7db9c912-abc9-4682-a5a4-3f598bee3123-cni-binary-copy\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-netns\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-netns\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfhcw\" (UniqueName: \"kubernetes.io/projected/36c1d58b-4ae3-4185-8609-a30eb99d7c39-kube-api-access-jfhcw\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-slash\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-k8s-cni-cncf-io\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425771    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7db9c912-abc9-4682-a5a4-3f598bee3123-host-run-k8s-cni-cncf-io\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysconfig\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbec540a-1614-4eb9-b71b-fee45693436a-etc-sysconfig\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55pv4\" (UniqueName: \"kubernetes.io/projected/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-kube-api-access-55pv4\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.427127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc5014fb-4c2f-4b12-b725-4e614956d342-kubelet-config\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.428025 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.425982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-systemd-units\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.428025 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.426036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7db9c912-abc9-4682-a5a4-3f598bee3123-cni-binary-copy\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.428025 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.426120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.428665 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.428644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbec540a-1614-4eb9-b71b-fee45693436a-tmp\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.428751 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.428694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbec540a-1614-4eb9-b71b-fee45693436a-etc-tuned\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.434126 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.433886    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:36:43.434126 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.433916    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:36:43.434126 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.433931    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:43.434126 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.434007    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:43.933974322 +0000 UTC m=+2.966354664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:43.436005 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.435979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngxr5\" (UniqueName: \"kubernetes.io/projected/fbec540a-1614-4eb9-b71b-fee45693436a-kube-api-access-ngxr5\") pod \"tuned-kl2mh\" (UID: \"fbec540a-1614-4eb9-b71b-fee45693436a\") " pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.436545 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.436521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7sbm\" (UniqueName: \"kubernetes.io/projected/7db9c912-abc9-4682-a5a4-3f598bee3123-kube-api-access-k7sbm\") pod \"multus-bwn98\" (UID: \"7db9c912-abc9-4682-a5a4-3f598bee3123\") " pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.437810 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.437785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55pv4\" (UniqueName: \"kubernetes.io/projected/6c46bde0-359b-4f7e-8fe2-ae7b87d05566-kube-api-access-55pv4\") pod \"aws-ebs-csi-driver-node-j5zhw\" (UID: \"6c46bde0-359b-4f7e-8fe2-ae7b87d05566\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.526297 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.526492 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhcw\" (UniqueName: \"kubernetes.io/projected/36c1d58b-4ae3-4185-8609-a30eb99d7c39-kube-api-access-jfhcw\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.526492 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-slash\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526492 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc5014fb-4c2f-4b12-b725-4e614956d342-kubelet-config\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.526492 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-systemd-units\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526492 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-cni-binary-copy\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-slash\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526510    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc5014fb-4c2f-4b12-b725-4e614956d342-kubelet-config\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-systemd-units\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-ovn\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-ovn\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-os-release\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc5014fb-4c2f-4b12-b725-4e614956d342-dbus\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.526760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e4beacc-551c-44fe-ad2e-4be857a1709c-iptables-alerter-script\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqq6w\" (UniqueName: \"kubernetes.io/projected/26f06874-5a2f-4aab-980d-e27099e40f32-kube-api-access-zqq6w\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k76kt\" (UniqueName: \"kubernetes.io/projected/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-kube-api-access-k76kt\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e4beacc-551c-44fe-ad2e-4be857a1709c-host-slash\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.526978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36c1d58b-4ae3-4185-8609-a30eb99d7c39-serviceca\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-var-lib-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-etc-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-cnibin\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovnkube-script-lib\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/42e19666-20c4-42a5-bec9-37a0c8b3aa6e-konnectivity-ca\") pod \"konnectivity-agent-fbfsh\" (UID: \"42e19666-20c4-42a5-bec9-37a0c8b3aa6e\") " pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-kubelet\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-cni-binary-copy\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-node-log\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.528410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-node-log\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-cni-bin\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovn-node-metrics-cert\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-cni-bin\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab61a84-5482-4cb5-8241-a7cb3d83d326-tmp-dir\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-system-cni-dir\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-etc-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-systemd\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc5014fb-4c2f-4b12-b725-4e614956d342-dbus\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c1d58b-4ae3-4185-8609-a30eb99d7c39-host\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-log-socket\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovnkube-config\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36c1d58b-4ae3-4185-8609-a30eb99d7c39-serviceca\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-os-release\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/42e19666-20c4-42a5-bec9-37a0c8b3aa6e-agent-certs\") pod \"konnectivity-agent-fbfsh\" (UID: \"42e19666-20c4-42a5-bec9-37a0c8b3aa6e\") " pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.527609    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:43.529302 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.527672    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:44.027653797 +0000 UTC m=+3.060034158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-system-cni-dir\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26f06874-5a2f-4aab-980d-e27099e40f32-cnibin\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-var-lib-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e4beacc-551c-44fe-ad2e-4be857a1709c-host-slash\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c1d58b-4ae3-4185-8609-a30eb99d7c39-host\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-kubelet\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-log-socket\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e4beacc-551c-44fe-ad2e-4be857a1709c-iptables-alerter-script\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26f06874-5a2f-4aab-980d-e27099e40f32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.527992    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/42e19666-20c4-42a5-bec9-37a0c8b3aa6e-konnectivity-ca\") pod \"konnectivity-agent-fbfsh\" (UID: \"42e19666-20c4-42a5-bec9-37a0c8b3aa6e\") " pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-env-overrides\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovnkube-script-lib\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfnk2\" (UniqueName: \"kubernetes.io/projected/5ab61a84-5482-4cb5-8241-a7cb3d83d326-kube-api-access-tfnk2\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-systemd\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.530232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab61a84-5482-4cb5-8241-a7cb3d83d326-tmp-dir\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-run-netns\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.528255    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-cni-netd\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-624m4\" (UniqueName: \"kubernetes.io/projected/9e4beacc-551c-44fe-ad2e-4be857a1709c-kube-api-access-624m4\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-run-netns\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovnkube-config\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:43.528525    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:36:44.028507232 +0000 UTC m=+3.060887585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-env-overrides\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab61a84-5482-4cb5-8241-a7cb3d83d326-hosts-file\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-host-cni-netd\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab61a84-5482-4cb5-8241-a7cb3d83d326-hosts-file\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbfj5\" (UniqueName: \"kubernetes.io/projected/39726eac-a819-439a-a511-3c067cae4a0d-kube-api-access-hbfj5\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.528905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-run-openvswitch\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.531127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.530401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-ovn-node-metrics-cert\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.532017 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.531998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/42e19666-20c4-42a5-bec9-37a0c8b3aa6e-agent-certs\") pod \"konnectivity-agent-fbfsh\" (UID: \"42e19666-20c4-42a5-bec9-37a0c8b3aa6e\") " pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.539628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.539558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfhcw\" (UniqueName: \"kubernetes.io/projected/36c1d58b-4ae3-4185-8609-a30eb99d7c39-kube-api-access-jfhcw\") pod \"node-ca-9xwrq\" (UID: \"36c1d58b-4ae3-4185-8609-a30eb99d7c39\") " pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.550880 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.550844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqq6w\" (UniqueName: \"kubernetes.io/projected/26f06874-5a2f-4aab-980d-e27099e40f32-kube-api-access-zqq6w\") pod \"multus-additional-cni-plugins-787mq\" (UID: \"26f06874-5a2f-4aab-980d-e27099e40f32\") " pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.551120 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.551082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfnk2\" (UniqueName: \"kubernetes.io/projected/5ab61a84-5482-4cb5-8241-a7cb3d83d326-kube-api-access-tfnk2\") pod \"node-resolver-npt2z\" (UID: \"5ab61a84-5482-4cb5-8241-a7cb3d83d326\") " pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.551554 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.551533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-624m4\" (UniqueName: \"kubernetes.io/projected/9e4beacc-551c-44fe-ad2e-4be857a1709c-kube-api-access-624m4\") pod \"iptables-alerter-c6x6l\" (UID: \"9e4beacc-551c-44fe-ad2e-4be857a1709c\") " pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.551656 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.551600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k76kt\" (UniqueName: \"kubernetes.io/projected/9f738c2f-8e5a-4a6a-8e65-7604f91544fa-kube-api-access-k76kt\") pod \"ovnkube-node-5j9pp\" (UID: \"9f738c2f-8e5a-4a6a-8e65-7604f91544fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.552902 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.552878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbfj5\" (UniqueName: \"kubernetes.io/projected/39726eac-a819-439a-a511-3c067cae4a0d-kube-api-access-hbfj5\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:43.616541 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.616495    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw"
Jul 24 17:36:43.626801 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.626774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bwn98"
Jul 24 17:36:43.638624 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.638601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kl2mh"
Jul 24 17:36:43.646136 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.646116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6x6l"
Jul 24 17:36:43.654661 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.654630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xwrq"
Jul 24 17:36:43.662478 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.662456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:36:43.670277 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.670259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:36:43.678183 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.678164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-npt2z"
Jul 24 17:36:43.682795 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.682770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-787mq"
Jul 24 17:36:43.719696 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:43.719663    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:36:44.033281 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.033238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:44.033469 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.033292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:44.033469 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.033316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:44.033469 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033423    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:44.033469 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033427    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:44.033469 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033446    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:36:44.033469 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033471    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:36:44.033730 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033485    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:44.033730 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033486    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:45.033467684 +0000 UTC m=+4.065848040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:44.033730 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033534    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:36:45.033522325 +0000 UTC m=+4.065902663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:44.033730 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.033549    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:45.033539896 +0000 UTC m=+4.065920234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:44.360641 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.360521    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:31:43 +0000 UTC" deadline="2028-02-11 05:15:43.845487572 +0000 UTC"
Jul 24 17:36:44.360641 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.360584    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13595h38m59.484908143s"
Jul 24 17:36:44.453934 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.453903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:44.454090 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:44.454022    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:44.618459 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.618425    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c46bde0_359b_4f7e_8fe2_ae7b87d05566.slice/crio-150e9fd5dc00680196c5eb914dfb235bc65087759ab80f9b3db5995577a649e1 WatchSource:0}: Error finding container 150e9fd5dc00680196c5eb914dfb235bc65087759ab80f9b3db5995577a649e1: Status 404 returned error can't find the container with id 150e9fd5dc00680196c5eb914dfb235bc65087759ab80f9b3db5995577a649e1
Jul 24 17:36:44.619780 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.619756    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f06874_5a2f_4aab_980d_e27099e40f32.slice/crio-9bd68db48e8bdeccc0e0c2bcf8a7c1134d9275c5e35fbc4e280af2c80a25c7b6 WatchSource:0}: Error finding container 9bd68db48e8bdeccc0e0c2bcf8a7c1134d9275c5e35fbc4e280af2c80a25c7b6: Status 404 returned error can't find the container with id 9bd68db48e8bdeccc0e0c2bcf8a7c1134d9275c5e35fbc4e280af2c80a25c7b6
Jul 24 17:36:44.623802 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.623766    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e19666_20c4_42a5_bec9_37a0c8b3aa6e.slice/crio-ae1165bd58f95bb8ee83bbb3df903b1666e69bf998a58f6d770ae4d3e3441b92 WatchSource:0}: Error finding container ae1165bd58f95bb8ee83bbb3df903b1666e69bf998a58f6d770ae4d3e3441b92: Status 404 returned error can't find the container with id ae1165bd58f95bb8ee83bbb3df903b1666e69bf998a58f6d770ae4d3e3441b92
Jul 24 17:36:44.624544 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.624519    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db9c912_abc9_4682_a5a4_3f598bee3123.slice/crio-d259674a4b71da61629fba5f4c1009375a69b0108337b0ece0354e5b84d4f042 WatchSource:0}: Error finding container d259674a4b71da61629fba5f4c1009375a69b0108337b0ece0354e5b84d4f042: Status 404 returned error can't find the container with id d259674a4b71da61629fba5f4c1009375a69b0108337b0ece0354e5b84d4f042
Jul 24 17:36:44.625691 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.625380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f738c2f_8e5a_4a6a_8e65_7604f91544fa.slice/crio-bd40999a9e4f28b19bc6b513f6abf2a5f7466cee77d5df6671e65f96a30a4377 WatchSource:0}: Error finding container bd40999a9e4f28b19bc6b513f6abf2a5f7466cee77d5df6671e65f96a30a4377: Status 404 returned error can't find the container with id bd40999a9e4f28b19bc6b513f6abf2a5f7466cee77d5df6671e65f96a30a4377
Jul 24 17:36:44.628007 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.627979    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c1d58b_4ae3_4185_8609_a30eb99d7c39.slice/crio-add6fd11a8560cb086160a455e0f3b56b612cf341dd5d646cad1e67bad6052a4 WatchSource:0}: Error finding container add6fd11a8560cb086160a455e0f3b56b612cf341dd5d646cad1e67bad6052a4: Status 404 returned error can't find the container with id add6fd11a8560cb086160a455e0f3b56b612cf341dd5d646cad1e67bad6052a4
Jul 24 17:36:44.628323 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.628300    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4beacc_551c_44fe_ad2e_4be857a1709c.slice/crio-a8ff942d918e092019290bdc77136c22728b385e46fc644cea0e4d41b902aa2a WatchSource:0}: Error finding container a8ff942d918e092019290bdc77136c22728b385e46fc644cea0e4d41b902aa2a: Status 404 returned error can't find the container with id a8ff942d918e092019290bdc77136c22728b385e46fc644cea0e4d41b902aa2a
Jul 24 17:36:44.629804 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:36:44.629729    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbec540a_1614_4eb9_b71b_fee45693436a.slice/crio-816af7378a3e808e2be43b59e831d27ce6861f4c8d5778e01470d9bdb4532c3a WatchSource:0}: Error finding container 816af7378a3e808e2be43b59e831d27ce6861f4c8d5778e01470d9bdb4532c3a: Status 404 returned error can't find the container with id 816af7378a3e808e2be43b59e831d27ce6861f4c8d5778e01470d9bdb4532c3a
Jul 24 17:36:44.946104 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:44.945890    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:36:45.040775 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.040725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:45.040946 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.040796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:45.040946 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.040849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:45.040946 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.040923    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.040972    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.040995    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.041003    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:47.040981314 +0000 UTC m=+6.073361669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.041009    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.041075    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.041066    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:47.041049349 +0000 UTC m=+6.073429705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:45.041157 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.041119    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:36:47.041106174 +0000 UTC m=+6.073486530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:45.361436 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.361309    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:31:43 +0000 UTC" deadline="2028-01-06 07:06:41.338649116 +0000 UTC"
Jul 24 17:36:45.361436 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.361385    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12733h29m55.977269221s"
Jul 24 17:36:45.455297 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.455212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:45.455491 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.455367    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:45.455491 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.455411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:45.455609 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:45.455490    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:45.478703 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.478288    2564 generic.go:356] "Generic (PLEG): container finished" podID="9c0b0ea39991f2367c86ab864e372477" containerID="0d6026ac2d730e9d25cb5348adbbeb47b56001e25a7380edcd06694f13204f12" exitCode=0
Jul 24 17:36:45.478703 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.478462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal" event={"ID":"9c0b0ea39991f2367c86ab864e372477","Type":"ContainerDied","Data":"0d6026ac2d730e9d25cb5348adbbeb47b56001e25a7380edcd06694f13204f12"}
Jul 24 17:36:45.484953 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.484923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-npt2z" event={"ID":"5ab61a84-5482-4cb5-8241-a7cb3d83d326","Type":"ContainerStarted","Data":"674b0594e6556e3ca64e6843e1ae147d337c9c6c34d58369dd591484e4077453"}
Jul 24 17:36:45.492964 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.492894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kl2mh" event={"ID":"fbec540a-1614-4eb9-b71b-fee45693436a","Type":"ContainerStarted","Data":"816af7378a3e808e2be43b59e831d27ce6861f4c8d5778e01470d9bdb4532c3a"}
Jul 24 17:36:45.504330 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.504250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xwrq" event={"ID":"36c1d58b-4ae3-4185-8609-a30eb99d7c39","Type":"ContainerStarted","Data":"add6fd11a8560cb086160a455e0f3b56b612cf341dd5d646cad1e67bad6052a4"}
Jul 24 17:36:45.508609 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.508572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bwn98" event={"ID":"7db9c912-abc9-4682-a5a4-3f598bee3123","Type":"ContainerStarted","Data":"d259674a4b71da61629fba5f4c1009375a69b0108337b0ece0354e5b84d4f042"}
Jul 24 17:36:45.515323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.515299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbfsh" event={"ID":"42e19666-20c4-42a5-bec9-37a0c8b3aa6e","Type":"ContainerStarted","Data":"ae1165bd58f95bb8ee83bbb3df903b1666e69bf998a58f6d770ae4d3e3441b92"}
Jul 24 17:36:45.522971 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.522943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal" event={"ID":"e324f28c574bcb525044f52d56737e58","Type":"ContainerStarted","Data":"573908618b9140ea478d082044e23dd6b18c7baae79c9e9e0d50a1146c27c5f7"}
Jul 24 17:36:45.528500 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.528469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6x6l" event={"ID":"9e4beacc-551c-44fe-ad2e-4be857a1709c","Type":"ContainerStarted","Data":"a8ff942d918e092019290bdc77136c22728b385e46fc644cea0e4d41b902aa2a"}
Jul 24 17:36:45.536901 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.536871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"bd40999a9e4f28b19bc6b513f6abf2a5f7466cee77d5df6671e65f96a30a4377"}
Jul 24 17:36:45.539765 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.539716    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-114.ec2.internal" podStartSLOduration=3.539702418 podStartE2EDuration="3.539702418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:36:45.539250579 +0000 UTC m=+4.571630942" watchObservedRunningTime="2026-07-24 17:36:45.539702418 +0000 UTC m=+4.572082779"
Jul 24 17:36:45.547972 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.547900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerStarted","Data":"9bd68db48e8bdeccc0e0c2bcf8a7c1134d9275c5e35fbc4e280af2c80a25c7b6"}
Jul 24 17:36:45.568010 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:45.567950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw" event={"ID":"6c46bde0-359b-4f7e-8fe2-ae7b87d05566","Type":"ContainerStarted","Data":"150e9fd5dc00680196c5eb914dfb235bc65087759ab80f9b3db5995577a649e1"}
Jul 24 17:36:46.453653 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:46.453617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:46.454192 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:46.453759    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:46.606368 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:46.605885    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal" event={"ID":"9c0b0ea39991f2367c86ab864e372477","Type":"ContainerStarted","Data":"0ee00ab8c0a8f82fa5a3bf92a5b78be1e9edf62a8624401c211c01a2e0e66dba"}
Jul 24 17:36:47.061547 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:47.060779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:47.061547 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:47.060851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:47.061547 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:47.060884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:47.061547 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061022    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:47.061547 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061110    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:51.061088258 +0000 UTC m=+10.093468599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:47.061547 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061520    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:47.062041 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061569    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:36:51.061554705 +0000 UTC m=+10.093935058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:47.062041 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061662    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:36:47.062041 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061678    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:36:47.062041 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061691    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:47.062041 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.061728    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:51.061716473 +0000 UTC m=+10.094096825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:47.456343 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:47.455673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:47.456343 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.455813    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:47.456343 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:47.456195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:47.456343 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:47.456288    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:48.454219 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:48.454188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:48.454386 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:48.454303    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:49.455198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:49.455151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:49.455198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:49.455198    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:49.455654 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:49.455284    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:49.455726 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:49.455641    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:50.453586 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:50.453552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:50.453815 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:50.453677    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:51.096202 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:51.096159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096315    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:51.096353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096385    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:36:59.096364448 +0000 UTC m=+18.128744800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:51.096432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096478    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096499    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096513    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096521    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096559    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:59.096547979 +0000 UTC m=+18.128928319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:51.096649 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.096575    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:36:59.096566025 +0000 UTC m=+18.128946374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:51.456151 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:51.456113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:51.456331 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:51.456160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:51.456331 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.456296    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:51.456776 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:51.456743    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:52.453900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:52.453866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:52.454352 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:52.453997    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:53.454536 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:53.454487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:53.454985 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:53.454620    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:53.454985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:53.454489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:53.455122 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:53.455063    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:54.453870 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:54.453839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:54.454050 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:54.453959    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:55.454371 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:55.454326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:55.454782 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:55.454345    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:55.454782 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:55.454457    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:55.454782 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:55.454507    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:56.453467 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:56.453436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:56.453647 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:56.453547    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:57.454267 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:57.454228    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:57.454724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:57.454276    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:57.454724 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:57.454381    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:36:57.454724 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:57.454477    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:58.453728 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:58.453694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:58.453948 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:58.453815    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:36:59.159488 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:59.159449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:59.159501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:59.159549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159632    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159652    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159667    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159719    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:37:15.159702814 +0000 UTC m=+34.192083150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159656    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159739    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:37:15.159728724 +0000 UTC m=+34.192109060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159752    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:59.159942 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.159820    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:37:15.159804743 +0000 UTC m=+34.192185093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:36:59.454240 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:59.454166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:36:59.454387 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:36:59.454173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:36:59.454387 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.454283    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:36:59.454387 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:36:59.454364    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:00.453360 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:00.453326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:00.453805 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:00.453454    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:01.454961 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:01.454921    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:01.455369 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:01.455041    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:01.455369 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:01.455089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:01.455369 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:01.455204    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:02.453526 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:02.453489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:02.453688 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:02.453607    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:03.453862 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.453689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:03.454554 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.453697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:03.454554 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:03.453968    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:03.454554 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:03.454071    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:03.644334 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.644294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xwrq" event={"ID":"36c1d58b-4ae3-4185-8609-a30eb99d7c39","Type":"ContainerStarted","Data":"222726f35870088eb352a4bc1fd886d0bb0fd37069a0e6feeaf88283e7d2902f"}
Jul 24 17:37:03.646433 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.646368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bwn98" event={"ID":"7db9c912-abc9-4682-a5a4-3f598bee3123","Type":"ContainerStarted","Data":"fe4cd203cf00dee13dab94c699fae9fa1fa2849f1e001b5c17052f97837257d7"}
Jul 24 17:37:03.648156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.648122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbfsh" event={"ID":"42e19666-20c4-42a5-bec9-37a0c8b3aa6e","Type":"ContainerStarted","Data":"6efba6ac9e8f926eb7f76452b4f259db75a7da19994691e099c7f8ec19ad7c82"}
Jul 24 17:37:03.652013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.651948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"9163f209532f260710d20c4beff389f762ef6e037aa0db3081d086a8664ce8b2"}
Jul 24 17:37:03.652131 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.652035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"4009a7ce06834f527a54e759e06fb92531b1b401059934f35b290e9064ab078e"}
Jul 24 17:37:03.652131 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.652091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"b85da5eee2c56f48237f715b6c57ca2249b13e2ae361fa320a260821fdee8e77"}
Jul 24 17:37:03.652256 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.652139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"824676759f4153f2201279e8b28500c38765e829e337dd363d515af108afdc68"}
Jul 24 17:37:03.652256 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.652186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"53b79b561ab47236724098b439165887d05ce614209c6a2a1925aa3e2d7f755f"}
Jul 24 17:37:03.652371 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.652259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"0819e5a70dae74e7c0ea0090e611a27be7c60cd425c9198a5a06c3e6906b697e"}
Jul 24 17:37:03.653639 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.653614    2564 generic.go:356] "Generic (PLEG): container finished" podID="26f06874-5a2f-4aab-980d-e27099e40f32" containerID="ac32c16f7de48dca5d2bf9128bb3be443d0720f4565559285311ad3db4b914d2" exitCode=0
Jul 24 17:37:03.653778 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.653752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerDied","Data":"ac32c16f7de48dca5d2bf9128bb3be443d0720f4565559285311ad3db4b914d2"}
Jul 24 17:37:03.656067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.656043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw" event={"ID":"6c46bde0-359b-4f7e-8fe2-ae7b87d05566","Type":"ContainerStarted","Data":"2806f11d519538af3b5bd2514e2f44b92cce5209790c1d190c3238b54a5132ee"}
Jul 24 17:37:03.658000 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.657979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-npt2z" event={"ID":"5ab61a84-5482-4cb5-8241-a7cb3d83d326","Type":"ContainerStarted","Data":"888965f392eaf990abeba2eab5d8950e9cff529fc7847b885bee9beda91f0bcf"}
Jul 24 17:37:03.660323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.660303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kl2mh" event={"ID":"fbec540a-1614-4eb9-b71b-fee45693436a","Type":"ContainerStarted","Data":"576964eefe278d92c8ce646d439cfa57600e38e8a9b0ce6fc66959d17ea01496"}
Jul 24 17:37:03.661422 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.661376    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-114.ec2.internal" podStartSLOduration=21.661359716 podStartE2EDuration="21.661359716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:36:46.622997927 +0000 UTC m=+5.655378288" watchObservedRunningTime="2026-07-24 17:37:03.661359716 +0000 UTC m=+22.693740076"
Jul 24 17:37:03.661881 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.661846    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9xwrq" podStartSLOduration=4.3596512579999995 podStartE2EDuration="22.661835178s" totalImagesPullingTime="18.30218392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:03.66107176 +0000 UTC m=+22.693452119" watchObservedRunningTime="2026-07-24 17:37:03.661835178 +0000 UTC m=+22.694215536"
Jul 24 17:37:03.680167 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.680086    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bwn98" podStartSLOduration=4.3188042939999995 podStartE2EDuration="22.680074825s" totalImagesPullingTime="18.361270531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:03.679012417 +0000 UTC m=+22.711392775" watchObservedRunningTime="2026-07-24 17:37:03.680074825 +0000 UTC m=+22.712455184"
Jul 24 17:37:03.694625 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.694589    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-npt2z" podStartSLOduration=3.397749243 podStartE2EDuration="21.6945767s" totalImagesPullingTime="18.296827457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:03.694463281 +0000 UTC m=+22.726843640" watchObservedRunningTime="2026-07-24 17:37:03.6945767 +0000 UTC m=+22.726957059"
Jul 24 17:37:03.713726 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.713676    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kl2mh" podStartSLOduration=4.412907189 podStartE2EDuration="22.71365791s" totalImagesPullingTime="18.300750721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:03.713385096 +0000 UTC m=+22.745765455" watchObservedRunningTime="2026-07-24 17:37:03.71365791 +0000 UTC m=+22.746038268"
Jul 24 17:37:03.728799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:03.728756    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fbfsh" podStartSLOduration=12.211024394 podStartE2EDuration="22.728739792s" totalImagesPullingTime="10.517715398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:03.728137545 +0000 UTC m=+22.760517902" watchObservedRunningTime="2026-07-24 17:37:03.728739792 +0000 UTC m=+22.761120150"
Jul 24 17:37:04.315019 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.314989    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:37:04.384203 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.384083    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:37:04.315013555Z","UUID":"c0a182f7-9516-4f89-9670-dd825c4ebba4","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:37:04.385729 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.385703    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:37:04.385847 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.385746    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:37:04.453635 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.453601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:04.453796 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:04.453714    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:04.665127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.665059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw" event={"ID":"6c46bde0-359b-4f7e-8fe2-ae7b87d05566","Type":"ContainerStarted","Data":"5972c681908c485c098e79ac1d9109632ae96007e2c8b0978d67d25e75ee6285"}
Jul 24 17:37:04.666669 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.666633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6x6l" event={"ID":"9e4beacc-551c-44fe-ad2e-4be857a1709c","Type":"ContainerStarted","Data":"bc598f83ee2eeab293838b81c4acaa618740088225f7aaf4478e8e52bc2bb12e"}
Jul 24 17:37:04.684085 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:04.684033    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c6x6l" podStartSLOduration=4.382898427 podStartE2EDuration="22.684002038s" totalImagesPullingTime="18.301103611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:04.683520452 +0000 UTC m=+23.715900811" watchObservedRunningTime="2026-07-24 17:37:04.684002038 +0000 UTC m=+23.716382400"
Jul 24 17:37:05.454435 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:05.454263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:05.454696 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:05.454340    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:05.454696 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:05.454525    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:05.454696 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:05.454617    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:05.671338 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:05.671309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw" event={"ID":"6c46bde0-359b-4f7e-8fe2-ae7b87d05566","Type":"ContainerStarted","Data":"184b3cec1d74c1bce5740edfe8d1dbc012bfc3b523b937fa92e61e8e7b92b674"}
Jul 24 17:37:05.708794 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:05.708719    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5zhw" podStartSLOduration=4.158120787 podStartE2EDuration="24.70870428s" totalImagesPullingTime="20.550583493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:05.708624461 +0000 UTC m=+24.741004826" watchObservedRunningTime="2026-07-24 17:37:05.70870428 +0000 UTC m=+24.741084637"
Jul 24 17:37:06.454130 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:06.454093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:06.454312 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:06.454217    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:06.678153 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:06.678118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"a0990e704ed826ed3ac067267646cf68137b511155757efcacb5d3e74ee1ba7e"}
Jul 24 17:37:07.122925 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:07.122886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:37:07.123520 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:07.123492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:37:07.454278 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:07.454239    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:07.454457 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:07.454240    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:07.454457 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:07.454374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:07.454457 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:07.454445    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:07.680382 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:07.680347    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:37:07.680979 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:07.680857    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fbfsh"
Jul 24 17:37:08.453851 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.453686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:08.453943 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:08.453926    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:08.685575 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.685545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" event={"ID":"9f738c2f-8e5a-4a6a-8e65-7604f91544fa","Type":"ContainerStarted","Data":"012a96e7ef0ccb668ea8cb5a7390dbc3a3838ded49079c149cb0b05d7fcd50d9"}
Jul 24 17:37:08.686099 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.685794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:37:08.686099 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.685861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:37:08.687511 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.687479    2564 generic.go:356] "Generic (PLEG): container finished" podID="26f06874-5a2f-4aab-980d-e27099e40f32" containerID="8f05049b05f0375648c5fc0af6612a9e4869c4e907ee466fd2fe75e7930ce914" exitCode=0
Jul 24 17:37:08.687629 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.687544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerDied","Data":"8f05049b05f0375648c5fc0af6612a9e4869c4e907ee466fd2fe75e7930ce914"}
Jul 24 17:37:08.701604 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.701576    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:37:08.716888 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:08.716849    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp" podStartSLOduration=9.340671538 podStartE2EDuration="27.716836968s" totalImagesPullingTime="18.37616543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:08.71647583 +0000 UTC m=+27.748856188" watchObservedRunningTime="2026-07-24 17:37:08.716836968 +0000 UTC m=+27.749217325"
Jul 24 17:37:09.454052 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:09.453998    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:09.454214 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:09.454084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:09.454214 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:09.454189    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:09.454478 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:09.454448    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:09.690144 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:09.690114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:37:09.703841 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:09.703813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:37:10.453875 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.453710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:10.454066 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:10.453945    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:10.583444 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.583415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x9s76"]
Jul 24 17:37:10.587255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.587225    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wx8pj"]
Jul 24 17:37:10.587368 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.587326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:10.587450 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:10.587430    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:10.599274 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.599247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4d5j5"]
Jul 24 17:37:10.599367 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.599339    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:10.599438 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:10.599421    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:10.694482 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.694442    2564 generic.go:356] "Generic (PLEG): container finished" podID="26f06874-5a2f-4aab-980d-e27099e40f32" containerID="f8ea33128da4e3fb9d65b571e4e38bb4523720e298e73471353378adf20ccb0c" exitCode=0
Jul 24 17:37:10.695085 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.694566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:10.695085 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:10.694707    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:10.695733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:10.695705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerDied","Data":"f8ea33128da4e3fb9d65b571e4e38bb4523720e298e73471353378adf20ccb0c"}
Jul 24 17:37:11.700304 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:11.700265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerStarted","Data":"ccfdbee51fdae4a642136e350216dab2066dd3da69c415ba8976fa1d30d6e9e1"}
Jul 24 17:37:12.454208 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:12.454185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:12.454208 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:12.454200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:12.454359 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:12.454184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:12.454359 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:12.454278    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:12.454359 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:12.454351    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:12.454445 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:12.454429    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:12.705140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:12.705055    2564 generic.go:356] "Generic (PLEG): container finished" podID="26f06874-5a2f-4aab-980d-e27099e40f32" containerID="ccfdbee51fdae4a642136e350216dab2066dd3da69c415ba8976fa1d30d6e9e1" exitCode=0
Jul 24 17:37:12.705140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:12.705103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerDied","Data":"ccfdbee51fdae4a642136e350216dab2066dd3da69c415ba8976fa1d30d6e9e1"}
Jul 24 17:37:14.453398 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:14.453360    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:14.453398 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:14.453390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:14.453866 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:14.453380    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:14.453866 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:14.453516    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:37:14.453866 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:14.453622    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9s76" podUID="2198a3b5-906f-45e7-8ed7-a0734bb65f27"
Jul 24 17:37:14.453866 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:14.453708    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wx8pj" podUID="bc5014fb-4c2f-4b12-b725-4e614956d342"
Jul 24 17:37:15.183953 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.183917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:15.184149 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.183982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:15.184149 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184099    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:37:15.184149 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184109    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:37:15.184149 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.184132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:15.184380 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184176    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:37:47.184157896 +0000 UTC m=+66.216538232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:37:15.184380 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184209    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:37:15.184380 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184248    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret podName:bc5014fb-4c2f-4b12-b725-4e614956d342 nodeName:}" failed. No retries permitted until 2026-07-24 17:37:47.184237388 +0000 UTC m=+66.216617724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret") pod "global-pull-secret-syncer-wx8pj" (UID: "bc5014fb-4c2f-4b12-b725-4e614956d342") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:37:15.184380 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184116    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:37:15.184380 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184266    2564 projected.go:196] Error preparing data for projected volume kube-api-access-gbpqt for pod openshift-network-diagnostics/network-check-target-x9s76: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:37:15.184380 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:15.184307    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt podName:2198a3b5-906f-45e7-8ed7-a0734bb65f27 nodeName:}" failed. No retries permitted until 2026-07-24 17:37:47.18429737 +0000 UTC m=+66.216677724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbpqt" (UniqueName: "kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt") pod "network-check-target-x9s76" (UID: "2198a3b5-906f-45e7-8ed7-a0734bb65f27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:37:15.799810 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.799549    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-114.ec2.internal" event="NodeReady"
Jul 24 17:37:15.800305 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.799867    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:37:15.854442 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.854411    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d2gv8"]
Jul 24 17:37:15.856957 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.856931    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pqp28"]
Jul 24 17:37:15.857116 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.857069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:15.859083 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.859060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:15.860323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.860298    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:37:15.860713 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.860691    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:37:15.860778 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.860719    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qpkwg\""
Jul 24 17:37:15.862820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.861223    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:37:15.862820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.861979    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7mn5h\""
Jul 24 17:37:15.862820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.862243    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:37:15.862820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.862462    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:37:15.866866 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.866841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d2gv8"]
Jul 24 17:37:15.870433 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.870410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqp28"]
Jul 24 17:37:15.989928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.989891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95601a7f-b046-4c9e-9745-5386d0a1f7bc-config-volume\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:15.990141 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.989971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9m4p\" (UniqueName: \"kubernetes.io/projected/95601a7f-b046-4c9e-9745-5386d0a1f7bc-kube-api-access-h9m4p\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:15.990141 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.990079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:15.990141 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.990123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95601a7f-b046-4c9e-9745-5386d0a1f7bc-tmp-dir\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:15.990300 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.990199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb1dcc7f-5409-4604-9a1a-f4e0c8095872-cert\") pod \"ingress-canary-d2gv8\" (UID: \"bb1dcc7f-5409-4604-9a1a-f4e0c8095872\") " pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:15.990300 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:15.990230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc6jv\" (UniqueName: \"kubernetes.io/projected/bb1dcc7f-5409-4604-9a1a-f4e0c8095872-kube-api-access-lc6jv\") pod \"ingress-canary-d2gv8\" (UID: \"bb1dcc7f-5409-4604-9a1a-f4e0c8095872\") " pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:16.090849 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.090759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.090849 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.090802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95601a7f-b046-4c9e-9745-5386d0a1f7bc-tmp-dir\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.090849 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.090826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb1dcc7f-5409-4604-9a1a-f4e0c8095872-cert\") pod \"ingress-canary-d2gv8\" (UID: \"bb1dcc7f-5409-4604-9a1a-f4e0c8095872\") " pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:16.090849 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.090847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc6jv\" (UniqueName: \"kubernetes.io/projected/bb1dcc7f-5409-4604-9a1a-f4e0c8095872-kube-api-access-lc6jv\") pod \"ingress-canary-d2gv8\" (UID: \"bb1dcc7f-5409-4604-9a1a-f4e0c8095872\") " pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:16.091191 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.090874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95601a7f-b046-4c9e-9745-5386d0a1f7bc-config-volume\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.091191 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.090928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9m4p\" (UniqueName: \"kubernetes.io/projected/95601a7f-b046-4c9e-9745-5386d0a1f7bc-kube-api-access-h9m4p\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.091528 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:16.091325    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:16.091528 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:16.091399    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:37:16.591380141 +0000 UTC m=+35.623760477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:16.091715 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.091666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95601a7f-b046-4c9e-9745-5386d0a1f7bc-tmp-dir\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.091949 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.091923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95601a7f-b046-4c9e-9745-5386d0a1f7bc-config-volume\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.096208 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.096189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb1dcc7f-5409-4604-9a1a-f4e0c8095872-cert\") pod \"ingress-canary-d2gv8\" (UID: \"bb1dcc7f-5409-4604-9a1a-f4e0c8095872\") " pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:16.100201 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.100179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9m4p\" (UniqueName: \"kubernetes.io/projected/95601a7f-b046-4c9e-9745-5386d0a1f7bc-kube-api-access-h9m4p\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.100687 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.100670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc6jv\" (UniqueName: \"kubernetes.io/projected/bb1dcc7f-5409-4604-9a1a-f4e0c8095872-kube-api-access-lc6jv\") pod \"ingress-canary-d2gv8\" (UID: \"bb1dcc7f-5409-4604-9a1a-f4e0c8095872\") " pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:16.172041 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.171996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d2gv8"
Jul 24 17:37:16.453621 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.453591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:16.453793 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.453592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:16.453890 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.453592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:16.456548 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.456531    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:37:16.456651 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.456533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lvv7h\""
Jul 24 17:37:16.456651 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.456533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:37:16.456736 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.456533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88pnr\""
Jul 24 17:37:16.457508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.457491    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:37:16.457573 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.457507    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:37:16.595182 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:16.594540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:16.595182 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:16.594722    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:16.595182 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:16.594794    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:37:17.594774969 +0000 UTC m=+36.627155306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:17.241269 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:17.241244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d2gv8"]
Jul 24 17:37:17.245619 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:37:17.245595    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1dcc7f_5409_4604_9a1a_f4e0c8095872.slice/crio-40b3ae40bdf82a5a157a1812ad37a9f09b64845b96a58301c4b91330976e57fe WatchSource:0}: Error finding container 40b3ae40bdf82a5a157a1812ad37a9f09b64845b96a58301c4b91330976e57fe: Status 404 returned error can't find the container with id 40b3ae40bdf82a5a157a1812ad37a9f09b64845b96a58301c4b91330976e57fe
Jul 24 17:37:17.604160 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:17.604125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:17.604327 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:17.604279    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:17.604368 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:17.604341    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:37:19.604327034 +0000 UTC m=+38.636707370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:17.718532 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:17.718494    2564 generic.go:356] "Generic (PLEG): container finished" podID="26f06874-5a2f-4aab-980d-e27099e40f32" containerID="e2f0003ff9c41f69e353821a5db0e4a7f3c53e861ace819fd6c1f184075d8091" exitCode=0
Jul 24 17:37:17.718703 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:17.718557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerDied","Data":"e2f0003ff9c41f69e353821a5db0e4a7f3c53e861ace819fd6c1f184075d8091"}
Jul 24 17:37:17.719627 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:17.719608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d2gv8" event={"ID":"bb1dcc7f-5409-4604-9a1a-f4e0c8095872","Type":"ContainerStarted","Data":"40b3ae40bdf82a5a157a1812ad37a9f09b64845b96a58301c4b91330976e57fe"}
Jul 24 17:37:18.725400 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:18.725359    2564 generic.go:356] "Generic (PLEG): container finished" podID="26f06874-5a2f-4aab-980d-e27099e40f32" containerID="751d5c681e494c6bf4e7f24dd8ec86dacd90acc634af2c791c69b59197186c18" exitCode=0
Jul 24 17:37:18.725844 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:18.725426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerDied","Data":"751d5c681e494c6bf4e7f24dd8ec86dacd90acc634af2c791c69b59197186c18"}
Jul 24 17:37:19.621800 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:19.621763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:19.621980 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:19.621939    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:19.622047 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:19.622017    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:37:23.622001622 +0000 UTC m=+42.654381958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:19.731884 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:19.731851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-787mq" event={"ID":"26f06874-5a2f-4aab-980d-e27099e40f32","Type":"ContainerStarted","Data":"8dd34c422fbe2737c6e72cd7a9e2c021cf80042df580b775797ef756d4651efd"}
Jul 24 17:37:19.756488 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:19.756439    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-787mq" podStartSLOduration=8.14550902 podStartE2EDuration="37.756419861s" totalImagesPullingTime="29.610910841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:19.756348042 +0000 UTC m=+38.788728438" watchObservedRunningTime="2026-07-24 17:37:19.756419861 +0000 UTC m=+38.788800218"
Jul 24 17:37:20.736981 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:20.736939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d2gv8" event={"ID":"bb1dcc7f-5409-4604-9a1a-f4e0c8095872","Type":"ContainerStarted","Data":"761a40e26d59a6de619b74a19398667d934fbfe02db242d90bcff8e21defe75e"}
Jul 24 17:37:20.753722 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:20.753671    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d2gv8" podStartSLOduration=3.372701866 podStartE2EDuration="5.753655438s" totalImagesPullingTime="2.380953572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:20.753148478 +0000 UTC m=+39.785528835" watchObservedRunningTime="2026-07-24 17:37:20.753655438 +0000 UTC m=+39.786035795"
Jul 24 17:37:23.651555 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:23.651513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:23.651943 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:23.651635    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:23.651943 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:23.651693    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:37:31.651679117 +0000 UTC m=+50.684059453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:31.705075 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:31.705035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:31.705511 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:31.705189    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:31.705511 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:31.705260    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:37:47.705243258 +0000 UTC m=+66.737623608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:41.724421 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:41.724391    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5j9pp"
Jul 24 17:37:47.210065 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.210003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:47.210065 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.210072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:47.210570 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.210122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:37:47.212993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.212972    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:37:47.213066 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.212976    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:37:47.213066 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.213046    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:37:47.220362 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:47.220339    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:37:47.220467 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:47.220408    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:38:51.220389225 +0000 UTC m=+130.252769562 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : secret "metrics-daemon-secret" not found
Jul 24 17:37:47.222994 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.222975    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:37:47.223545 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.223523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc5014fb-4c2f-4b12-b725-4e614956d342-original-pull-secret\") pod \"global-pull-secret-syncer-wx8pj\" (UID: \"bc5014fb-4c2f-4b12-b725-4e614956d342\") " pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:47.233169 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.233143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpqt\" (UniqueName: \"kubernetes.io/projected/2198a3b5-906f-45e7-8ed7-a0734bb65f27-kube-api-access-gbpqt\") pod \"network-check-target-x9s76\" (UID: \"2198a3b5-906f-45e7-8ed7-a0734bb65f27\") " pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:47.368160 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.368132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88pnr\""
Jul 24 17:37:47.370711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.370696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wx8pj"
Jul 24 17:37:47.376107 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.376084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:47.502643 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.502612    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wx8pj"]
Jul 24 17:37:47.505820 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:37:47.505792    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5014fb_4c2f_4b12_b725_4e614956d342.slice/crio-eaa0cb6c487a6a6b2ca43fcf24e58fe1b0974def8a106979fc5da62f482a9800 WatchSource:0}: Error finding container eaa0cb6c487a6a6b2ca43fcf24e58fe1b0974def8a106979fc5da62f482a9800: Status 404 returned error can't find the container with id eaa0cb6c487a6a6b2ca43fcf24e58fe1b0974def8a106979fc5da62f482a9800
Jul 24 17:37:47.520352 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.520328    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x9s76"]
Jul 24 17:37:47.523352 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:37:47.523323    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2198a3b5_906f_45e7_8ed7_a0734bb65f27.slice/crio-4fca6743eddadeff4e17689642e6b4d5b3d94dfbff7769f5b0e3d83733fa3d92 WatchSource:0}: Error finding container 4fca6743eddadeff4e17689642e6b4d5b3d94dfbff7769f5b0e3d83733fa3d92: Status 404 returned error can't find the container with id 4fca6743eddadeff4e17689642e6b4d5b3d94dfbff7769f5b0e3d83733fa3d92
Jul 24 17:37:47.714772 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.714736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:37:47.714939 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:47.714879    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:37:47.714980 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:37:47.714939    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:38:19.714924103 +0000 UTC m=+98.747304440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:37:47.798094 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.797986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wx8pj" event={"ID":"bc5014fb-4c2f-4b12-b725-4e614956d342","Type":"ContainerStarted","Data":"eaa0cb6c487a6a6b2ca43fcf24e58fe1b0974def8a106979fc5da62f482a9800"}
Jul 24 17:37:47.798989 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:47.798964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x9s76" event={"ID":"2198a3b5-906f-45e7-8ed7-a0734bb65f27","Type":"ContainerStarted","Data":"4fca6743eddadeff4e17689642e6b4d5b3d94dfbff7769f5b0e3d83733fa3d92"}
Jul 24 17:37:52.812329 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:52.812293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wx8pj" event={"ID":"bc5014fb-4c2f-4b12-b725-4e614956d342","Type":"ContainerStarted","Data":"89bcbafe0e89962747837732d826e33f6b2f93d9610165a4ab6deeb418b737fb"}
Jul 24 17:37:52.813694 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:52.813670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x9s76" event={"ID":"2198a3b5-906f-45e7-8ed7-a0734bb65f27","Type":"ContainerStarted","Data":"53821f13ed2aea711775d7003c4d30867f87759d215e86608684b943f767c6e9"}
Jul 24 17:37:52.813807 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:52.813797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:37:52.828011 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:52.827966    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wx8pj" podStartSLOduration=66.109738052 podStartE2EDuration="1m10.827953266s" totalImagesPullingTime="4.718215214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:52.827455327 +0000 UTC m=+71.859835685" watchObservedRunningTime="2026-07-24 17:37:52.827953266 +0000 UTC m=+71.860333671"
Jul 24 17:37:52.844110 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:37:52.844068    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x9s76" podStartSLOduration=67.146877487 podStartE2EDuration="1m11.84405355s" totalImagesPullingTime="4.697176063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:52.843528685 +0000 UTC m=+71.875909043" watchObservedRunningTime="2026-07-24 17:37:52.84405355 +0000 UTC m=+71.876433908"
Jul 24 17:38:19.723941 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:38:19.723803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:38:19.724321 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:38:19.723955    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:38:19.724321 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:38:19.724042    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:39:23.724011023 +0000 UTC m=+162.756391364 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:38:23.818655 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:38:23.818624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x9s76"
Jul 24 17:38:51.230835 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:38:51.230797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:38:51.231436 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:38:51.230919    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:38:51.231436 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:38:51.230988    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:40:53.230973745 +0000 UTC m=+252.263354081 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : secret "metrics-daemon-secret" not found
Jul 24 17:39:18.877736 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:39:18.877687    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pqp28" podUID="95601a7f-b046-4c9e-9745-5386d0a1f7bc"
Jul 24 17:39:19.008659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:39:19.008626    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqp28"
Jul 24 17:39:19.476533 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:39:19.476494    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:39:23.747615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:39:23.747571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:39:23.748111 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:39:23.747698    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:39:23.748111 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:39:23.747792    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls podName:95601a7f-b046-4c9e-9745-5386d0a1f7bc nodeName:}" failed. No retries permitted until 2026-07-24 17:41:25.747777669 +0000 UTC m=+284.780158009 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls") pod "dns-default-pqp28" (UID: "95601a7f-b046-4c9e-9745-5386d0a1f7bc") : secret "dns-default-metrics-tls" not found
Jul 24 17:39:31.455452 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:39:31.455414    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:40:44.807721 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.807689    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"]
Jul 24 17:40:44.809631 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.809616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.813267 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.813245    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 17:40:44.813616 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.813596    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"]
Jul 24 17:40:44.813961 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.813922    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:40:44.814055 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.813965    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:40:44.815203 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.815183    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h9gj8\""
Jul 24 17:40:44.816007 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.815864    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 17:40:44.821127 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.821108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.825149 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.825129    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 17:40:44.825245 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.825207    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 17:40:44.825245 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.825227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 17:40:44.825245 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.825227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cx5nw\""
Jul 24 17:40:44.825396 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.825227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:40:44.833939 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.833919    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"]
Jul 24 17:40:44.834826 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.834808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"]
Jul 24 17:40:44.887932 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.887896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f610788-8ae2-484f-a1ac-4f61cfae992a-config\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.888140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.887946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.888140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.887969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9gv\" (UniqueName: \"kubernetes.io/projected/2380aec2-248c-4671-8f4c-672f7a2198b7-kube-api-access-wz9gv\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.888140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.887993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4q9\" (UniqueName: \"kubernetes.io/projected/3f610788-8ae2-484f-a1ac-4f61cfae992a-kube-api-access-vp4q9\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.888140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.888014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2380aec2-248c-4671-8f4c-672f7a2198b7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.888140 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.888108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f610788-8ae2-484f-a1ac-4f61cfae992a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.910415 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.910381    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"]
Jul 24 17:40:44.912136 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.912117    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"]
Jul 24 17:40:44.912270 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.912252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"
Jul 24 17:40:44.913837 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.913818    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b8bc7cbc7-l48w7"]
Jul 24 17:40:44.913928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.913916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:44.914782 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.914766    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tkmh2\""
Jul 24 17:40:44.914936 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.914923    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:40:44.915059 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.915044    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 17:40:44.915638 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.915623    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.916838 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.916817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 17:40:44.916919 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.916842    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:40:44.916919 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.916841    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bcj5r\""
Jul 24 17:40:44.917673 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.917655    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 17:40:44.918191 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.918175    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 17:40:44.918274 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.918245    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4k4kx\""
Jul 24 17:40:44.918634 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.918456    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 17:40:44.918634 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.918487    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 17:40:44.923794 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.923775    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 17:40:44.926513 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.926489    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"]
Jul 24 17:40:44.927610 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.927586    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"]
Jul 24 17:40:44.929483 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.929465    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8bc7cbc7-l48w7"]
Jul 24 17:40:44.989256 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-trusted-ca\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989256 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hqhg\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-kube-api-access-6hqhg\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f610788-8ae2-484f-a1ac-4f61cfae992a-config\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9gv\" (UniqueName: \"kubernetes.io/projected/2380aec2-248c-4671-8f4c-672f7a2198b7-kube-api-access-wz9gv\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4q9\" (UniqueName: \"kubernetes.io/projected/3f610788-8ae2-484f-a1ac-4f61cfae992a-kube-api-access-vp4q9\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n8rh\" (UniqueName: \"kubernetes.io/projected/e29515f8-612d-4e33-b345-4f27f5926780-kube-api-access-2n8rh\") pod \"volume-data-source-validator-549c6d54cf-jnbzv\" (UID: \"e29515f8-612d-4e33-b345-4f27f5926780\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2380aec2-248c-4671-8f4c-672f7a2198b7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68b6d747-8e83-4d24-a083-b695324317b8-ca-trust-extracted\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-registry-certificates\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989477 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-bound-sa-token\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:44.989486    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:44.989552    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls podName:2380aec2-248c-4671-8f4c-672f7a2198b7 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:45.489533131 +0000 UTC m=+244.521913474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-scdpk" (UID: "2380aec2-248c-4671-8f4c-672f7a2198b7") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-installation-pull-secrets\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f610788-8ae2-484f-a1ac-4f61cfae992a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-image-registry-private-configuration\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnjn\" (UniqueName: \"kubernetes.io/projected/6ac73419-3416-4c42-b005-2b1ccf0bf964-kube-api-access-5cnjn\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:44.989895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.989872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f610788-8ae2-484f-a1ac-4f61cfae992a-config\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.990331 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.990246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2380aec2-248c-4671-8f4c-672f7a2198b7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:44.991717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.991701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f610788-8ae2-484f-a1ac-4f61cfae992a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.997646 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.997622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4q9\" (UniqueName: \"kubernetes.io/projected/3f610788-8ae2-484f-a1ac-4f61cfae992a-kube-api-access-vp4q9\") pod \"service-ca-operator-5d6c75f84f-4ltg6\" (UID: \"3f610788-8ae2-484f-a1ac-4f61cfae992a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:44.997748 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:44.997625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9gv\" (UniqueName: \"kubernetes.io/projected/2380aec2-248c-4671-8f4c-672f7a2198b7-kube-api-access-wz9gv\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:45.090920 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.090827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnjn\" (UniqueName: \"kubernetes.io/projected/6ac73419-3416-4c42-b005-2b1ccf0bf964-kube-api-access-5cnjn\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:45.090920 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.090881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-trusted-ca\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.090920 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.090899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hqhg\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-kube-api-access-6hqhg\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.090940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n8rh\" (UniqueName: \"kubernetes.io/projected/e29515f8-612d-4e33-b345-4f27f5926780-kube-api-access-2n8rh\") pod \"volume-data-source-validator-549c6d54cf-jnbzv\" (UID: \"e29515f8-612d-4e33-b345-4f27f5926780\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.090960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68b6d747-8e83-4d24-a083-b695324317b8-ca-trust-extracted\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.090975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-registry-certificates\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-bound-sa-token\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-installation-pull-secrets\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-image-registry-private-configuration\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091198 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.091195    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:40:45.091552 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.091215    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8bc7cbc7-l48w7: secret "image-registry-tls" not found
Jul 24 17:40:45.091552 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.091245    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:40:45.091552 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.091344    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls podName:68b6d747-8e83-4d24-a083-b695324317b8 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:45.591285382 +0000 UTC m=+244.623665732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls") pod "image-registry-b8bc7cbc7-l48w7" (UID: "68b6d747-8e83-4d24-a083-b695324317b8") : secret "image-registry-tls" not found
Jul 24 17:40:45.091552 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.091367    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls podName:6ac73419-3416-4c42-b005-2b1ccf0bf964 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:45.591355152 +0000 UTC m=+244.623735501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls") pod "cluster-samples-operator-6748489656-jcmw4" (UID: "6ac73419-3416-4c42-b005-2b1ccf0bf964") : secret "samples-operator-tls" not found
Jul 24 17:40:45.091552 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68b6d747-8e83-4d24-a083-b695324317b8-ca-trust-extracted\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091813 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-registry-certificates\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.091869 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.091834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-trusted-ca\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.093378 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.093355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-image-registry-private-configuration\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.093517 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.093499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-installation-pull-secrets\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.100284 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.100255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hqhg\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-kube-api-access-6hqhg\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.100398 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.100314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnjn\" (UniqueName: \"kubernetes.io/projected/6ac73419-3416-4c42-b005-2b1ccf0bf964-kube-api-access-5cnjn\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:45.100839 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.100814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n8rh\" (UniqueName: \"kubernetes.io/projected/e29515f8-612d-4e33-b345-4f27f5926780-kube-api-access-2n8rh\") pod \"volume-data-source-validator-549c6d54cf-jnbzv\" (UID: \"e29515f8-612d-4e33-b345-4f27f5926780\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"
Jul 24 17:40:45.100914 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.100890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-bound-sa-token\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.132077 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.132051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"
Jul 24 17:40:45.222392 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.222364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"
Jul 24 17:40:45.246789 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.246762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6"]
Jul 24 17:40:45.250197 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:40:45.250170    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f610788_8ae2_484f_a1ac_4f61cfae992a.slice/crio-edc6a4222c21c1fee794d0295b07f5a038d1d33ab36308cf0fcd11d23f8a6598 WatchSource:0}: Error finding container edc6a4222c21c1fee794d0295b07f5a038d1d33ab36308cf0fcd11d23f8a6598: Status 404 returned error can't find the container with id edc6a4222c21c1fee794d0295b07f5a038d1d33ab36308cf0fcd11d23f8a6598
Jul 24 17:40:45.337526 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.337496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv"]
Jul 24 17:40:45.341683 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:40:45.341107    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29515f8_612d_4e33_b345_4f27f5926780.slice/crio-cc9a77b5f428f16c87368c124094ebeb01fd67d84760aa6aafea860c22149396 WatchSource:0}: Error finding container cc9a77b5f428f16c87368c124094ebeb01fd67d84760aa6aafea860c22149396: Status 404 returned error can't find the container with id cc9a77b5f428f16c87368c124094ebeb01fd67d84760aa6aafea860c22149396
Jul 24 17:40:45.494657 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.494622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:45.494829 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.494736    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:45.494829 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.494786    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls podName:2380aec2-248c-4671-8f4c-672f7a2198b7 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:46.494772809 +0000 UTC m=+245.527153145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-scdpk" (UID: "2380aec2-248c-4671-8f4c-672f7a2198b7") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:45.595718 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.595632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:45.595884 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:45.595743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:45.595884 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.595806    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:40:45.595884 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.595837    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:40:45.595884 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.595860    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8bc7cbc7-l48w7: secret "image-registry-tls" not found
Jul 24 17:40:45.595884 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.595878    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls podName:6ac73419-3416-4c42-b005-2b1ccf0bf964 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:46.595859261 +0000 UTC m=+245.628239602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls") pod "cluster-samples-operator-6748489656-jcmw4" (UID: "6ac73419-3416-4c42-b005-2b1ccf0bf964") : secret "samples-operator-tls" not found
Jul 24 17:40:45.596159 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:45.595899    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls podName:68b6d747-8e83-4d24-a083-b695324317b8 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:46.595887315 +0000 UTC m=+245.628267650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls") pod "image-registry-b8bc7cbc7-l48w7" (UID: "68b6d747-8e83-4d24-a083-b695324317b8") : secret "image-registry-tls" not found
Jul 24 17:40:46.210715 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:46.210669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv" event={"ID":"e29515f8-612d-4e33-b345-4f27f5926780","Type":"ContainerStarted","Data":"cc9a77b5f428f16c87368c124094ebeb01fd67d84760aa6aafea860c22149396"}
Jul 24 17:40:46.211959 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:46.211927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6" event={"ID":"3f610788-8ae2-484f-a1ac-4f61cfae992a","Type":"ContainerStarted","Data":"edc6a4222c21c1fee794d0295b07f5a038d1d33ab36308cf0fcd11d23f8a6598"}
Jul 24 17:40:46.503319 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:46.503232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:46.503486 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.503400    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:46.503486 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.503477    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls podName:2380aec2-248c-4671-8f4c-672f7a2198b7 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:48.503456538 +0000 UTC m=+247.535836886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-scdpk" (UID: "2380aec2-248c-4671-8f4c-672f7a2198b7") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:46.603890 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:46.603850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:46.604116 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:46.603921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:46.604116 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.603999    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:40:46.604116 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.604016    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8bc7cbc7-l48w7: secret "image-registry-tls" not found
Jul 24 17:40:46.604116 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.604084    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:40:46.604116 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.604087    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls podName:68b6d747-8e83-4d24-a083-b695324317b8 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:48.604068993 +0000 UTC m=+247.636449343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls") pod "image-registry-b8bc7cbc7-l48w7" (UID: "68b6d747-8e83-4d24-a083-b695324317b8") : secret "image-registry-tls" not found
Jul 24 17:40:46.604383 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:46.604127    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls podName:6ac73419-3416-4c42-b005-2b1ccf0bf964 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:48.604116004 +0000 UTC m=+247.636496344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls") pod "cluster-samples-operator-6748489656-jcmw4" (UID: "6ac73419-3416-4c42-b005-2b1ccf0bf964") : secret "samples-operator-tls" not found
Jul 24 17:40:47.216005 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:47.215961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6" event={"ID":"3f610788-8ae2-484f-a1ac-4f61cfae992a","Type":"ContainerStarted","Data":"b59d57c71e723090eda9f2b8ee749031578f1ae3b295d95643e629125cbad21d"}
Jul 24 17:40:47.217426 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:47.217401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv" event={"ID":"e29515f8-612d-4e33-b345-4f27f5926780","Type":"ContainerStarted","Data":"8ba293ae6bd27d73ea44c9ad73fed28ec4752bad30df3022335690c3bd7dc7d2"}
Jul 24 17:40:47.233196 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:47.233141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6" podStartSLOduration=1.662074171 podStartE2EDuration="3.233122689s" totalImagesPullingTime="1.571048518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:47.231898141 +0000 UTC m=+246.264278512" watchObservedRunningTime="2026-07-24 17:40:47.233122689 +0000 UTC m=+246.265503047"
Jul 24 17:40:47.247169 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:47.247122    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-jnbzv" podStartSLOduration=2.290035015 podStartE2EDuration="3.247105758s" totalImagesPullingTime="957.070743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:47.246574174 +0000 UTC m=+246.278954533" watchObservedRunningTime="2026-07-24 17:40:47.247105758 +0000 UTC m=+246.279486208"
Jul 24 17:40:48.517865 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.517819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:48.518281 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.517972    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:48.518281 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.518065    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls podName:2380aec2-248c-4671-8f4c-672f7a2198b7 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:52.518042575 +0000 UTC m=+251.550422925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-scdpk" (UID: "2380aec2-248c-4671-8f4c-672f7a2198b7") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:48.618412 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.618378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:48.618524 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.618428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:48.618557 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.618536    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:40:48.618591 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.618564    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8bc7cbc7-l48w7: secret "image-registry-tls" not found
Jul 24 17:40:48.618591 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.618539    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:40:48.618651 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.618621    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls podName:68b6d747-8e83-4d24-a083-b695324317b8 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:52.618605042 +0000 UTC m=+251.650985402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls") pod "image-registry-b8bc7cbc7-l48w7" (UID: "68b6d747-8e83-4d24-a083-b695324317b8") : secret "image-registry-tls" not found
Jul 24 17:40:48.618651 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:48.618634    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls podName:6ac73419-3416-4c42-b005-2b1ccf0bf964 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:52.618628568 +0000 UTC m=+251.651008904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls") pod "cluster-samples-operator-6748489656-jcmw4" (UID: "6ac73419-3416-4c42-b005-2b1ccf0bf964") : secret "samples-operator-tls" not found
Jul 24 17:40:48.835829 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.835739    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v2rt5"]
Jul 24 17:40:48.838040 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.838004    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:48.840654 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.840624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:40:48.840738 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.840680    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:40:48.841779 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.841749    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cpj25\""
Jul 24 17:40:48.841779 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.841770    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:40:48.841919 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.841753    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:40:48.850911 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.850889    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v2rt5"]
Jul 24 17:40:48.920798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.920757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d29e7a52-5574-462a-a713-2a0149ea20c3-crio-socket\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:48.920798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.920795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d29e7a52-5574-462a-a713-2a0149ea20c3-data-volume\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:48.920993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.920928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:48.920993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.920968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:48.920993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:48.920987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxnw\" (UniqueName: \"kubernetes.io/projected/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-api-access-fnxnw\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021311 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021311 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxnw\" (UniqueName: \"kubernetes.io/projected/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-api-access-fnxnw\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d29e7a52-5574-462a-a713-2a0149ea20c3-crio-socket\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.021385    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d29e7a52-5574-462a-a713-2a0149ea20c3-crio-socket\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.021435    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d29e7a52-5574-462a-a713-2a0149ea20c3-data-volume\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.021464    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:49.521447576 +0000 UTC m=+248.553827927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : configmap "kube-rbac-proxy" not found
Jul 24 17:40:49.021509 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.021499    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:49.521482241 +0000 UTC m=+248.553862580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:49.021786 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.021769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d29e7a52-5574-462a-a713-2a0149ea20c3-data-volume\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.030634 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.030609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxnw\" (UniqueName: \"kubernetes.io/projected/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-api-access-fnxnw\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.527561 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.527511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.527561 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:49.527564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:49.528143 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.527633    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:40:49.528143 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.527670    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:49.528143 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.527694    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:50.527679354 +0000 UTC m=+249.560059694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : configmap "kube-rbac-proxy" not found
Jul 24 17:40:49.528143 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:49.527710    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:50.527699644 +0000 UTC m=+249.560079984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:50.302984 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.302952    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-pdh8m"]
Jul 24 17:40:50.304831 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.304814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.307357 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.307332    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 17:40:50.307612 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.307596    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 17:40:50.308592 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.308562    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 17:40:50.308689 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.308562    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kvc59\""
Jul 24 17:40:50.308753 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.308644    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 17:40:50.315775 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.315755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-pdh8m"]
Jul 24 17:40:50.435255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.435216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5cd117dd-a688-4817-a994-7b0656135eb6-signing-cabundle\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.435255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.435255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnt9z\" (UniqueName: \"kubernetes.io/projected/5cd117dd-a688-4817-a994-7b0656135eb6-kube-api-access-xnt9z\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.435459 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.435276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5cd117dd-a688-4817-a994-7b0656135eb6-signing-key\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.535817 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.535774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:50.536195 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:50.535937    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:50.536195 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.535970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5cd117dd-a688-4817-a994-7b0656135eb6-signing-cabundle\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.536195 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:50.536010    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:52.535992411 +0000 UTC m=+251.568372754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:50.536195 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.536048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnt9z\" (UniqueName: \"kubernetes.io/projected/5cd117dd-a688-4817-a994-7b0656135eb6-kube-api-access-xnt9z\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.536195 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.536084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5cd117dd-a688-4817-a994-7b0656135eb6-signing-key\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.536195 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.536134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:50.536417 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:50.536229    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:40:50.536417 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:50.536277    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:52.536262117 +0000 UTC m=+251.568642473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : configmap "kube-rbac-proxy" not found
Jul 24 17:40:50.536685 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.536667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5cd117dd-a688-4817-a994-7b0656135eb6-signing-cabundle\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.538422 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.538403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5cd117dd-a688-4817-a994-7b0656135eb6-signing-key\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.544400 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.544370    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnt9z\" (UniqueName: \"kubernetes.io/projected/5cd117dd-a688-4817-a994-7b0656135eb6-kube-api-access-xnt9z\") pod \"service-ca-658d7b7c78-pdh8m\" (UID: \"5cd117dd-a688-4817-a994-7b0656135eb6\") " pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.613860 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.613773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m"
Jul 24 17:40:50.731110 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.731070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-pdh8m"]
Jul 24 17:40:50.733870 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:40:50.733834    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd117dd_a688_4817_a994_7b0656135eb6.slice/crio-ee45c8c7f3f994a0801028728f50251a84b42be9a86499419a7c4871701a8e34 WatchSource:0}: Error finding container ee45c8c7f3f994a0801028728f50251a84b42be9a86499419a7c4871701a8e34: Status 404 returned error can't find the container with id ee45c8c7f3f994a0801028728f50251a84b42be9a86499419a7c4871701a8e34
Jul 24 17:40:50.832517 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:50.832485    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-npt2z_5ab61a84-5482-4cb5-8241-a7cb3d83d326/dns-node-resolver/0.log"
Jul 24 17:40:51.237046 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:51.236997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m" event={"ID":"5cd117dd-a688-4817-a994-7b0656135eb6","Type":"ContainerStarted","Data":"f598a2e9156172e00b907e6797e3278d866d079fe75bd77a8962b9da8d579838"}
Jul 24 17:40:51.237242 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:51.237083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m" event={"ID":"5cd117dd-a688-4817-a994-7b0656135eb6","Type":"ContainerStarted","Data":"ee45c8c7f3f994a0801028728f50251a84b42be9a86499419a7c4871701a8e34"}
Jul 24 17:40:51.254732 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:51.254685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-pdh8m" podStartSLOduration=1.2546704530000001 podStartE2EDuration="1.254670453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:51.253666254 +0000 UTC m=+250.286046680" watchObservedRunningTime="2026-07-24 17:40:51.254670453 +0000 UTC m=+250.287050811"
Jul 24 17:40:51.633348 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:51.633256    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xwrq_36c1d58b-4ae3-4185-8609-a30eb99d7c39/node-ca/0.log"
Jul 24 17:40:52.555580 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:52.555533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:52.555766 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:52.555587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:52.555766 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:52.555637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:40:52.555766 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.555651    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:40:52.555766 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.555725    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:56.55569843 +0000 UTC m=+255.588078774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : configmap "kube-rbac-proxy" not found
Jul 24 17:40:52.555977 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.555768    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:52.555977 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.555820    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls podName:2380aec2-248c-4671-8f4c-672f7a2198b7 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:00.555804015 +0000 UTC m=+259.588184367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-scdpk" (UID: "2380aec2-248c-4671-8f4c-672f7a2198b7") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:40:52.555977 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.555768    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:52.555977 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.555870    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:40:56.555860567 +0000 UTC m=+255.588240903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:52.631405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:52.631377    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d2gv8_bb1dcc7f-5409-4604-9a1a-f4e0c8095872/serve-healthcheck-canary/0.log"
Jul 24 17:40:52.656413 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:52.656377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:40:52.656834 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.656516    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:40:52.656834 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.656536    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b8bc7cbc7-l48w7: secret "image-registry-tls" not found
Jul 24 17:40:52.656834 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:52.656515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:40:52.656834 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.656583    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls podName:68b6d747-8e83-4d24-a083-b695324317b8 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:00.656568645 +0000 UTC m=+259.688948982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls") pod "image-registry-b8bc7cbc7-l48w7" (UID: "68b6d747-8e83-4d24-a083-b695324317b8") : secret "image-registry-tls" not found
Jul 24 17:40:52.656834 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.656605    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:40:52.656834 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:52.656660    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls podName:6ac73419-3416-4c42-b005-2b1ccf0bf964 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:00.656644686 +0000 UTC m=+259.689025029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls") pod "cluster-samples-operator-6748489656-jcmw4" (UID: "6ac73419-3416-4c42-b005-2b1ccf0bf964") : secret "samples-operator-tls" not found
Jul 24 17:40:53.262271 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:53.262239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:40:53.262447 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:53.262349    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:40:53.262447 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:53.262397    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs podName:39726eac-a819-439a-a511-3c067cae4a0d nodeName:}" failed. No retries permitted until 2026-07-24 17:42:55.262383046 +0000 UTC m=+374.294763386 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs") pod "network-metrics-daemon-4d5j5" (UID: "39726eac-a819-439a-a511-3c067cae4a0d") : secret "metrics-daemon-secret" not found
Jul 24 17:40:56.590323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:56.590270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:56.590682 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:40:56.590411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:40:56.590682 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:56.590428    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:56.590682 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:56.590492    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:40:56.590682 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:56.590527    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:04.590505914 +0000 UTC m=+263.622886272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:40:56.590682 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:40:56.590552    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm podName:d29e7a52-5574-462a-a713-2a0149ea20c3 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:04.590537002 +0000 UTC m=+263.622917352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v2rt5" (UID: "d29e7a52-5574-462a-a713-2a0149ea20c3") : configmap "kube-rbac-proxy" not found
Jul 24 17:41:00.622350 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.622303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:41:00.624672 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.624647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2380aec2-248c-4671-8f4c-672f7a2198b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-scdpk\" (UID: \"2380aec2-248c-4671-8f4c-672f7a2198b7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:41:00.717869 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.717822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"
Jul 24 17:41:00.723502 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.723474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:00.723649 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.723635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:41:00.725822 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.725795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"image-registry-b8bc7cbc7-l48w7\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") " pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:00.725928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.725868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ac73419-3416-4c42-b005-2b1ccf0bf964-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jcmw4\" (UID: \"6ac73419-3416-4c42-b005-2b1ccf0bf964\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:41:00.830468 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.830439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"
Jul 24 17:41:00.836056 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.836017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:00.844553 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.844401    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk"]
Jul 24 17:41:00.848557 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:00.848515    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2380aec2_248c_4671_8f4c_672f7a2198b7.slice/crio-834216e78b4c8b12b30ca074a67c8364b9375c34c55e481d9e17ea2ab8005d13 WatchSource:0}: Error finding container 834216e78b4c8b12b30ca074a67c8364b9375c34c55e481d9e17ea2ab8005d13: Status 404 returned error can't find the container with id 834216e78b4c8b12b30ca074a67c8364b9375c34c55e481d9e17ea2ab8005d13
Jul 24 17:41:00.967894 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.967861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4"]
Jul 24 17:41:00.990347 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:00.990319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b8bc7cbc7-l48w7"]
Jul 24 17:41:00.993564 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:00.993542    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b6d747_8e83_4d24_a083_b695324317b8.slice/crio-09de4af05d8e76a666720346f040b0dcbffb36941f5b9470c49fa3529e7590d0 WatchSource:0}: Error finding container 09de4af05d8e76a666720346f040b0dcbffb36941f5b9470c49fa3529e7590d0: Status 404 returned error can't find the container with id 09de4af05d8e76a666720346f040b0dcbffb36941f5b9470c49fa3529e7590d0
Jul 24 17:41:01.269068 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:01.269015    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk" event={"ID":"2380aec2-248c-4671-8f4c-672f7a2198b7","Type":"ContainerStarted","Data":"834216e78b4c8b12b30ca074a67c8364b9375c34c55e481d9e17ea2ab8005d13"}
Jul 24 17:41:01.270326 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:01.270303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4" event={"ID":"6ac73419-3416-4c42-b005-2b1ccf0bf964","Type":"ContainerStarted","Data":"dc8fb416fb8603d419521cf91dd7a6fc90d380b5777e9206ae37bfac701f9555"}
Jul 24 17:41:01.271942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:01.271907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" event={"ID":"68b6d747-8e83-4d24-a083-b695324317b8","Type":"ContainerStarted","Data":"092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f"}
Jul 24 17:41:01.272078 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:01.271947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" event={"ID":"68b6d747-8e83-4d24-a083-b695324317b8","Type":"ContainerStarted","Data":"09de4af05d8e76a666720346f040b0dcbffb36941f5b9470c49fa3529e7590d0"}
Jul 24 17:41:01.272078 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:01.272058    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:01.292069 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:01.291994    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" podStartSLOduration=17.29194131 podStartE2EDuration="17.29194131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:01.290976207 +0000 UTC m=+260.323356566" watchObservedRunningTime="2026-07-24 17:41:01.29194131 +0000 UTC m=+260.324321669"
Jul 24 17:41:03.281284 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:03.281243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk" event={"ID":"2380aec2-248c-4671-8f4c-672f7a2198b7","Type":"ContainerStarted","Data":"357fc821493e5d0bb842502bb95b6397926b8d96ed4cceb1a11c16aa42e65463"}
Jul 24 17:41:03.282985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:03.282963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4" event={"ID":"6ac73419-3416-4c42-b005-2b1ccf0bf964","Type":"ContainerStarted","Data":"8c99e59e1a00d8cfed038e9039fec377cbbdca2a42c8931d070f595ff0e18cf1"}
Jul 24 17:41:03.283115 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:03.283003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4" event={"ID":"6ac73419-3416-4c42-b005-2b1ccf0bf964","Type":"ContainerStarted","Data":"96dca4c1b0672cfc381857c26210e6b32a7a416c997e2cbf2bd04c04b8cde369"}
Jul 24 17:41:03.301103 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:03.301048    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-scdpk" podStartSLOduration=17.298125183 podStartE2EDuration="19.30102032s" totalImagesPullingTime="2.002895137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:03.299631442 +0000 UTC m=+262.332011800" watchObservedRunningTime="2026-07-24 17:41:03.30102032 +0000 UTC m=+262.333400678"
Jul 24 17:41:04.656872 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.656836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:41:04.656872 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.656879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:41:04.657386 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.657368    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d29e7a52-5574-462a-a713-2a0149ea20c3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:41:04.659117 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.659095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d29e7a52-5574-462a-a713-2a0149ea20c3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2rt5\" (UID: \"d29e7a52-5574-462a-a713-2a0149ea20c3\") " pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:41:04.747341 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.747291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v2rt5"
Jul 24 17:41:04.870768 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.870717    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jcmw4" podStartSLOduration=19.02334613 podStartE2EDuration="20.870699645s" totalImagesPullingTime="1.847353515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:03.317006814 +0000 UTC m=+262.349387173" watchObservedRunningTime="2026-07-24 17:41:04.870699645 +0000 UTC m=+263.903080029"
Jul 24 17:41:04.871374 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:04.871358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v2rt5"]
Jul 24 17:41:04.873695 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:04.873670    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd29e7a52_5574_462a_a713_2a0149ea20c3.slice/crio-3cf3a863839bf30b3e07f23fe8a088f8cf13c651103ef820c5f566a617d05a53 WatchSource:0}: Error finding container 3cf3a863839bf30b3e07f23fe8a088f8cf13c651103ef820c5f566a617d05a53: Status 404 returned error can't find the container with id 3cf3a863839bf30b3e07f23fe8a088f8cf13c651103ef820c5f566a617d05a53
Jul 24 17:41:05.292081 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:05.292008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2rt5" event={"ID":"d29e7a52-5574-462a-a713-2a0149ea20c3","Type":"ContainerStarted","Data":"3cf3a863839bf30b3e07f23fe8a088f8cf13c651103ef820c5f566a617d05a53"}
Jul 24 17:41:10.311433 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:10.311387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2rt5" event={"ID":"d29e7a52-5574-462a-a713-2a0149ea20c3","Type":"ContainerStarted","Data":"81fde0b6097a2b821584aa6f49a6f7f40bcf0cefe3fe5a7882331bcb919bc17a"}
Jul 24 17:41:12.542316 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.542227    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"]
Jul 24 17:41:12.547238 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.547210    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-57tss"]
Jul 24 17:41:12.548008 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.547960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:12.549337 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.549317    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:12.550767 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.550746    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 17:41:12.551192 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.551170    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tvkd5\""
Jul 24 17:41:12.552099 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.552077    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 17:41:12.552099 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.552081    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lkh6b\""
Jul 24 17:41:12.552289 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.552102    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 17:41:12.559861 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.559792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"]
Jul 24 17:41:12.567396 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.567041    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b8bc7cbc7-l48w7"]
Jul 24 17:41:12.567770 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.567746    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-57tss"]
Jul 24 17:41:12.601705 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.601673    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c5b4c757f-cp6v6"]
Jul 24 17:41:12.605052 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.605006    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.623889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.623863    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5b4c757f-cp6v6"]
Jul 24 17:41:12.721339 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-registry-tls\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23df5762-a60b-41a9-89f3-6457b5c77f2e-registry-certificates\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d20e58b-d359-4aec-b243-e5023341eeec-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-lqv94\" (UID: \"9d20e58b-d359-4aec-b243-e5023341eeec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:12.721540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23df5762-a60b-41a9-89f3-6457b5c77f2e-trusted-ca\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721698 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23df5762-a60b-41a9-89f3-6457b5c77f2e-installation-pull-secrets\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721698 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56x5w\" (UniqueName: \"kubernetes.io/projected/6cbc6b95-4a39-4c37-a7d0-bad18f2df270-kube-api-access-56x5w\") pod \"downloads-7c97dc4555-57tss\" (UID: \"6cbc6b95-4a39-4c37-a7d0-bad18f2df270\") " pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:12.721698 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23df5762-a60b-41a9-89f3-6457b5c77f2e-image-registry-private-configuration\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721698 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23df5762-a60b-41a9-89f3-6457b5c77f2e-ca-trust-extracted\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721698 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7sd6\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-kube-api-access-g7sd6\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.721897 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.721711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-bound-sa-token\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.822914 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.822823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23df5762-a60b-41a9-89f3-6457b5c77f2e-image-registry-private-configuration\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.822914 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.822882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23df5762-a60b-41a9-89f3-6457b5c77f2e-ca-trust-extracted\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.822917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7sd6\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-kube-api-access-g7sd6\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.822948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-bound-sa-token\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.822981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-registry-tls\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23df5762-a60b-41a9-89f3-6457b5c77f2e-registry-certificates\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d20e58b-d359-4aec-b243-e5023341eeec-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-lqv94\" (UID: \"9d20e58b-d359-4aec-b243-e5023341eeec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23df5762-a60b-41a9-89f3-6457b5c77f2e-trusted-ca\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23df5762-a60b-41a9-89f3-6457b5c77f2e-installation-pull-secrets\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823531 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56x5w\" (UniqueName: \"kubernetes.io/projected/6cbc6b95-4a39-4c37-a7d0-bad18f2df270-kube-api-access-56x5w\") pod \"downloads-7c97dc4555-57tss\" (UID: \"6cbc6b95-4a39-4c37-a7d0-bad18f2df270\") " pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:12.823531 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23df5762-a60b-41a9-89f3-6457b5c77f2e-ca-trust-extracted\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.823943 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.823919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23df5762-a60b-41a9-89f3-6457b5c77f2e-registry-certificates\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.824355 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.824324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23df5762-a60b-41a9-89f3-6457b5c77f2e-trusted-ca\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.826117 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.826090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-registry-tls\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.826117 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.826096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23df5762-a60b-41a9-89f3-6457b5c77f2e-image-registry-private-configuration\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.826255 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.826159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d20e58b-d359-4aec-b243-e5023341eeec-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-lqv94\" (UID: \"9d20e58b-d359-4aec-b243-e5023341eeec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:12.826774 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.826746    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23df5762-a60b-41a9-89f3-6457b5c77f2e-installation-pull-secrets\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.833849 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.833820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-bound-sa-token\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.833984 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.833902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56x5w\" (UniqueName: \"kubernetes.io/projected/6cbc6b95-4a39-4c37-a7d0-bad18f2df270-kube-api-access-56x5w\") pod \"downloads-7c97dc4555-57tss\" (UID: \"6cbc6b95-4a39-4c37-a7d0-bad18f2df270\") " pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:12.834574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.834533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7sd6\" (UniqueName: \"kubernetes.io/projected/23df5762-a60b-41a9-89f3-6457b5c77f2e-kube-api-access-g7sd6\") pod \"image-registry-7c5b4c757f-cp6v6\" (UID: \"23df5762-a60b-41a9-89f3-6457b5c77f2e\") " pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:12.865468 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.865426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:12.870013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.869944    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:12.915655 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:12.915618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:13.229555 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.229470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5b4c757f-cp6v6"]
Jul 24 17:41:13.232470 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:13.232438    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23df5762_a60b_41a9_89f3_6457b5c77f2e.slice/crio-3fd48bce4653c9dfa7588f676957f3f0bdc77a20291a87e8c7d054f641bf8163 WatchSource:0}: Error finding container 3fd48bce4653c9dfa7588f676957f3f0bdc77a20291a87e8c7d054f641bf8163: Status 404 returned error can't find the container with id 3fd48bce4653c9dfa7588f676957f3f0bdc77a20291a87e8c7d054f641bf8163
Jul 24 17:41:13.257183 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.257148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-57tss"]
Jul 24 17:41:13.260970 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:13.260912    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbc6b95_4a39_4c37_a7d0_bad18f2df270.slice/crio-d51be798a2c9d00b6e402cebd52529d3d52a645c56f1012068dcd6b7f74bec20 WatchSource:0}: Error finding container d51be798a2c9d00b6e402cebd52529d3d52a645c56f1012068dcd6b7f74bec20: Status 404 returned error can't find the container with id d51be798a2c9d00b6e402cebd52529d3d52a645c56f1012068dcd6b7f74bec20
Jul 24 17:41:13.273614 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.273588    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"]
Jul 24 17:41:13.279167 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:13.279142    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d20e58b_d359_4aec_b243_e5023341eeec.slice/crio-c426b9238daf181168de088ad2b7af0562c4daca94674f65df2644bc1cb9aa84 WatchSource:0}: Error finding container c426b9238daf181168de088ad2b7af0562c4daca94674f65df2644bc1cb9aa84: Status 404 returned error can't find the container with id c426b9238daf181168de088ad2b7af0562c4daca94674f65df2644bc1cb9aa84
Jul 24 17:41:13.323284 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.323249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94" event={"ID":"9d20e58b-d359-4aec-b243-e5023341eeec","Type":"ContainerStarted","Data":"c426b9238daf181168de088ad2b7af0562c4daca94674f65df2644bc1cb9aa84"}
Jul 24 17:41:13.324553 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.324522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-57tss" event={"ID":"6cbc6b95-4a39-4c37-a7d0-bad18f2df270","Type":"ContainerStarted","Data":"d51be798a2c9d00b6e402cebd52529d3d52a645c56f1012068dcd6b7f74bec20"}
Jul 24 17:41:13.326411 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.326390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2rt5" event={"ID":"d29e7a52-5574-462a-a713-2a0149ea20c3","Type":"ContainerStarted","Data":"3d80b15e667634df58fefacf8f8dbd267961afb68b5e34831438bf587e09ac01"}
Jul 24 17:41:13.327792 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.327767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6" event={"ID":"23df5762-a60b-41a9-89f3-6457b5c77f2e","Type":"ContainerStarted","Data":"c0bd51292ac6525f360a6696f0d410ccc864d2526a0035e3930c63c2acf0d0e0"}
Jul 24 17:41:13.327880 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.327811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6" event={"ID":"23df5762-a60b-41a9-89f3-6457b5c77f2e","Type":"ContainerStarted","Data":"3fd48bce4653c9dfa7588f676957f3f0bdc77a20291a87e8c7d054f641bf8163"}
Jul 24 17:41:13.327916 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.327903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:13.351524 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:13.351412    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6" podStartSLOduration=1.3513960520000001 podStartE2EDuration="1.351396052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:13.35112566 +0000 UTC m=+272.383506017" watchObservedRunningTime="2026-07-24 17:41:13.351396052 +0000 UTC m=+272.383776392"
Jul 24 17:41:15.338572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:15.338535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94" event={"ID":"9d20e58b-d359-4aec-b243-e5023341eeec","Type":"ContainerStarted","Data":"1f07b3d3913ecd89743397088fe526890f4f95ea7d9036c90b6353e426985347"}
Jul 24 17:41:15.339046 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:15.338729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:15.345327 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:15.345293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94"
Jul 24 17:41:15.354767 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:15.354713    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lqv94" podStartSLOduration=2.045759937 podStartE2EDuration="3.354691666s" totalImagesPullingTime="1.308931729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:15.354523195 +0000 UTC m=+274.386903554" watchObservedRunningTime="2026-07-24 17:41:15.354691666 +0000 UTC m=+274.387072026"
Jul 24 17:41:18.352331 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:18.352289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2rt5" event={"ID":"d29e7a52-5574-462a-a713-2a0149ea20c3","Type":"ContainerStarted","Data":"5a1eb42cbc211851d083890f54bfdd59c72e766aae56246232786024b35f42b3"}
Jul 24 17:41:18.370707 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:18.370651    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v2rt5" podStartSLOduration=18.122482541 podStartE2EDuration="30.37063637s" totalImagesPullingTime="12.248153829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:40:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:18.369072451 +0000 UTC m=+277.401452810" watchObservedRunningTime="2026-07-24 17:41:18.37063637 +0000 UTC m=+277.403016727"
Jul 24 17:41:20.800740 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.799345    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"]
Jul 24 17:41:20.804020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.802915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.809441 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.809415    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 17:41:20.809606 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.809586    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fnwrg\""
Jul 24 17:41:20.811717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.810692    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 17:41:20.811717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.810888    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:41:20.821832 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.821808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"]
Jul 24 17:41:20.845039 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.845005    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k5txh"]
Jul 24 17:41:20.847574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.847549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.850330 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.850306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:41:20.850444 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.850396    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xfx6g\""
Jul 24 17:41:20.850444 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.850405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:41:20.850665 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.850638    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:41:20.893650 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.893841 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-metrics-client-ca\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.893841 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.893841 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.893841 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.894072 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-sys\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.894072 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-accelerators-collector-config\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.894072 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjvq\" (UniqueName: \"kubernetes.io/projected/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-kube-api-access-6qjvq\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.894072 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.893965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-root\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.894072 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.894000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-textfile\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.894072 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.894066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-wtmp\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.894378 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.894090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c757g\" (UniqueName: \"kubernetes.io/projected/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-kube-api-access-c757g\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.894378 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.894128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.994813 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-metrics-client-ca\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.994813 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-sys\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-accelerators-collector-config\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:20.994956    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjvq\" (UniqueName: \"kubernetes.io/projected/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-kube-api-access-6qjvq\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.994991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-root\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-textfile\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-sys\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995098 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:20.995052    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls podName:fdbd20aa-2f48-4da4-a3f2-1c5abf69e351 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:21.495018036 +0000 UTC m=+280.527398373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls") pod "node-exporter-k5txh" (UID: "fdbd20aa-2f48-4da4-a3f2-1c5abf69e351") : secret "node-exporter-tls" not found
Jul 24 17:41:20.995615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-wtmp\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c757g\" (UniqueName: \"kubernetes.io/projected/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-kube-api-access-c757g\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.995615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.995615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-metrics-client-ca\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-wtmp\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995926 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-root\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.995926 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.995852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-accelerators-collector-config\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.996105 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.996086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.996170 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.996108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-textfile\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.997978 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.997914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:20.997978 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.997948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:20.998142 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:20.998060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:21.005577 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.005550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c757g\" (UniqueName: \"kubernetes.io/projected/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-kube-api-access-c757g\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:21.006143 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.006123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjvq\" (UniqueName: \"kubernetes.io/projected/9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94-kube-api-access-6qjvq\") pod \"openshift-state-metrics-b8f49f5c6-nwlhr\" (UID: \"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:21.115962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.115879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"
Jul 24 17:41:21.272323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.271797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr"]
Jul 24 17:41:21.274901 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:21.274865    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd7cbe3_9cf7_4a5b_84cd_61f60cdbbf94.slice/crio-9ece1db955977d43b997bd1f668a5726cfb76422d5dba691388db747dfe27321 WatchSource:0}: Error finding container 9ece1db955977d43b997bd1f668a5726cfb76422d5dba691388db747dfe27321: Status 404 returned error can't find the container with id 9ece1db955977d43b997bd1f668a5726cfb76422d5dba691388db747dfe27321
Jul 24 17:41:21.363898 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.363811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr" event={"ID":"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94","Type":"ContainerStarted","Data":"008f9a85bddf9e90a07da7e96048e687b49d5141079a834e63a07866e593a884"}
Jul 24 17:41:21.363898 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.363871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr" event={"ID":"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94","Type":"ContainerStarted","Data":"9ece1db955977d43b997bd1f668a5726cfb76422d5dba691388db747dfe27321"}
Jul 24 17:41:21.499575 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:21.499512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:21.499779 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:21.499681    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:41:21.499779 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:21.499752    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls podName:fdbd20aa-2f48-4da4-a3f2-1c5abf69e351 nodeName:}" failed. No retries permitted until 2026-07-24 17:41:22.499732843 +0000 UTC m=+281.532113192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls") pod "node-exporter-k5txh" (UID: "fdbd20aa-2f48-4da4-a3f2-1c5abf69e351") : secret "node-exporter-tls" not found
Jul 24 17:41:22.010892 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:22.010093    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pqp28" podUID="95601a7f-b046-4c9e-9745-5386d0a1f7bc"
Jul 24 17:41:22.248018 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.247952    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c5d99f6db-4x6lg"]
Jul 24 17:41:22.250736 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.250706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.254941 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.253927    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 17:41:22.254941 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.254202    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 17:41:22.254941 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.254905    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 17:41:22.255198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.255149    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 17:41:22.255353 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.255336    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 17:41:22.255596 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.255573    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6mw9c\""
Jul 24 17:41:22.266078 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.265046    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5d99f6db-4x6lg"]
Jul 24 17:41:22.308073 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.307978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt98v\" (UniqueName: \"kubernetes.io/projected/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-kube-api-access-mt98v\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.308265 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.308100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-oauth-serving-cert\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.308265 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.308188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-config\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.308265 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.308252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-service-ca\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.308419 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.308328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-serving-cert\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.308419 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.308361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-oauth-config\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.370697 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.370667    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqp28"
Jul 24 17:41:22.370885 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.370734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr" event={"ID":"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94","Type":"ContainerStarted","Data":"cff4a58e70514f8b27e4dc89b2a5266129c79a148fe3660340873044a5ae68df"}
Jul 24 17:41:22.409951 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.409522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-oauth-serving-cert\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.409951 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.409610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-config\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.409951 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.409638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-service-ca\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.410257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.409967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-serving-cert\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.410257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.410006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-oauth-config\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.410257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.410242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt98v\" (UniqueName: \"kubernetes.io/projected/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-kube-api-access-mt98v\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.410481 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.410458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-oauth-serving-cert\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.410889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.410848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-service-ca\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.411334 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.411294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-config\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.413818 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.413774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-oauth-config\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.415267 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.415242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-serving-cert\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.427963 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.427912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt98v\" (UniqueName: \"kubernetes.io/projected/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-kube-api-access-mt98v\") pod \"console-6c5d99f6db-4x6lg\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") " pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.511148 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.511110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:22.514130 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.514071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fdbd20aa-2f48-4da4-a3f2-1c5abf69e351-node-exporter-tls\") pod \"node-exporter-k5txh\" (UID: \"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351\") " pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:22.571243 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.570990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:22.573387 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.573343    2564 patch_prober.go:28] interesting pod/image-registry-b8bc7cbc7-l48w7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:41:22.573527 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.573400    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" podUID="68b6d747-8e83-4d24-a083-b695324317b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:41:22.660104 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.660018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k5txh"
Jul 24 17:41:22.670602 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:22.670568    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbd20aa_2f48_4da4_a3f2_1c5abf69e351.slice/crio-16e0ffdf8758416e339d4987597e33928d576720d936554f9a812d1a994c82fe WatchSource:0}: Error finding container 16e0ffdf8758416e339d4987597e33928d576720d936554f9a812d1a994c82fe: Status 404 returned error can't find the container with id 16e0ffdf8758416e339d4987597e33928d576720d936554f9a812d1a994c82fe
Jul 24 17:41:22.735210 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:22.735179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5d99f6db-4x6lg"]
Jul 24 17:41:22.737100 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:22.737071    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda653bd9c_f57c_4d95_ab35_642dc0dd38aa.slice/crio-e065900324485959dc43e4fb29917480cd1ed2d2fd9f240fe17d49fba3bf923c WatchSource:0}: Error finding container e065900324485959dc43e4fb29917480cd1ed2d2fd9f240fe17d49fba3bf923c: Status 404 returned error can't find the container with id e065900324485959dc43e4fb29917480cd1ed2d2fd9f240fe17d49fba3bf923c
Jul 24 17:41:23.376518 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:23.376481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5d99f6db-4x6lg" event={"ID":"a653bd9c-f57c-4d95-ab35-642dc0dd38aa","Type":"ContainerStarted","Data":"e065900324485959dc43e4fb29917480cd1ed2d2fd9f240fe17d49fba3bf923c"}
Jul 24 17:41:23.379590 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:23.379370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr" event={"ID":"9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94","Type":"ContainerStarted","Data":"a08250992b699c7f2ec94a0a8e5a04257c20810c8e196def029cdb8a580c7d8c"}
Jul 24 17:41:23.380648 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:23.380617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5txh" event={"ID":"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351","Type":"ContainerStarted","Data":"16e0ffdf8758416e339d4987597e33928d576720d936554f9a812d1a994c82fe"}
Jul 24 17:41:23.397752 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:23.397696    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwlhr" podStartSLOduration=2.268725464 podStartE2EDuration="3.397676948s" totalImagesPullingTime="1.128951484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:23.395817611 +0000 UTC m=+282.428197969" watchObservedRunningTime="2026-07-24 17:41:23.397676948 +0000 UTC m=+282.430057307"
Jul 24 17:41:24.386762 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:24.386725    2564 generic.go:356] "Generic (PLEG): container finished" podID="fdbd20aa-2f48-4da4-a3f2-1c5abf69e351" containerID="84fd5f322edb86bfc52f3d13dd1e99f6894d58fd359d23b03105b4e73bb18aa2" exitCode=0
Jul 24 17:41:24.387246 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:24.386818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5txh" event={"ID":"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351","Type":"ContainerDied","Data":"84fd5f322edb86bfc52f3d13dd1e99f6894d58fd359d23b03105b4e73bb18aa2"}
Jul 24 17:41:25.845110 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:25.845073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:41:25.847525 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:25.847497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95601a7f-b046-4c9e-9745-5386d0a1f7bc-metrics-tls\") pod \"dns-default-pqp28\" (UID: \"95601a7f-b046-4c9e-9745-5386d0a1f7bc\") " pod="openshift-dns/dns-default-pqp28"
Jul 24 17:41:25.973983 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:25.973953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7mn5h\""
Jul 24 17:41:25.982151 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:25.982123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqp28"
Jul 24 17:41:30.447098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.447062    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657f859667-9c9h5"]
Jul 24 17:41:30.614232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.614194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657f859667-9c9h5"]
Jul 24 17:41:30.614424 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.614341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.623226 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.623195    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 17:41:30.683213 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-oauth-config\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.683213 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-trusted-ca-bundle\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.683452 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-service-ca\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.683452 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-console-config\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.683452 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-serving-cert\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.683612 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-oauth-serving-cert\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.683612 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.683482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhj6\" (UniqueName: \"kubernetes.io/projected/88f84102-23c6-4dec-94d7-4a0734c5744a-kube-api-access-sfhj6\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784639 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-oauth-serving-cert\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784639 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhj6\" (UniqueName: \"kubernetes.io/projected/88f84102-23c6-4dec-94d7-4a0734c5744a-kube-api-access-sfhj6\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-oauth-config\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-trusted-ca-bundle\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-service-ca\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-console-config\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.784883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.784845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-serving-cert\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.785465 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.785406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-oauth-serving-cert\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.785692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.785666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-trusted-ca-bundle\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.785793 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.785700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-service-ca\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.785793 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.785742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-console-config\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.787585 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.787562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-serving-cert\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.787975 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.787955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-oauth-config\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.793543 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.793522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhj6\" (UniqueName: \"kubernetes.io/projected/88f84102-23c6-4dec-94d7-4a0734c5744a-kube-api-access-sfhj6\") pod \"console-657f859667-9c9h5\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") " pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:30.926321 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:30.926275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:32.572084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:32.572047    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:32.923113 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:32.923079    2564 patch_prober.go:28] interesting pod/image-registry-7c5b4c757f-cp6v6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:41:32.923238 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:32.923134    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6" podUID="23df5762-a60b-41a9-89f3-6457b5c77f2e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:41:32.956189 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:32.956119    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqp28"]
Jul 24 17:41:32.960621 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:32.960590    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95601a7f_b046_4c9e_9745_5386d0a1f7bc.slice/crio-9b11ac1f842bbf4b28f3f59dec1422c0bb63804d1a759b2d2af724c30c4ec15b WatchSource:0}: Error finding container 9b11ac1f842bbf4b28f3f59dec1422c0bb63804d1a759b2d2af724c30c4ec15b: Status 404 returned error can't find the container with id 9b11ac1f842bbf4b28f3f59dec1422c0bb63804d1a759b2d2af724c30c4ec15b
Jul 24 17:41:32.973376 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:32.973350    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657f859667-9c9h5"]
Jul 24 17:41:32.978339 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:41:32.978310    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f84102_23c6_4dec_94d7_4a0734c5744a.slice/crio-19a038c774394bae5ae38245166caf75f42de070b7115bb920ba654578204c78 WatchSource:0}: Error finding container 19a038c774394bae5ae38245166caf75f42de070b7115bb920ba654578204c78: Status 404 returned error can't find the container with id 19a038c774394bae5ae38245166caf75f42de070b7115bb920ba654578204c78
Jul 24 17:41:33.425198 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.425113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f859667-9c9h5" event={"ID":"88f84102-23c6-4dec-94d7-4a0734c5744a","Type":"ContainerStarted","Data":"8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d"}
Jul 24 17:41:33.425889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.425526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f859667-9c9h5" event={"ID":"88f84102-23c6-4dec-94d7-4a0734c5744a","Type":"ContainerStarted","Data":"19a038c774394bae5ae38245166caf75f42de070b7115bb920ba654578204c78"}
Jul 24 17:41:33.427983 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.427951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-57tss" event={"ID":"6cbc6b95-4a39-4c37-a7d0-bad18f2df270","Type":"ContainerStarted","Data":"dd0d016667f967e630f29aaf7f2b72dd5c47297a617bb9beca55fe018213029b"}
Jul 24 17:41:33.429513 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.429440    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:33.431668 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.431645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqp28" event={"ID":"95601a7f-b046-4c9e-9745-5386d0a1f7bc","Type":"ContainerStarted","Data":"9b11ac1f842bbf4b28f3f59dec1422c0bb63804d1a759b2d2af724c30c4ec15b"}
Jul 24 17:41:33.434620 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.434463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5txh" event={"ID":"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351","Type":"ContainerStarted","Data":"5d8a55fea535a92aa8854bb41ab6316d16d8528453795046e22fcd1ef3bda9eb"}
Jul 24 17:41:33.434620 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.434505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5txh" event={"ID":"fdbd20aa-2f48-4da4-a3f2-1c5abf69e351","Type":"ContainerStarted","Data":"0be61edd5d4b973d7c0c281f06d42bb7cd95a3e503adc91513f58103d9925550"}
Jul 24 17:41:33.436991 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.436942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5d99f6db-4x6lg" event={"ID":"a653bd9c-f57c-4d95-ab35-642dc0dd38aa","Type":"ContainerStarted","Data":"73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628"}
Jul 24 17:41:33.441580 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.441539    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-57tss"
Jul 24 17:41:33.448369 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.448328    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657f859667-9c9h5" podStartSLOduration=3.448312565 podStartE2EDuration="3.448312565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:33.446416772 +0000 UTC m=+292.478797130" watchObservedRunningTime="2026-07-24 17:41:33.448312565 +0000 UTC m=+292.480692924"
Jul 24 17:41:33.468160 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.468086    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-57tss" podStartSLOduration=1.872960054 podStartE2EDuration="21.468067s" totalImagesPullingTime="19.595106946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:33.466884423 +0000 UTC m=+292.499264773" watchObservedRunningTime="2026-07-24 17:41:33.468067 +0000 UTC m=+292.500447359"
Jul 24 17:41:33.489075 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.488997    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c5d99f6db-4x6lg" podStartSLOduration=1.412953658 podStartE2EDuration="11.488974372s" totalImagesPullingTime="10.076020714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:33.48693483 +0000 UTC m=+292.519315189" watchObservedRunningTime="2026-07-24 17:41:33.488974372 +0000 UTC m=+292.521354781"
Jul 24 17:41:33.504987 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:33.504854    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k5txh" podStartSLOduration=12.481155085 podStartE2EDuration="13.504831939s" totalImagesPullingTime="919.44114ms" totalInitContainerRuntime="104.235714ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:33.504313971 +0000 UTC m=+292.536694330" watchObservedRunningTime="2026-07-24 17:41:33.504831939 +0000 UTC m=+292.537212299"
Jul 24 17:41:34.338458 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:34.338418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c5b4c757f-cp6v6"
Jul 24 17:41:34.456647 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:34.456596    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4d5j5" podUID="39726eac-a819-439a-a511-3c067cae4a0d"
Jul 24 17:41:36.454234 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:36.454193    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqp28" event={"ID":"95601a7f-b046-4c9e-9745-5386d0a1f7bc","Type":"ContainerStarted","Data":"c966e404edfe900014efbebd4359696d99634d1935df431119046538c7347ab0"}
Jul 24 17:41:36.454667 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:36.454265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqp28" event={"ID":"95601a7f-b046-4c9e-9745-5386d0a1f7bc","Type":"ContainerStarted","Data":"6381be9cec8205a0965b00b03e5e0257502bf6f8fac54b9008e7f206cf77dafe"}
Jul 24 17:41:36.454667 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:36.454363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pqp28"
Jul 24 17:41:36.472095 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:36.472020    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pqp28" podStartSLOduration=259.098216736 podStartE2EDuration="4m21.472001545s" totalImagesPullingTime="2.373784809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:41:36.471448117 +0000 UTC m=+295.503828475" watchObservedRunningTime="2026-07-24 17:41:36.472001545 +0000 UTC m=+295.504381904"
Jul 24 17:41:37.590702 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.590630    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" podUID="68b6d747-8e83-4d24-a083-b695324317b8" containerName="registry" containerID="cri-o://092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f" gracePeriod=30
Jul 24 17:41:37.894378 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.894337    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:37.954649 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954603    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hqhg\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-kube-api-access-6hqhg\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.954649 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68b6d747-8e83-4d24-a083-b695324317b8-ca-trust-extracted\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.954889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-registry-certificates\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.954889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954731    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-installation-pull-secrets\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.954889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954777    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-trusted-ca\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.954889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-image-registry-private-configuration\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.954889 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.955172 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.954913    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-bound-sa-token\") pod \"68b6d747-8e83-4d24-a083-b695324317b8\" (UID: \"68b6d747-8e83-4d24-a083-b695324317b8\") "
Jul 24 17:41:37.955172 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.955133    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:37.955273 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.955231    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-registry-certificates\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:37.955328 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.955262    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:37.957723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.957687    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:37.957866 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.957782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-kube-api-access-6hqhg" (OuterVolumeSpecName: "kube-api-access-6hqhg") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "kube-api-access-6hqhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:37.958156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.958118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:37.958648 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.958601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:41:37.959209 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.959181    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:41:37.966120 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:37.966085    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68b6d747-8e83-4d24-a083-b695324317b8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "68b6d747-8e83-4d24-a083-b695324317b8" (UID: "68b6d747-8e83-4d24-a083-b695324317b8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:38.056450 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056414    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-installation-pull-secrets\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.056450 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056445    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68b6d747-8e83-4d24-a083-b695324317b8-trusted-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.056450 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056456    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68b6d747-8e83-4d24-a083-b695324317b8-image-registry-private-configuration\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.056685 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056466    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-registry-tls\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.056685 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056475    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-bound-sa-token\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.056685 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056483    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hqhg\" (UniqueName: \"kubernetes.io/projected/68b6d747-8e83-4d24-a083-b695324317b8-kube-api-access-6hqhg\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.056685 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.056494    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68b6d747-8e83-4d24-a083-b695324317b8-ca-trust-extracted\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.464386 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.464351    2564 generic.go:356] "Generic (PLEG): container finished" podID="68b6d747-8e83-4d24-a083-b695324317b8" containerID="092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f" exitCode=0
Jul 24 17:41:38.464386 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.464393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" event={"ID":"68b6d747-8e83-4d24-a083-b695324317b8","Type":"ContainerDied","Data":"092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f"}
Jul 24 17:41:38.464611 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.464409    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7"
Jul 24 17:41:38.464611 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.464440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b8bc7cbc7-l48w7" event={"ID":"68b6d747-8e83-4d24-a083-b695324317b8","Type":"ContainerDied","Data":"09de4af05d8e76a666720346f040b0dcbffb36941f5b9470c49fa3529e7590d0"}
Jul 24 17:41:38.464611 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.464475    2564 scope.go:117] "RemoveContainer" containerID="092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f"
Jul 24 17:41:38.475414 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.475379    2564 scope.go:117] "RemoveContainer" containerID="092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f"
Jul 24 17:41:38.475785 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:41:38.475762    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f\": container with ID starting with 092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f not found: ID does not exist" containerID="092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f"
Jul 24 17:41:38.475861 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.475792    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f"} err="failed to get container status \"092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f\": rpc error: code = NotFound desc = could not find container \"092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f\": container with ID starting with 092759660e5623443be8bea2002545e6938542a6b90b9a462b47fc31fd80e78f not found: ID does not exist"
Jul 24 17:41:38.487155 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.487126    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b8bc7cbc7-l48w7"]
Jul 24 17:41:38.490067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:38.490014    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b8bc7cbc7-l48w7"]
Jul 24 17:41:39.459081 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:39.459047    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68b6d747-8e83-4d24-a083-b695324317b8" path="/var/lib/kubelet/pods/68b6d747-8e83-4d24-a083-b695324317b8/volumes"
Jul 24 17:41:40.926995 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:40.926949    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:40.927459 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:40.927074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:40.932273 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:40.932245    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:41.346113 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:41.346086    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:41:41.483417 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:41.483265    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:41:41.723558 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:41.526475    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c5d99f6db-4x6lg"]
Jul 24 17:41:42.572012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:42.571965    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:41:45.454365 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:45.454327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:41:46.460752 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:41:46.460722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pqp28"
Jul 24 17:42:06.549157 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.549097    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c5d99f6db-4x6lg" podUID="a653bd9c-f57c-4d95-ab35-642dc0dd38aa" containerName="console" containerID="cri-o://73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628" gracePeriod=15
Jul 24 17:42:06.824287 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.824229    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:42:06.902219 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902189    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-oauth-config\") pod \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") "
Jul 24 17:42:06.902362 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-oauth-serving-cert\") pod \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") "
Jul 24 17:42:06.902362 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902343    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt98v\" (UniqueName: \"kubernetes.io/projected/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-kube-api-access-mt98v\") pod \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") "
Jul 24 17:42:06.902482 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902384    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-config\") pod \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") "
Jul 24 17:42:06.902482 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902400    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-service-ca\") pod \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") "
Jul 24 17:42:06.902482 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902419    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-serving-cert\") pod \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\" (UID: \"a653bd9c-f57c-4d95-ab35-642dc0dd38aa\") "
Jul 24 17:42:06.902698 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902675    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a653bd9c-f57c-4d95-ab35-642dc0dd38aa" (UID: "a653bd9c-f57c-4d95-ab35-642dc0dd38aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:42:06.902755 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-config" (OuterVolumeSpecName: "console-config") pod "a653bd9c-f57c-4d95-ab35-642dc0dd38aa" (UID: "a653bd9c-f57c-4d95-ab35-642dc0dd38aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:42:06.902832 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.902806    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "a653bd9c-f57c-4d95-ab35-642dc0dd38aa" (UID: "a653bd9c-f57c-4d95-ab35-642dc0dd38aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:42:06.904525 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.904498    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a653bd9c-f57c-4d95-ab35-642dc0dd38aa" (UID: "a653bd9c-f57c-4d95-ab35-642dc0dd38aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:42:06.904637 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.904532    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-kube-api-access-mt98v" (OuterVolumeSpecName: "kube-api-access-mt98v") pod "a653bd9c-f57c-4d95-ab35-642dc0dd38aa" (UID: "a653bd9c-f57c-4d95-ab35-642dc0dd38aa"). InnerVolumeSpecName "kube-api-access-mt98v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:42:06.904637 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:06.904541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a653bd9c-f57c-4d95-ab35-642dc0dd38aa" (UID: "a653bd9c-f57c-4d95-ab35-642dc0dd38aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:42:07.003725 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.003688    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-oauth-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:42:07.003725 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.003717    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-oauth-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:42:07.003725 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.003727    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt98v\" (UniqueName: \"kubernetes.io/projected/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-kube-api-access-mt98v\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:42:07.003725 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.003735    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:42:07.003990 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.003745    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:42:07.003990 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.003753    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a653bd9c-f57c-4d95-ab35-642dc0dd38aa-console-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:42:07.568838 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.568809    2564 generic.go:356] "Generic (PLEG): container finished" podID="a653bd9c-f57c-4d95-ab35-642dc0dd38aa" containerID="73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628" exitCode=0
Jul 24 17:42:07.569264 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.568855    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5d99f6db-4x6lg"
Jul 24 17:42:07.569264 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.568878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5d99f6db-4x6lg" event={"ID":"a653bd9c-f57c-4d95-ab35-642dc0dd38aa","Type":"ContainerDied","Data":"73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628"}
Jul 24 17:42:07.569264 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.568916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5d99f6db-4x6lg" event={"ID":"a653bd9c-f57c-4d95-ab35-642dc0dd38aa","Type":"ContainerDied","Data":"e065900324485959dc43e4fb29917480cd1ed2d2fd9f240fe17d49fba3bf923c"}
Jul 24 17:42:07.569264 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.568935    2564 scope.go:117] "RemoveContainer" containerID="73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628"
Jul 24 17:42:07.576617 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.576603    2564 scope.go:117] "RemoveContainer" containerID="73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628"
Jul 24 17:42:07.576879 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:42:07.576860    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628\": container with ID starting with 73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628 not found: ID does not exist" containerID="73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628"
Jul 24 17:42:07.576922 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.576887    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628"} err="failed to get container status \"73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628\": rpc error: code = NotFound desc = could not find container \"73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628\": container with ID starting with 73ac1b7599289c60cae9f8e0189de627706de72c89c088f013071e01f605a628 not found: ID does not exist"
Jul 24 17:42:07.586016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.585994    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c5d99f6db-4x6lg"]
Jul 24 17:42:07.589821 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:07.589797    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c5d99f6db-4x6lg"]
Jul 24 17:42:09.457611 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:09.457577    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a653bd9c-f57c-4d95-ab35-642dc0dd38aa" path="/var/lib/kubelet/pods/a653bd9c-f57c-4d95-ab35-642dc0dd38aa/volumes"
Jul 24 17:42:17.604758 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:17.604668    2564 generic.go:356] "Generic (PLEG): container finished" podID="3f610788-8ae2-484f-a1ac-4f61cfae992a" containerID="b59d57c71e723090eda9f2b8ee749031578f1ae3b295d95643e629125cbad21d" exitCode=0
Jul 24 17:42:17.604758 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:17.604741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6" event={"ID":"3f610788-8ae2-484f-a1ac-4f61cfae992a","Type":"ContainerDied","Data":"b59d57c71e723090eda9f2b8ee749031578f1ae3b295d95643e629125cbad21d"}
Jul 24 17:42:17.605243 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:17.605092    2564 scope.go:117] "RemoveContainer" containerID="b59d57c71e723090eda9f2b8ee749031578f1ae3b295d95643e629125cbad21d"
Jul 24 17:42:18.610146 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:18.610110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4ltg6" event={"ID":"3f610788-8ae2-484f-a1ac-4f61cfae992a","Type":"ContainerStarted","Data":"9a62e788a0e65d37bd3a8fee3d0fe08c79ce0cc5b8db7ae892d67dcf6a54db11"}
Jul 24 17:42:42.575009 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.574974    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 17:42:42.575420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.575277    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b6d747-8e83-4d24-a083-b695324317b8" containerName="registry"
Jul 24 17:42:42.575420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.575289    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b6d747-8e83-4d24-a083-b695324317b8" containerName="registry"
Jul 24 17:42:42.575420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.575299    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a653bd9c-f57c-4d95-ab35-642dc0dd38aa" containerName="console"
Jul 24 17:42:42.575420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.575305    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a653bd9c-f57c-4d95-ab35-642dc0dd38aa" containerName="console"
Jul 24 17:42:42.575420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.575355    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a653bd9c-f57c-4d95-ab35-642dc0dd38aa" containerName="console"
Jul 24 17:42:42.575420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.575364    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68b6d747-8e83-4d24-a083-b695324317b8" containerName="registry"
Jul 24 17:42:42.578341 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.578324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.581000 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.580978    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 17:42:42.581136 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.580984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 17:42:42.581301 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581233    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 17:42:42.581301 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581290    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 17:42:42.581515 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581495    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 17:42:42.581589 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581554    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 17:42:42.581681 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581667    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 17:42:42.581872 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581856    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s828z\""
Jul 24 17:42:42.581948 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.581861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 17:42:42.586679 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.586661    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 17:42:42.593309 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.593287    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 17:42:42.689548 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-config-out\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhbm9\" (UniqueName: \"kubernetes.io/projected/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-kube-api-access-fhbm9\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689724 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-web-config\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.689962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.689801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790484 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790484 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790484 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-web-config\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-config-out\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.790805 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.790812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhbm9\" (UniqueName: \"kubernetes.io/projected/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-kube-api-access-fhbm9\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.791318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.791127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.791373 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.791348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.791730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.791682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.793765 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.793727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794048 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-config-out\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794201 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794289 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794417 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-web-config\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794480 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794480 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.794626 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.794608    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.795352 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.795333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.801423 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.801402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhbm9\" (UniqueName: \"kubernetes.io/projected/08e80d25-eba6-4c28-b2a1-f74a35ed1e5d-kube-api-access-fhbm9\") pod \"alertmanager-main-0\" (UID: \"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:42.888067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:42.887967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:42:43.024281 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:43.024176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 17:42:43.027170 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:42:43.027144    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e80d25_eba6_4c28_b2a1_f74a35ed1e5d.slice/crio-41388de03bd982a2462337e2810825d227d7eaf62f1b6f49729483f64c17e0f8 WatchSource:0}: Error finding container 41388de03bd982a2462337e2810825d227d7eaf62f1b6f49729483f64c17e0f8: Status 404 returned error can't find the container with id 41388de03bd982a2462337e2810825d227d7eaf62f1b6f49729483f64c17e0f8
Jul 24 17:42:43.029251 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:43.029236    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:42:43.704661 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:43.704624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"41388de03bd982a2462337e2810825d227d7eaf62f1b6f49729483f64c17e0f8"}
Jul 24 17:42:44.710379 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:44.710344    2564 generic.go:356] "Generic (PLEG): container finished" podID="08e80d25-eba6-4c28-b2a1-f74a35ed1e5d" containerID="1b32c4e1e90aaa9b2569e0d00a71ea876d18ae363d90147a07040afc1b1c8354" exitCode=0
Jul 24 17:42:44.710739 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:44.710402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerDied","Data":"1b32c4e1e90aaa9b2569e0d00a71ea876d18ae363d90147a07040afc1b1c8354"}
Jul 24 17:42:45.129723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.129642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dbbd877fc-smkdq"]
Jul 24 17:42:45.132009 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.131984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.134566 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.134530    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 17:42:45.134566 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.134561    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 17:42:45.134723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.134563    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-44d92\""
Jul 24 17:42:45.134723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.134530    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 17:42:45.134723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.134620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 17:42:45.134878 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.134861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 17:42:45.139449 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.139427    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 17:42:45.148210 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.148188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dbbd877fc-smkdq"]
Jul 24 17:42:45.214692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-secret-telemeter-client\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-telemeter-client-tls\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdglk\" (UniqueName: \"kubernetes.io/projected/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-kube-api-access-tdglk\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214999 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-federate-client-tls\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214999 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-serving-certs-ca-bundle\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.214999 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.214974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-metrics-client-ca\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.315602 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.315558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-metrics-client-ca\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.315602 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.315600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-secret-telemeter-client\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.315848 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.315627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.315936 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.315905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316001 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.315987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-telemeter-client-tls\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316094 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.316070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdglk\" (UniqueName: \"kubernetes.io/projected/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-kube-api-access-tdglk\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316165 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.316123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-federate-client-tls\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316229 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.316174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-serving-certs-ca-bundle\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316597 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.316393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-metrics-client-ca\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316597 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.316532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.316807 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.316786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-serving-certs-ca-bundle\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.318798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.318767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-secret-telemeter-client\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.319217 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.319193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.319321 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.319224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-telemeter-client-tls\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.319677 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.319645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-federate-client-tls\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.325137 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.325116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdglk\" (UniqueName: \"kubernetes.io/projected/ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10-kube-api-access-tdglk\") pod \"telemeter-client-dbbd877fc-smkdq\" (UID: \"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10\") " pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.442916 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.442854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq"
Jul 24 17:42:45.594302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.594265    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dbbd877fc-smkdq"]
Jul 24 17:42:45.598412 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:42:45.598382    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0a33a8_3ea5_490f_afc0_9cfcf1eb0d10.slice/crio-489918e08513179511e5fbd29a1049fb538abbf460b520842e202dac489f97c4 WatchSource:0}: Error finding container 489918e08513179511e5fbd29a1049fb538abbf460b520842e202dac489f97c4: Status 404 returned error can't find the container with id 489918e08513179511e5fbd29a1049fb538abbf460b520842e202dac489f97c4
Jul 24 17:42:45.715183 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:45.715102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq" event={"ID":"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10","Type":"ContainerStarted","Data":"489918e08513179511e5fbd29a1049fb538abbf460b520842e202dac489f97c4"}
Jul 24 17:42:46.722730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:46.722698    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"a6b61af61c8d1633404b05c16a186e932d5cd871ee5da4282af37534f2665e8e"}
Jul 24 17:42:46.723250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:46.722769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"cb0617fa93c48e8d54656ebfcf66e5c7345a776e5390d75698f6bedca3e09df6"}
Jul 24 17:42:46.723250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:46.722799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"deacf03b1b5ac35402739015ecc15a2932999b2ff5bf5d8bcc60d473048f10b1"}
Jul 24 17:42:46.723250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:46.722823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"c9d99f6f4ad0ed496c5eb2507cfdbd14993944b48cf45411b912ad17599adf46"}
Jul 24 17:42:46.723250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:46.722856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"a48ceaa109825567fceba94747837dcdd6dd398965f52b03b5a5a636e02e070d"}
Jul 24 17:42:47.728743 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:47.728706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq" event={"ID":"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10","Type":"ContainerStarted","Data":"24125931a7a76a7dd4ed675e3713700526047682f1643cac4fb0985f4b10c01a"}
Jul 24 17:42:47.729151 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:47.728768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq" event={"ID":"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10","Type":"ContainerStarted","Data":"e260511ec2b2bf4980d14ee0ece7ba2954967a9fafd17f6da54b0ce7e74e2d86"}
Jul 24 17:42:47.729151 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:47.728787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq" event={"ID":"ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10","Type":"ContainerStarted","Data":"46ba852cd0b61fcbd06a80b2a855e357eb2bef7900a69a0474cf3bc7a3e01255"}
Jul 24 17:42:47.761257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:47.761205    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dbbd877fc-smkdq" podStartSLOduration=1.105994592 podStartE2EDuration="2.76118895s" totalImagesPullingTime="1.655194358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:47.759167977 +0000 UTC m=+366.791548337" watchObservedRunningTime="2026-07-24 17:42:47.76118895 +0000 UTC m=+366.793569309"
Jul 24 17:42:48.513916 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.513880    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d8596784-ms84z"]
Jul 24 17:42:48.516098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.516081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.527501 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.527476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d8596784-ms84z"]
Jul 24 17:42:48.644656 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-trusted-ca-bundle\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.644656 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-oauth-serving-cert\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.644879 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-service-ca\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.644879 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-serving-cert\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.644879 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-oauth-config\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.644879 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-console-config\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.644879 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.644863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4rl\" (UniqueName: \"kubernetes.io/projected/16251ad0-92eb-4de7-b75b-a438b81289d7-kube-api-access-gl4rl\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.735928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.735886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08e80d25-eba6-4c28-b2a1-f74a35ed1e5d","Type":"ContainerStarted","Data":"bfcf4943d827ea9b7114b8f51aaa9359949c6cb5537160c6a423dd514284773b"}
Jul 24 17:42:48.745750 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.745724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-service-ca\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.745836 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.745774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-serving-cert\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.745903 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.745884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-oauth-config\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.745947 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.745913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-console-config\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.745947 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.745935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4rl\" (UniqueName: \"kubernetes.io/projected/16251ad0-92eb-4de7-b75b-a438b81289d7-kube-api-access-gl4rl\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.746063 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.745963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-trusted-ca-bundle\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.746271 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.746191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-oauth-serving-cert\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.746508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.746485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-service-ca\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.746598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.746572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-console-config\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.746752 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.746731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-oauth-serving-cert\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.746812 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.746793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-trusted-ca-bundle\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.748196 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.748168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-oauth-config\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.748313 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.748297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-serving-cert\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.754262 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.754223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4rl\" (UniqueName: \"kubernetes.io/projected/16251ad0-92eb-4de7-b75b-a438b81289d7-kube-api-access-gl4rl\") pod \"console-64d8596784-ms84z\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") " pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.766808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.766737    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.990868794 podStartE2EDuration="6.76672399s" totalImagesPullingTime="3.760586588s" totalInitContainerRuntime="15.268608ms" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:48.764557882 +0000 UTC m=+367.796938242" watchObservedRunningTime="2026-07-24 17:42:48.76672399 +0000 UTC m=+367.799104349"
Jul 24 17:42:48.825434 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.825395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:48.955869 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:48.955780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d8596784-ms84z"]
Jul 24 17:42:48.958002 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:42:48.957975    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16251ad0_92eb_4de7_b75b_a438b81289d7.slice/crio-f9210fd589f20aca109955327ecb05fcdecda518443bcac8e5afe67d8074a5d4 WatchSource:0}: Error finding container f9210fd589f20aca109955327ecb05fcdecda518443bcac8e5afe67d8074a5d4: Status 404 returned error can't find the container with id f9210fd589f20aca109955327ecb05fcdecda518443bcac8e5afe67d8074a5d4
Jul 24 17:42:49.742085 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:49.742020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8596784-ms84z" event={"ID":"16251ad0-92eb-4de7-b75b-a438b81289d7","Type":"ContainerStarted","Data":"1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79"}
Jul 24 17:42:49.742538 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:49.742101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8596784-ms84z" event={"ID":"16251ad0-92eb-4de7-b75b-a438b81289d7","Type":"ContainerStarted","Data":"f9210fd589f20aca109955327ecb05fcdecda518443bcac8e5afe67d8074a5d4"}
Jul 24 17:42:49.759227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:49.759180    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64d8596784-ms84z" podStartSLOduration=1.759166403 podStartE2EDuration="1.759166403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:49.75786625 +0000 UTC m=+368.790246609" watchObservedRunningTime="2026-07-24 17:42:49.759166403 +0000 UTC m=+368.791546761"
Jul 24 17:42:55.301803 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:55.301758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:42:55.304226 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:55.304204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39726eac-a819-439a-a511-3c067cae4a0d-metrics-certs\") pod \"network-metrics-daemon-4d5j5\" (UID: \"39726eac-a819-439a-a511-3c067cae4a0d\") " pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:42:55.357926 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:55.357905    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lvv7h\""
Jul 24 17:42:55.366156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:55.366141    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4d5j5"
Jul 24 17:42:55.491574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:55.491547    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4d5j5"]
Jul 24 17:42:55.494766 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:42:55.494740    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39726eac_a819_439a_a511_3c067cae4a0d.slice/crio-7337524ca277d52c92c1e227aed1c9681614e346f9e94e99a2347d49fb4aba88 WatchSource:0}: Error finding container 7337524ca277d52c92c1e227aed1c9681614e346f9e94e99a2347d49fb4aba88: Status 404 returned error can't find the container with id 7337524ca277d52c92c1e227aed1c9681614e346f9e94e99a2347d49fb4aba88
Jul 24 17:42:55.767660 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:55.767623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4d5j5" event={"ID":"39726eac-a819-439a-a511-3c067cae4a0d","Type":"ContainerStarted","Data":"7337524ca277d52c92c1e227aed1c9681614e346f9e94e99a2347d49fb4aba88"}
Jul 24 17:42:56.773642 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:56.773554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4d5j5" event={"ID":"39726eac-a819-439a-a511-3c067cae4a0d","Type":"ContainerStarted","Data":"b6313d2c327f08eb112a7103142f93ad7ae19a27084ad7733af080825d31c44a"}
Jul 24 17:42:56.773989 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:56.773644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4d5j5" event={"ID":"39726eac-a819-439a-a511-3c067cae4a0d","Type":"ContainerStarted","Data":"8acbfeed3410816c66bb11b01e545f064aab4c15f75a7e95f9f0592ee0be0121"}
Jul 24 17:42:56.793445 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:56.793401    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4d5j5" podStartSLOduration=374.804526422 podStartE2EDuration="6m15.793387858s" totalImagesPullingTime="988.861436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:56.793044975 +0000 UTC m=+375.825425335" watchObservedRunningTime="2026-07-24 17:42:56.793387858 +0000 UTC m=+375.825768239"
Jul 24 17:42:58.825513 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:58.825473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:58.825875 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:58.825533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:58.830306 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:58.830282    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:59.789942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:59.789911    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:42:59.843473 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:42:59.843444    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657f859667-9c9h5"]
Jul 24 17:43:24.862654 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:24.862589    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-657f859667-9c9h5" podUID="88f84102-23c6-4dec-94d7-4a0734c5744a" containerName="console" containerID="cri-o://8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d" gracePeriod=15
Jul 24 17:43:25.105095 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.105071    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:43:25.148670 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148632    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-service-ca\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.148842 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-oauth-config\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.148842 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-oauth-serving-cert\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.148950 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148878    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-trusted-ca-bundle\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.148950 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-serving-cert\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.149067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148987    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-console-config\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.149067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.148993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-service-ca" (OuterVolumeSpecName: "service-ca") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:43:25.149067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.149059    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfhj6\" (UniqueName: \"kubernetes.io/projected/88f84102-23c6-4dec-94d7-4a0734c5744a-kube-api-access-sfhj6\") pod \"88f84102-23c6-4dec-94d7-4a0734c5744a\" (UID: \"88f84102-23c6-4dec-94d7-4a0734c5744a\") "
Jul 24 17:43:25.149217 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.149095    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:43:25.149357 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.149312    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.149357 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.149333    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-oauth-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.149357 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.149338    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:43:25.149543 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.149464    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-console-config" (OuterVolumeSpecName: "console-config") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:43:25.151079 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.151054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:43:25.151342 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.151316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:43:25.151442 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.151418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f84102-23c6-4dec-94d7-4a0734c5744a-kube-api-access-sfhj6" (OuterVolumeSpecName: "kube-api-access-sfhj6") pod "88f84102-23c6-4dec-94d7-4a0734c5744a" (UID: "88f84102-23c6-4dec-94d7-4a0734c5744a"). InnerVolumeSpecName "kube-api-access-sfhj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:43:25.250103 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.250063    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-trusted-ca-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.250103 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.250094    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.250103 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.250104    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88f84102-23c6-4dec-94d7-4a0734c5744a-console-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.250103 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.250113    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfhj6\" (UniqueName: \"kubernetes.io/projected/88f84102-23c6-4dec-94d7-4a0734c5744a-kube-api-access-sfhj6\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.250360 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.250123    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88f84102-23c6-4dec-94d7-4a0734c5744a-console-oauth-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:43:25.886221 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.886136    2564 generic.go:356] "Generic (PLEG): container finished" podID="88f84102-23c6-4dec-94d7-4a0734c5744a" containerID="8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d" exitCode=0
Jul 24 17:43:25.886221 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.886181    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657f859667-9c9h5"
Jul 24 17:43:25.886683 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.886226    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f859667-9c9h5" event={"ID":"88f84102-23c6-4dec-94d7-4a0734c5744a","Type":"ContainerDied","Data":"8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d"}
Jul 24 17:43:25.886683 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.886280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657f859667-9c9h5" event={"ID":"88f84102-23c6-4dec-94d7-4a0734c5744a","Type":"ContainerDied","Data":"19a038c774394bae5ae38245166caf75f42de070b7115bb920ba654578204c78"}
Jul 24 17:43:25.886683 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.886307    2564 scope.go:117] "RemoveContainer" containerID="8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d"
Jul 24 17:43:25.894394 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.894377    2564 scope.go:117] "RemoveContainer" containerID="8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d"
Jul 24 17:43:25.894625 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:43:25.894606    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d\": container with ID starting with 8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d not found: ID does not exist" containerID="8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d"
Jul 24 17:43:25.894673 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.894634    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d"} err="failed to get container status \"8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d\": rpc error: code = NotFound desc = could not find container \"8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d\": container with ID starting with 8a729e2a120916d143681e233077c31a90a03f440a58ad38b091abb87258f44d not found: ID does not exist"
Jul 24 17:43:25.902173 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.902151    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657f859667-9c9h5"]
Jul 24 17:43:25.905851 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:25.905830    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657f859667-9c9h5"]
Jul 24 17:43:27.458608 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:43:27.458578    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f84102-23c6-4dec-94d7-4a0734c5744a" path="/var/lib/kubelet/pods/88f84102-23c6-4dec-94d7-4a0734c5744a/volumes"
Jul 24 17:44:00.218458 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.218421    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559ccfbd59-jpctr"]
Jul 24 17:44:00.218923 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.218732    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f84102-23c6-4dec-94d7-4a0734c5744a" containerName="console"
Jul 24 17:44:00.218923 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.218742    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f84102-23c6-4dec-94d7-4a0734c5744a" containerName="console"
Jul 24 17:44:00.218923 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.218807    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f84102-23c6-4dec-94d7-4a0734c5744a" containerName="console"
Jul 24 17:44:00.222893 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.222875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228280 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-serving-cert\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228426 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-service-ca\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228426 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-trusted-ca-bundle\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228546 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228423    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrd2n\" (UniqueName: \"kubernetes.io/projected/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-kube-api-access-qrd2n\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228546 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-config\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228546 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-oauth-config\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.228546 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.228500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-oauth-serving-cert\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.231972 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.231946    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559ccfbd59-jpctr"]
Jul 24 17:44:00.329539 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-trusted-ca-bundle\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.329539 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrd2n\" (UniqueName: \"kubernetes.io/projected/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-kube-api-access-qrd2n\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.329814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-config\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.329814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-oauth-config\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.329814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-oauth-serving-cert\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.329814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-serving-cert\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.329814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.329667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-service-ca\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.330426 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.330402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-service-ca\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.330534 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.330453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-config\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.330534 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.330489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-trusted-ca-bundle\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.330608 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.330568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-oauth-serving-cert\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.332210 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.332183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-oauth-config\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.332210 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.332198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-serving-cert\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.338146 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.338125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrd2n\" (UniqueName: \"kubernetes.io/projected/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-kube-api-access-qrd2n\") pod \"console-559ccfbd59-jpctr\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") " pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.533305 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.533224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:00.659376 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:00.659342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559ccfbd59-jpctr"]
Jul 24 17:44:00.662477 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:44:00.662453    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7ed4cc_0ca5_40d2_820a_f875e804d5c9.slice/crio-a422f0e323496f00eb7112d3e5012e369ad9a51ffcb5606bc02d3416e129e973 WatchSource:0}: Error finding container a422f0e323496f00eb7112d3e5012e369ad9a51ffcb5606bc02d3416e129e973: Status 404 returned error can't find the container with id a422f0e323496f00eb7112d3e5012e369ad9a51ffcb5606bc02d3416e129e973
Jul 24 17:44:01.022289 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:01.022248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559ccfbd59-jpctr" event={"ID":"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9","Type":"ContainerStarted","Data":"6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6"}
Jul 24 17:44:01.022463 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:01.022309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559ccfbd59-jpctr" event={"ID":"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9","Type":"ContainerStarted","Data":"a422f0e323496f00eb7112d3e5012e369ad9a51ffcb5606bc02d3416e129e973"}
Jul 24 17:44:01.051555 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:01.051505    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559ccfbd59-jpctr" podStartSLOduration=1.051488051 podStartE2EDuration="1.051488051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:44:01.050894989 +0000 UTC m=+440.083275348" watchObservedRunningTime="2026-07-24 17:44:01.051488051 +0000 UTC m=+440.083868408"
Jul 24 17:44:10.533785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:10.533695    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:10.533785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:10.533754    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:10.538353 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:10.538330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:11.065155 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:11.065127    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:44:11.114157 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:11.114123    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d8596784-ms84z"]
Jul 24 17:44:36.138606 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.138539    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64d8596784-ms84z" podUID="16251ad0-92eb-4de7-b75b-a438b81289d7" containerName="console" containerID="cri-o://1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79" gracePeriod=15
Jul 24 17:44:36.387242 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.387215    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:44:36.531288 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531251    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-trusted-ca-bundle\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531493 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531312    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-oauth-serving-cert\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531493 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531356    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-service-ca\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531493 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4rl\" (UniqueName: \"kubernetes.io/projected/16251ad0-92eb-4de7-b75b-a438b81289d7-kube-api-access-gl4rl\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531493 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-oauth-config\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531697 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-console-config\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531697 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531531    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-serving-cert\") pod \"16251ad0-92eb-4de7-b75b-a438b81289d7\" (UID: \"16251ad0-92eb-4de7-b75b-a438b81289d7\") "
Jul 24 17:44:36.531791 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:36.531869 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531824    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:36.531992 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.531955    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-console-config" (OuterVolumeSpecName: "console-config") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:36.532139 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.532080    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:36.533709 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.533683    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:44:36.533799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.533684    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16251ad0-92eb-4de7-b75b-a438b81289d7-kube-api-access-gl4rl" (OuterVolumeSpecName: "kube-api-access-gl4rl") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "kube-api-access-gl4rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:44:36.533799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.533712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16251ad0-92eb-4de7-b75b-a438b81289d7" (UID: "16251ad0-92eb-4de7-b75b-a438b81289d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:44:36.632358 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632316    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-oauth-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.632358 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632352    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.632358 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632369    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4rl\" (UniqueName: \"kubernetes.io/projected/16251ad0-92eb-4de7-b75b-a438b81289d7-kube-api-access-gl4rl\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.632618 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632379    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-oauth-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.632618 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632388    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-console-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.632618 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632396    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16251ad0-92eb-4de7-b75b-a438b81289d7-console-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.632618 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:36.632404    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16251ad0-92eb-4de7-b75b-a438b81289d7-trusted-ca-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:44:37.158794 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.158759    2564 generic.go:356] "Generic (PLEG): container finished" podID="16251ad0-92eb-4de7-b75b-a438b81289d7" containerID="1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79" exitCode=0
Jul 24 17:44:37.159296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.158806    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8596784-ms84z"
Jul 24 17:44:37.159296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.158832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8596784-ms84z" event={"ID":"16251ad0-92eb-4de7-b75b-a438b81289d7","Type":"ContainerDied","Data":"1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79"}
Jul 24 17:44:37.159296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.158873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8596784-ms84z" event={"ID":"16251ad0-92eb-4de7-b75b-a438b81289d7","Type":"ContainerDied","Data":"f9210fd589f20aca109955327ecb05fcdecda518443bcac8e5afe67d8074a5d4"}
Jul 24 17:44:37.159296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.158893    2564 scope.go:117] "RemoveContainer" containerID="1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79"
Jul 24 17:44:37.169961 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.169899    2564 scope.go:117] "RemoveContainer" containerID="1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79"
Jul 24 17:44:37.170704 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:44:37.170673    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79\": container with ID starting with 1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79 not found: ID does not exist" containerID="1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79"
Jul 24 17:44:37.170815 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.170716    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79"} err="failed to get container status \"1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79\": rpc error: code = NotFound desc = could not find container \"1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79\": container with ID starting with 1c995e364530b8f4602924fa0652ec211e2e611c31ec95e696d56bee90270f79 not found: ID does not exist"
Jul 24 17:44:37.185618 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.185583    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d8596784-ms84z"]
Jul 24 17:44:37.190374 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.190342    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d8596784-ms84z"]
Jul 24 17:44:37.458505 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:44:37.458407    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16251ad0-92eb-4de7-b75b-a438b81289d7" path="/var/lib/kubelet/pods/16251ad0-92eb-4de7-b75b-a438b81289d7/volumes"
Jul 24 17:45:10.086991 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.086957    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"]
Jul 24 17:45:10.087445 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.087289    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16251ad0-92eb-4de7-b75b-a438b81289d7" containerName="console"
Jul 24 17:45:10.087445 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.087300    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="16251ad0-92eb-4de7-b75b-a438b81289d7" containerName="console"
Jul 24 17:45:10.087445 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.087351    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="16251ad0-92eb-4de7-b75b-a438b81289d7" containerName="console"
Jul 24 17:45:10.090273 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.090255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.093375 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.093353    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:45:10.093985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.093965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vmxlz\""
Jul 24 17:45:10.093985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.093976    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:45:10.103041 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.102997    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"]
Jul 24 17:45:10.185619 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.185584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.185798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.185631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.185798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.185705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4grp\" (UniqueName: \"kubernetes.io/projected/4b459f89-4249-40bb-9903-fddfb177cd02-kube-api-access-f4grp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.286299 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.286265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.286473 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.286310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4grp\" (UniqueName: \"kubernetes.io/projected/4b459f89-4249-40bb-9903-fddfb177cd02-kube-api-access-f4grp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.286473 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.286356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.286629 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.286609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.286686 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.286668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.296193 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.296175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4grp\" (UniqueName: \"kubernetes.io/projected/4b459f89-4249-40bb-9903-fddfb177cd02-kube-api-access-f4grp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.399428 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.399394    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:10.534451 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:10.534427    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"]
Jul 24 17:45:10.536580 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:45:10.536553    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b459f89_4249_40bb_9903_fddfb177cd02.slice/crio-088805d432d5f3f36e8ca297b392d9d490a45bb025d2f92b6c8700abeb81a532 WatchSource:0}: Error finding container 088805d432d5f3f36e8ca297b392d9d490a45bb025d2f92b6c8700abeb81a532: Status 404 returned error can't find the container with id 088805d432d5f3f36e8ca297b392d9d490a45bb025d2f92b6c8700abeb81a532
Jul 24 17:45:11.288309 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:11.288276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4" event={"ID":"4b459f89-4249-40bb-9903-fddfb177cd02","Type":"ContainerStarted","Data":"088805d432d5f3f36e8ca297b392d9d490a45bb025d2f92b6c8700abeb81a532"}
Jul 24 17:45:17.319229 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:17.319192    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b459f89-4249-40bb-9903-fddfb177cd02" containerID="e50c0f0405440515066758930fdeaf3220fc00e0f6454fb5697c0df8e040fa6b" exitCode=0
Jul 24 17:45:17.319681 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:17.319290    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4" event={"ID":"4b459f89-4249-40bb-9903-fddfb177cd02","Type":"ContainerDied","Data":"e50c0f0405440515066758930fdeaf3220fc00e0f6454fb5697c0df8e040fa6b"}
Jul 24 17:45:20.334222 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:20.334184    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b459f89-4249-40bb-9903-fddfb177cd02" containerID="33eeefa1b7da0360a9fef869ead419deb193b96b96d655b5699ed76f57191bc8" exitCode=0
Jul 24 17:45:20.334601 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:20.334242    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4" event={"ID":"4b459f89-4249-40bb-9903-fddfb177cd02","Type":"ContainerDied","Data":"33eeefa1b7da0360a9fef869ead419deb193b96b96d655b5699ed76f57191bc8"}
Jul 24 17:45:27.365288 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:27.365257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4" event={"ID":"4b459f89-4249-40bb-9903-fddfb177cd02","Type":"ContainerStarted","Data":"137df546e158cdafb529f7144c5e64c74e0bc2c7bafc3b02557a0ef599132612"}
Jul 24 17:45:28.371298 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.371262    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b459f89-4249-40bb-9903-fddfb177cd02" containerID="137df546e158cdafb529f7144c5e64c74e0bc2c7bafc3b02557a0ef599132612" exitCode=0
Jul 24 17:45:28.371659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.371349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4" event={"ID":"4b459f89-4249-40bb-9903-fddfb177cd02","Type":"ContainerDied","Data":"137df546e158cdafb529f7144c5e64c74e0bc2c7bafc3b02557a0ef599132612"}
Jul 24 17:45:28.499776 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.499752    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:28.540799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.540773    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-bundle\") pod \"4b459f89-4249-40bb-9903-fddfb177cd02\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") "
Jul 24 17:45:28.540799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.540802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-util\") pod \"4b459f89-4249-40bb-9903-fddfb177cd02\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") "
Jul 24 17:45:28.540970 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.540859    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4grp\" (UniqueName: \"kubernetes.io/projected/4b459f89-4249-40bb-9903-fddfb177cd02-kube-api-access-f4grp\") pod \"4b459f89-4249-40bb-9903-fddfb177cd02\" (UID: \"4b459f89-4249-40bb-9903-fddfb177cd02\") "
Jul 24 17:45:28.541501 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.541479    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-bundle" (OuterVolumeSpecName: "bundle") pod "4b459f89-4249-40bb-9903-fddfb177cd02" (UID: "4b459f89-4249-40bb-9903-fddfb177cd02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:28.543137 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.543111    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b459f89-4249-40bb-9903-fddfb177cd02-kube-api-access-f4grp" (OuterVolumeSpecName: "kube-api-access-f4grp") pod "4b459f89-4249-40bb-9903-fddfb177cd02" (UID: "4b459f89-4249-40bb-9903-fddfb177cd02"). InnerVolumeSpecName "kube-api-access-f4grp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:28.545136 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.545111    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-util" (OuterVolumeSpecName: "util") pod "4b459f89-4249-40bb-9903-fddfb177cd02" (UID: "4b459f89-4249-40bb-9903-fddfb177cd02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:28.642302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.642276    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4grp\" (UniqueName: \"kubernetes.io/projected/4b459f89-4249-40bb-9903-fddfb177cd02-kube-api-access-f4grp\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:45:28.642453 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.642309    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:45:28.642453 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:28.642323    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b459f89-4249-40bb-9903-fddfb177cd02-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:45:29.377295 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:29.377257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4" event={"ID":"4b459f89-4249-40bb-9903-fddfb177cd02","Type":"ContainerDied","Data":"088805d432d5f3f36e8ca297b392d9d490a45bb025d2f92b6c8700abeb81a532"}
Jul 24 17:45:29.377658 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:29.377314    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="088805d432d5f3f36e8ca297b392d9d490a45bb025d2f92b6c8700abeb81a532"
Jul 24 17:45:29.377658 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:29.377271    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc2n4"
Jul 24 17:45:33.579136 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579096    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"]
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579398    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="util"
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579409    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="util"
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579420    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="pull"
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579425    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="pull"
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579434    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="extract"
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579439    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="extract"
Jul 24 17:45:33.579504 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.579502    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b459f89-4249-40bb-9903-fddfb177cd02" containerName="extract"
Jul 24 17:45:33.582807 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.582756    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.590078 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.590057    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 17:45:33.590221 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.590137    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:45:33.590288 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.590269    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mrmkc\""
Jul 24 17:45:33.605147 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.605124    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"]
Jul 24 17:45:33.682401 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.682369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a2968bd-0207-4e04-9213-2f0b5cf27763-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjs2h\" (UID: \"3a2968bd-0207-4e04-9213-2f0b5cf27763\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.682401 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.682404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkjgf\" (UniqueName: \"kubernetes.io/projected/3a2968bd-0207-4e04-9213-2f0b5cf27763-kube-api-access-hkjgf\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjs2h\" (UID: \"3a2968bd-0207-4e04-9213-2f0b5cf27763\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.783835 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.783769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a2968bd-0207-4e04-9213-2f0b5cf27763-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjs2h\" (UID: \"3a2968bd-0207-4e04-9213-2f0b5cf27763\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.784003 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.783843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkjgf\" (UniqueName: \"kubernetes.io/projected/3a2968bd-0207-4e04-9213-2f0b5cf27763-kube-api-access-hkjgf\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjs2h\" (UID: \"3a2968bd-0207-4e04-9213-2f0b5cf27763\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.784236 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.784220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a2968bd-0207-4e04-9213-2f0b5cf27763-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjs2h\" (UID: \"3a2968bd-0207-4e04-9213-2f0b5cf27763\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.797936 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.797910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkjgf\" (UniqueName: \"kubernetes.io/projected/3a2968bd-0207-4e04-9213-2f0b5cf27763-kube-api-access-hkjgf\") pod \"cert-manager-operator-controller-manager-55c444bf86-hjs2h\" (UID: \"3a2968bd-0207-4e04-9213-2f0b5cf27763\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:33.891613 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:33.891585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"
Jul 24 17:45:34.025402 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:34.025377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h"]
Jul 24 17:45:34.028141 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:45:34.028113    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2968bd_0207_4e04_9213_2f0b5cf27763.slice/crio-28da2b0b49d276737615b05ceec2d7330b21b0179e3c0f85b2f81e6a1cf4ea10 WatchSource:0}: Error finding container 28da2b0b49d276737615b05ceec2d7330b21b0179e3c0f85b2f81e6a1cf4ea10: Status 404 returned error can't find the container with id 28da2b0b49d276737615b05ceec2d7330b21b0179e3c0f85b2f81e6a1cf4ea10
Jul 24 17:45:34.400771 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:34.400739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h" event={"ID":"3a2968bd-0207-4e04-9213-2f0b5cf27763","Type":"ContainerStarted","Data":"28da2b0b49d276737615b05ceec2d7330b21b0179e3c0f85b2f81e6a1cf4ea10"}
Jul 24 17:45:35.406791 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:35.406753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h" event={"ID":"3a2968bd-0207-4e04-9213-2f0b5cf27763","Type":"ContainerStarted","Data":"a79046afa90e4ed4fbed7324506ea82193c1753de25239378c61a3fb1f63c1eb"}
Jul 24 17:45:35.442900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:35.442824    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hjs2h" podStartSLOduration=1.198291422 podStartE2EDuration="2.442803179s" totalImagesPullingTime="1.244511757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:35.440866486 +0000 UTC m=+534.473246845" watchObservedRunningTime="2026-07-24 17:45:35.442803179 +0000 UTC m=+534.475183538"
Jul 24 17:45:36.837606 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.837571    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"]
Jul 24 17:45:36.839797 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.839773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:36.844671 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.844647    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:45:36.844671 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.844646    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:45:36.844853 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.844717    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vmxlz\""
Jul 24 17:45:36.862798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.862777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"]
Jul 24 17:45:36.912337 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.912304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npb9n\" (UniqueName: \"kubernetes.io/projected/51ec6dd9-4dde-4411-a5eb-8560eb818240-kube-api-access-npb9n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:36.912479 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.912344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:36.912479 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:36.912424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.013098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.013059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npb9n\" (UniqueName: \"kubernetes.io/projected/51ec6dd9-4dde-4411-a5eb-8560eb818240-kube-api-access-npb9n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.013098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.013102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.013310 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.013289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.013519 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.013497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.013643 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.013616    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.025449 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.025418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npb9n\" (UniqueName: \"kubernetes.io/projected/51ec6dd9-4dde-4411-a5eb-8560eb818240-kube-api-access-npb9n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.148578 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.148544    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:37.277071 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.277010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"]
Jul 24 17:45:37.279630 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:45:37.279600    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ec6dd9_4dde_4411_a5eb_8560eb818240.slice/crio-62b0fd21f77c6050170320b338be0c09e8ec02f491edaf8f24a66b012eb3c66b WatchSource:0}: Error finding container 62b0fd21f77c6050170320b338be0c09e8ec02f491edaf8f24a66b012eb3c66b: Status 404 returned error can't find the container with id 62b0fd21f77c6050170320b338be0c09e8ec02f491edaf8f24a66b012eb3c66b
Jul 24 17:45:37.416652 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.416583    2564 generic.go:356] "Generic (PLEG): container finished" podID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerID="bb015da6e80678ba0aca99d6eeacb87373d4a80c8773eb627e9b7d8f42a12ad0" exitCode=0
Jul 24 17:45:37.416771 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.416673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67" event={"ID":"51ec6dd9-4dde-4411-a5eb-8560eb818240","Type":"ContainerDied","Data":"bb015da6e80678ba0aca99d6eeacb87373d4a80c8773eb627e9b7d8f42a12ad0"}
Jul 24 17:45:37.416771 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:37.416719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67" event={"ID":"51ec6dd9-4dde-4411-a5eb-8560eb818240","Type":"ContainerStarted","Data":"62b0fd21f77c6050170320b338be0c09e8ec02f491edaf8f24a66b012eb3c66b"}
Jul 24 17:45:38.149886 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.149850    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r7gjk"]
Jul 24 17:45:38.153470 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.153448    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.156373 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.156350    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 17:45:38.157464 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.157441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xhltf\""
Jul 24 17:45:38.157584 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.157472    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 17:45:38.164437 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.164411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r7gjk"]
Jul 24 17:45:38.224142 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.224109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57gx6\" (UniqueName: \"kubernetes.io/projected/35a0ac38-4136-4e6c-9af4-c8065672554f-kube-api-access-57gx6\") pod \"cert-manager-webhook-6486ffd997-r7gjk\" (UID: \"35a0ac38-4136-4e6c-9af4-c8065672554f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.224314 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.224161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a0ac38-4136-4e6c-9af4-c8065672554f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r7gjk\" (UID: \"35a0ac38-4136-4e6c-9af4-c8065672554f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.325780 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.325694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57gx6\" (UniqueName: \"kubernetes.io/projected/35a0ac38-4136-4e6c-9af4-c8065672554f-kube-api-access-57gx6\") pod \"cert-manager-webhook-6486ffd997-r7gjk\" (UID: \"35a0ac38-4136-4e6c-9af4-c8065672554f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.325780 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.325750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a0ac38-4136-4e6c-9af4-c8065672554f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r7gjk\" (UID: \"35a0ac38-4136-4e6c-9af4-c8065672554f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.334356 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.334325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35a0ac38-4136-4e6c-9af4-c8065672554f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r7gjk\" (UID: \"35a0ac38-4136-4e6c-9af4-c8065672554f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.334676 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.334646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57gx6\" (UniqueName: \"kubernetes.io/projected/35a0ac38-4136-4e6c-9af4-c8065672554f-kube-api-access-57gx6\") pod \"cert-manager-webhook-6486ffd997-r7gjk\" (UID: \"35a0ac38-4136-4e6c-9af4-c8065672554f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.469995 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.469961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:38.615734 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:38.615708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r7gjk"]
Jul 24 17:45:39.161464 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:45:39.161429    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35a0ac38_4136_4e6c_9af4_c8065672554f.slice/crio-37b3793ffe3844a1708f3084abb6455f32d21ee9f0941b265ed115b611832b1b WatchSource:0}: Error finding container 37b3793ffe3844a1708f3084abb6455f32d21ee9f0941b265ed115b611832b1b: Status 404 returned error can't find the container with id 37b3793ffe3844a1708f3084abb6455f32d21ee9f0941b265ed115b611832b1b
Jul 24 17:45:39.428915 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:39.428832    2564 generic.go:356] "Generic (PLEG): container finished" podID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerID="8009f7201f0a79a342fae80efa0ec1d587c3d1de0d1a9020f684045b2b649827" exitCode=0
Jul 24 17:45:39.429089 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:39.428911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67" event={"ID":"51ec6dd9-4dde-4411-a5eb-8560eb818240","Type":"ContainerDied","Data":"8009f7201f0a79a342fae80efa0ec1d587c3d1de0d1a9020f684045b2b649827"}
Jul 24 17:45:39.430061 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:39.430040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk" event={"ID":"35a0ac38-4136-4e6c-9af4-c8065672554f","Type":"ContainerStarted","Data":"37b3793ffe3844a1708f3084abb6455f32d21ee9f0941b265ed115b611832b1b"}
Jul 24 17:45:40.437996 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:40.437957    2564 generic.go:356] "Generic (PLEG): container finished" podID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerID="d4636ececd38d5e334989e7147db66bcf694a1f366582909c57c60a90c4e8e4d" exitCode=0
Jul 24 17:45:40.438467 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:40.438004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67" event={"ID":"51ec6dd9-4dde-4411-a5eb-8560eb818240","Type":"ContainerDied","Data":"d4636ececd38d5e334989e7147db66bcf694a1f366582909c57c60a90c4e8e4d"}
Jul 24 17:45:41.613271 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.613244    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:41.756180 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.756137    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npb9n\" (UniqueName: \"kubernetes.io/projected/51ec6dd9-4dde-4411-a5eb-8560eb818240-kube-api-access-npb9n\") pod \"51ec6dd9-4dde-4411-a5eb-8560eb818240\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") "
Jul 24 17:45:41.756180 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.756188    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-util\") pod \"51ec6dd9-4dde-4411-a5eb-8560eb818240\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") "
Jul 24 17:45:41.756376 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.756242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-bundle\") pod \"51ec6dd9-4dde-4411-a5eb-8560eb818240\" (UID: \"51ec6dd9-4dde-4411-a5eb-8560eb818240\") "
Jul 24 17:45:41.756701 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.756669    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-bundle" (OuterVolumeSpecName: "bundle") pod "51ec6dd9-4dde-4411-a5eb-8560eb818240" (UID: "51ec6dd9-4dde-4411-a5eb-8560eb818240"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:41.758296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.758272    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ec6dd9-4dde-4411-a5eb-8560eb818240-kube-api-access-npb9n" (OuterVolumeSpecName: "kube-api-access-npb9n") pod "51ec6dd9-4dde-4411-a5eb-8560eb818240" (UID: "51ec6dd9-4dde-4411-a5eb-8560eb818240"). InnerVolumeSpecName "kube-api-access-npb9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:41.761846 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.761822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-util" (OuterVolumeSpecName: "util") pod "51ec6dd9-4dde-4411-a5eb-8560eb818240" (UID: "51ec6dd9-4dde-4411-a5eb-8560eb818240"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:41.857659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.857626    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npb9n\" (UniqueName: \"kubernetes.io/projected/51ec6dd9-4dde-4411-a5eb-8560eb818240-kube-api-access-npb9n\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:45:41.857659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.857651    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:45:41.857659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:41.857662    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ec6dd9-4dde-4411-a5eb-8560eb818240-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:45:42.448878 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:42.448841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk" event={"ID":"35a0ac38-4136-4e6c-9af4-c8065672554f","Type":"ContainerStarted","Data":"7ec20842a3535876ecdf2923c17f5e55dcdc999f1419a4d986365c4b942c1c7f"}
Jul 24 17:45:42.449112 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:42.448987    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:42.450726 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:42.450699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67" event={"ID":"51ec6dd9-4dde-4411-a5eb-8560eb818240","Type":"ContainerDied","Data":"62b0fd21f77c6050170320b338be0c09e8ec02f491edaf8f24a66b012eb3c66b"}
Jul 24 17:45:42.450846 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:42.450741    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg67"
Jul 24 17:45:42.450846 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:42.450741    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62b0fd21f77c6050170320b338be0c09e8ec02f491edaf8f24a66b012eb3c66b"
Jul 24 17:45:42.471484 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:42.471441    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk" podStartSLOduration=1.97820331 podStartE2EDuration="4.47142889s" totalImagesPullingTime="2.49322558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:42.469646231 +0000 UTC m=+541.502026589" watchObservedRunningTime="2026-07-24 17:45:42.47142889 +0000 UTC m=+541.503809248"
Jul 24 17:45:47.463653 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.463621    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wxgvx"]
Jul 24 17:45:47.464020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.463952    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="extract"
Jul 24 17:45:47.464020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.463964    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="extract"
Jul 24 17:45:47.464020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.463976    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="util"
Jul 24 17:45:47.464020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.463982    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="util"
Jul 24 17:45:47.464020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.463997    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="pull"
Jul 24 17:45:47.464020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.464003    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="pull"
Jul 24 17:45:47.464247 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.464073    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ec6dd9-4dde-4411-a5eb-8560eb818240" containerName="extract"
Jul 24 17:45:47.467270 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.467252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.469926 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.469900    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fjkff\""
Jul 24 17:45:47.476903 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.476876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wxgvx"]
Jul 24 17:45:47.608551 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.608512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56b81a6a-b125-4826-a9c3-78062ea59a50-bound-sa-token\") pod \"cert-manager-55b4d954d5-wxgvx\" (UID: \"56b81a6a-b125-4826-a9c3-78062ea59a50\") " pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.608719 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.608606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn79x\" (UniqueName: \"kubernetes.io/projected/56b81a6a-b125-4826-a9c3-78062ea59a50-kube-api-access-rn79x\") pod \"cert-manager-55b4d954d5-wxgvx\" (UID: \"56b81a6a-b125-4826-a9c3-78062ea59a50\") " pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.709665 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.709626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56b81a6a-b125-4826-a9c3-78062ea59a50-bound-sa-token\") pod \"cert-manager-55b4d954d5-wxgvx\" (UID: \"56b81a6a-b125-4826-a9c3-78062ea59a50\") " pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.709803 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.709693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn79x\" (UniqueName: \"kubernetes.io/projected/56b81a6a-b125-4826-a9c3-78062ea59a50-kube-api-access-rn79x\") pod \"cert-manager-55b4d954d5-wxgvx\" (UID: \"56b81a6a-b125-4826-a9c3-78062ea59a50\") " pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.720900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.720832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56b81a6a-b125-4826-a9c3-78062ea59a50-bound-sa-token\") pod \"cert-manager-55b4d954d5-wxgvx\" (UID: \"56b81a6a-b125-4826-a9c3-78062ea59a50\") " pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.721012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.720966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn79x\" (UniqueName: \"kubernetes.io/projected/56b81a6a-b125-4826-a9c3-78062ea59a50-kube-api-access-rn79x\") pod \"cert-manager-55b4d954d5-wxgvx\" (UID: \"56b81a6a-b125-4826-a9c3-78062ea59a50\") " pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.777599 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.777562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wxgvx"
Jul 24 17:45:47.906048 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:47.906009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wxgvx"]
Jul 24 17:45:47.908706 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:45:47.908679    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56b81a6a_b125_4826_a9c3_78062ea59a50.slice/crio-4a68ca2304df2f76b19ed37c5f67ae1fefa070d75cb3a996abdea5b79132ba90 WatchSource:0}: Error finding container 4a68ca2304df2f76b19ed37c5f67ae1fefa070d75cb3a996abdea5b79132ba90: Status 404 returned error can't find the container with id 4a68ca2304df2f76b19ed37c5f67ae1fefa070d75cb3a996abdea5b79132ba90
Jul 24 17:45:48.457952 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:48.457921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r7gjk"
Jul 24 17:45:48.476131 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:48.476098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wxgvx" event={"ID":"56b81a6a-b125-4826-a9c3-78062ea59a50","Type":"ContainerStarted","Data":"6670d5e1a2b1e06768366c8ffbc7628389a891c15b90ac2f77e73c2ca9e4ea1c"}
Jul 24 17:45:48.476468 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:48.476137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wxgvx" event={"ID":"56b81a6a-b125-4826-a9c3-78062ea59a50","Type":"ContainerStarted","Data":"4a68ca2304df2f76b19ed37c5f67ae1fefa070d75cb3a996abdea5b79132ba90"}
Jul 24 17:45:48.535868 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:48.535794    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wxgvx" podStartSLOduration=1.5357714599999999 podStartE2EDuration="1.53577146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:48.534081793 +0000 UTC m=+547.566462142" watchObservedRunningTime="2026-07-24 17:45:48.53577146 +0000 UTC m=+547.568151814"
Jul 24 17:45:57.416013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.415976    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"]
Jul 24 17:45:57.419445 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.419428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.422318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.422292    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:45:57.422318 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.422293    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:45:57.422463 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.422350    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vmxlz\""
Jul 24 17:45:57.428900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.428871    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"]
Jul 24 17:45:57.493552 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.493520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-465wx\" (UniqueName: \"kubernetes.io/projected/c21860aa-8766-464b-b920-2131a22ade1d-kube-api-access-465wx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.493730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.493580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.493730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.493603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.594526 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.594494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-465wx\" (UniqueName: \"kubernetes.io/projected/c21860aa-8766-464b-b920-2131a22ade1d-kube-api-access-465wx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.594700 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.594560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.594700 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.594582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.594918 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.594902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.594972 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.594953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.602754 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.602725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-465wx\" (UniqueName: \"kubernetes.io/projected/c21860aa-8766-464b-b920-2131a22ade1d-kube-api-access-465wx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.730010 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.729920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:45:57.862939 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:57.862904    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"]
Jul 24 17:45:57.865473 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:45:57.865449    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21860aa_8766_464b_b920_2131a22ade1d.slice/crio-2e2c8932b1b8620bf5835f794a0bac7f1c574b45d3fe636ea0315e2ea1354abe WatchSource:0}: Error finding container 2e2c8932b1b8620bf5835f794a0bac7f1c574b45d3fe636ea0315e2ea1354abe: Status 404 returned error can't find the container with id 2e2c8932b1b8620bf5835f794a0bac7f1c574b45d3fe636ea0315e2ea1354abe
Jul 24 17:45:58.527415 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:58.527375    2564 generic.go:356] "Generic (PLEG): container finished" podID="c21860aa-8766-464b-b920-2131a22ade1d" containerID="0b017fbed0e784e732ddc7b34fee952b62c7e191399cabe46cc400ba11241eb4" exitCode=0
Jul 24 17:45:58.527802 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:58.527460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td" event={"ID":"c21860aa-8766-464b-b920-2131a22ade1d","Type":"ContainerDied","Data":"0b017fbed0e784e732ddc7b34fee952b62c7e191399cabe46cc400ba11241eb4"}
Jul 24 17:45:58.527802 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:58.527510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td" event={"ID":"c21860aa-8766-464b-b920-2131a22ade1d","Type":"ContainerStarted","Data":"2e2c8932b1b8620bf5835f794a0bac7f1c574b45d3fe636ea0315e2ea1354abe"}
Jul 24 17:45:59.533229 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:59.533195    2564 generic.go:356] "Generic (PLEG): container finished" podID="c21860aa-8766-464b-b920-2131a22ade1d" containerID="5d0dfd914e99a539b43e7a9898c0d7cf1640cb491c585a99cf825954cede2fce" exitCode=0
Jul 24 17:45:59.533573 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:45:59.533264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td" event={"ID":"c21860aa-8766-464b-b920-2131a22ade1d","Type":"ContainerDied","Data":"5d0dfd914e99a539b43e7a9898c0d7cf1640cb491c585a99cf825954cede2fce"}
Jul 24 17:46:00.539686 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:00.539651    2564 generic.go:356] "Generic (PLEG): container finished" podID="c21860aa-8766-464b-b920-2131a22ade1d" containerID="bdf06581dab8ce101e140d080e8d5018049fdfbe3472752c4134a9e91e523622" exitCode=0
Jul 24 17:46:00.540094 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:00.539725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td" event={"ID":"c21860aa-8766-464b-b920-2131a22ade1d","Type":"ContainerDied","Data":"bdf06581dab8ce101e140d080e8d5018049fdfbe3472752c4134a9e91e523622"}
Jul 24 17:46:01.671764 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.671739    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:46:01.723294 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.723239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-util\") pod \"c21860aa-8766-464b-b920-2131a22ade1d\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") "
Jul 24 17:46:01.723294 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.723294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-bundle\") pod \"c21860aa-8766-464b-b920-2131a22ade1d\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") "
Jul 24 17:46:01.723535 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.723325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-465wx\" (UniqueName: \"kubernetes.io/projected/c21860aa-8766-464b-b920-2131a22ade1d-kube-api-access-465wx\") pod \"c21860aa-8766-464b-b920-2131a22ade1d\" (UID: \"c21860aa-8766-464b-b920-2131a22ade1d\") "
Jul 24 17:46:01.724081 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.724055    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-bundle" (OuterVolumeSpecName: "bundle") pod "c21860aa-8766-464b-b920-2131a22ade1d" (UID: "c21860aa-8766-464b-b920-2131a22ade1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.725416 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.725392    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c21860aa-8766-464b-b920-2131a22ade1d-kube-api-access-465wx" (OuterVolumeSpecName: "kube-api-access-465wx") pod "c21860aa-8766-464b-b920-2131a22ade1d" (UID: "c21860aa-8766-464b-b920-2131a22ade1d"). InnerVolumeSpecName "kube-api-access-465wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:01.731385 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.731334    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-util" (OuterVolumeSpecName: "util") pod "c21860aa-8766-464b-b920-2131a22ade1d" (UID: "c21860aa-8766-464b-b920-2131a22ade1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:01.823986 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.823888    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.823986 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.823923    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21860aa-8766-464b-b920-2131a22ade1d-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:01.823986 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:01.823935    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-465wx\" (UniqueName: \"kubernetes.io/projected/c21860aa-8766-464b-b920-2131a22ade1d-kube-api-access-465wx\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:02.552303 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:02.552265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td" event={"ID":"c21860aa-8766-464b-b920-2131a22ade1d","Type":"ContainerDied","Data":"2e2c8932b1b8620bf5835f794a0bac7f1c574b45d3fe636ea0315e2ea1354abe"}
Jul 24 17:46:02.552303 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:02.552302    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr86td"
Jul 24 17:46:02.552507 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:02.552321    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e2c8932b1b8620bf5835f794a0bac7f1c574b45d3fe636ea0315e2ea1354abe"
Jul 24 17:46:09.256355 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256320    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"]
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256624    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="pull"
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256634    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="pull"
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256651    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="extract"
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256656    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="extract"
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256671    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="util"
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256677    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="util"
Jul 24 17:46:09.256733 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.256726    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c21860aa-8766-464b-b920-2131a22ade1d" containerName="extract"
Jul 24 17:46:09.258650 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.258634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.262580 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.262560    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:46:09.262713 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.262671    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:46:09.262769 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.262715    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:46:09.262818 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.262714    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:46:09.262868 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.262817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jth4d\""
Jul 24 17:46:09.277207 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.277186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.277311 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.277229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-tmp\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.277311 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.277256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8mv\" (UniqueName: \"kubernetes.io/projected/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-kube-api-access-kf8mv\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.277311 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.277285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-manifests\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.277455 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.277376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.308080 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.308050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"]
Jul 24 17:46:09.378075 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.378046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-tmp\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.378235 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.378080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8mv\" (UniqueName: \"kubernetes.io/projected/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-kube-api-access-kf8mv\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.378235 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.378106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-manifests\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.378235 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.378163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.378235 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.378205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.378568 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.378549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-manifests\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.380398 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.380377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-tmp\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.380753 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.380731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.380820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.380731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.394654 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.394632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8mv\" (UniqueName: \"kubernetes.io/projected/9d80a36b-b389-4f2a-85fc-cc4102b91f3c-kube-api-access-kf8mv\") pod \"opendatahub-operator-controller-manager-6b794f588d-t28z2\" (UID: \"9d80a36b-b389-4f2a-85fc-cc4102b91f3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.568678 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.568583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:09.713747 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:09.713722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"]
Jul 24 17:46:09.716526 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:09.716501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d80a36b_b389_4f2a_85fc_cc4102b91f3c.slice/crio-83a1898fffd79850721c4d6d1463b1a57f80b1a83b6a7b964d1dfacaf437e98c WatchSource:0}: Error finding container 83a1898fffd79850721c4d6d1463b1a57f80b1a83b6a7b964d1dfacaf437e98c: Status 404 returned error can't find the container with id 83a1898fffd79850721c4d6d1463b1a57f80b1a83b6a7b964d1dfacaf437e98c
Jul 24 17:46:10.596631 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:10.596570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2" event={"ID":"9d80a36b-b389-4f2a-85fc-cc4102b91f3c","Type":"ContainerStarted","Data":"83a1898fffd79850721c4d6d1463b1a57f80b1a83b6a7b964d1dfacaf437e98c"}
Jul 24 17:46:13.612446 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:13.612413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2" event={"ID":"9d80a36b-b389-4f2a-85fc-cc4102b91f3c","Type":"ContainerStarted","Data":"9616c9a1ed73219f8f67b1bf9380b0cbaeadd3067208a4789cb77a2f8af67f11"}
Jul 24 17:46:14.617759 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:14.617722    2564 generic.go:356] "Generic (PLEG): container finished" podID="9d80a36b-b389-4f2a-85fc-cc4102b91f3c" containerID="9616c9a1ed73219f8f67b1bf9380b0cbaeadd3067208a4789cb77a2f8af67f11" exitCode=0
Jul 24 17:46:14.618164 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:14.617812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2" event={"ID":"9d80a36b-b389-4f2a-85fc-cc4102b91f3c","Type":"ContainerDied","Data":"9616c9a1ed73219f8f67b1bf9380b0cbaeadd3067208a4789cb77a2f8af67f11"}
Jul 24 17:46:15.624847 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:15.624804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2" event={"ID":"9d80a36b-b389-4f2a-85fc-cc4102b91f3c","Type":"ContainerStarted","Data":"fddd0c1e0ab0d8f68004148106c76fe26cb10c3c4f56651f7c1d2a304f663d5a"}
Jul 24 17:46:15.625273 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:15.625002    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:15.650139 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:15.650082    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2" podStartSLOduration=2.09867408 podStartE2EDuration="6.650062241s" totalImagesPullingTime="3.499384735s" totalInitContainerRuntime="1.052003426s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:15.647815857 +0000 UTC m=+574.680196209" watchObservedRunningTime="2026-07-24 17:46:15.650062241 +0000 UTC m=+574.682442598"
Jul 24 17:46:26.631045 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:26.630990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b794f588d-t28z2"
Jul 24 17:46:29.539050 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.538994    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"]
Jul 24 17:46:29.547585 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.547556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.553934 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.553899    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 17:46:29.554102 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.554039    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 17:46:29.555145 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.554927    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l2f9s\""
Jul 24 17:46:29.555145 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.554933    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:46:29.555145 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.554958    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:46:29.563976 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.563952    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"]
Jul 24 17:46:29.656216 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.656173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f809a7ec-db72-4140-87c4-79cfc05ab3de-tls-certs\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.656414 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.656223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7qd\" (UniqueName: \"kubernetes.io/projected/f809a7ec-db72-4140-87c4-79cfc05ab3de-kube-api-access-ts7qd\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.656414 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.656337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f809a7ec-db72-4140-87c4-79cfc05ab3de-tmp\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.693738 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.693708    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9t2x4"]
Jul 24 17:46:29.697615 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.697595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:29.700275 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.700253    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 17:46:29.700388 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.700261    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wds8d\""
Jul 24 17:46:29.709659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.709636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9t2x4"]
Jul 24 17:46:29.756942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.756897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq925\" (UniqueName: \"kubernetes.io/projected/22acf81d-ab18-4dce-8209-6f4385a5bce0-kube-api-access-xq925\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:29.756942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.756943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f809a7ec-db72-4140-87c4-79cfc05ab3de-tmp\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.757213 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.757000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22acf81d-ab18-4dce-8209-6f4385a5bce0-cert\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:29.757213 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.757186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f809a7ec-db72-4140-87c4-79cfc05ab3de-tls-certs\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.757313 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.757215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7qd\" (UniqueName: \"kubernetes.io/projected/f809a7ec-db72-4140-87c4-79cfc05ab3de-kube-api-access-ts7qd\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.759125 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.759103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f809a7ec-db72-4140-87c4-79cfc05ab3de-tmp\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.759453 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.759421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f809a7ec-db72-4140-87c4-79cfc05ab3de-tls-certs\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.774721 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.774702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7qd\" (UniqueName: \"kubernetes.io/projected/f809a7ec-db72-4140-87c4-79cfc05ab3de-kube-api-access-ts7qd\") pod \"kube-auth-proxy-546fb58d4c-4qbp9\" (UID: \"f809a7ec-db72-4140-87c4-79cfc05ab3de\") " pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.857540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.857456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"
Jul 24 17:46:29.857759 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.857731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq925\" (UniqueName: \"kubernetes.io/projected/22acf81d-ab18-4dce-8209-6f4385a5bce0-kube-api-access-xq925\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:29.857863 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.857784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22acf81d-ab18-4dce-8209-6f4385a5bce0-cert\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:29.857987 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:46:29.857966    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 17:46:29.858075 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:46:29.858061    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22acf81d-ab18-4dce-8209-6f4385a5bce0-cert podName:22acf81d-ab18-4dce-8209-6f4385a5bce0 nodeName:}" failed. No retries permitted until 2026-07-24 17:46:30.358038943 +0000 UTC m=+589.390419285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22acf81d-ab18-4dce-8209-6f4385a5bce0-cert") pod "odh-model-controller-7998c67dc4-9t2x4" (UID: "22acf81d-ab18-4dce-8209-6f4385a5bce0") : secret "odh-model-controller-webhook-cert" not found
Jul 24 17:46:29.872040 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:29.872002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq925\" (UniqueName: \"kubernetes.io/projected/22acf81d-ab18-4dce-8209-6f4385a5bce0-kube-api-access-xq925\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:30.001221 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.001197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9"]
Jul 24 17:46:30.003622 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:30.003595    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf809a7ec_db72_4140_87c4_79cfc05ab3de.slice/crio-ee65ca9a9ac4b1b790c387884ce8152e519908082ad9c2ca83248e7ed0a90e3f WatchSource:0}: Error finding container ee65ca9a9ac4b1b790c387884ce8152e519908082ad9c2ca83248e7ed0a90e3f: Status 404 returned error can't find the container with id ee65ca9a9ac4b1b790c387884ce8152e519908082ad9c2ca83248e7ed0a90e3f
Jul 24 17:46:30.362525 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.362484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22acf81d-ab18-4dce-8209-6f4385a5bce0-cert\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:30.364787 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.364763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22acf81d-ab18-4dce-8209-6f4385a5bce0-cert\") pod \"odh-model-controller-7998c67dc4-9t2x4\" (UID: \"22acf81d-ab18-4dce-8209-6f4385a5bce0\") " pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:30.593589 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.593557    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zn9sf"]
Jul 24 17:46:30.605464 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.605356    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:30.609268 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.609199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zn9sf"]
Jul 24 17:46:30.609418 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.609366    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 17:46:30.611583 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.611555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:30.664866 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.664835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5fgt\" (UniqueName: \"kubernetes.io/projected/472d3051-3545-4ff4-8e5b-d9c499350abb-kube-api-access-p5fgt\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:30.665060 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.664881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472d3051-3545-4ff4-8e5b-d9c499350abb-tls-certs\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:30.699929 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.699831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9" event={"ID":"f809a7ec-db72-4140-87c4-79cfc05ab3de","Type":"ContainerStarted","Data":"ee65ca9a9ac4b1b790c387884ce8152e519908082ad9c2ca83248e7ed0a90e3f"}
Jul 24 17:46:30.766901 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.766487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fgt\" (UniqueName: \"kubernetes.io/projected/472d3051-3545-4ff4-8e5b-d9c499350abb-kube-api-access-p5fgt\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:30.766901 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.766544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472d3051-3545-4ff4-8e5b-d9c499350abb-tls-certs\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:30.766901 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:46:30.766700    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 24 17:46:30.766901 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:46:30.766767    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472d3051-3545-4ff4-8e5b-d9c499350abb-tls-certs podName:472d3051-3545-4ff4-8e5b-d9c499350abb nodeName:}" failed. No retries permitted until 2026-07-24 17:46:31.266746565 +0000 UTC m=+590.299126914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/472d3051-3545-4ff4-8e5b-d9c499350abb-tls-certs") pod "model-serving-api-54d89bd5fc-zn9sf" (UID: "472d3051-3545-4ff4-8e5b-d9c499350abb") : secret "model-serving-api-tls" not found
Jul 24 17:46:30.779474 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.779440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5fgt\" (UniqueName: \"kubernetes.io/projected/472d3051-3545-4ff4-8e5b-d9c499350abb-kube-api-access-p5fgt\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:30.788296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.788272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9t2x4"]
Jul 24 17:46:30.790665 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:30.790637    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22acf81d_ab18_4dce_8209_6f4385a5bce0.slice/crio-280df017dfabf3b4cef9d64790d95a358017262c522f1ad3e9d7441cab486cfb WatchSource:0}: Error finding container 280df017dfabf3b4cef9d64790d95a358017262c522f1ad3e9d7441cab486cfb: Status 404 returned error can't find the container with id 280df017dfabf3b4cef9d64790d95a358017262c522f1ad3e9d7441cab486cfb
Jul 24 17:46:30.852420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.852386    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"]
Jul 24 17:46:30.857374 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.857353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.860040 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.859997    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 17:46:30.860206 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.860177    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l5j77\""
Jul 24 17:46:30.860206 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.860175    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 17:46:30.860455 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.860439    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:46:30.860659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.860639    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 17:46:30.873963 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.873941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"]
Jul 24 17:46:30.968540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.968540 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhn4\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-kube-api-access-dhhn4\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.968768 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.968768 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.968768 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.968768 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:30.968950 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:30.968875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069443 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069625 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhn4\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-kube-api-access-dhhn4\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069625 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069625 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069787 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069787 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.069923 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.069853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.070512 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.070486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.072564 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.072536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.072564 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.072558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.072753 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.072676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.072913 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.072894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.083422 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.083394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.085644 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.085621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhn4\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-kube-api-access-dhhn4\") pod \"istiod-openshift-gateway-7b7995d5cd-jcrxs\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.169545 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.169512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:31.272045 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.271995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472d3051-3545-4ff4-8e5b-d9c499350abb-tls-certs\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:31.275604 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.275552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472d3051-3545-4ff4-8e5b-d9c499350abb-tls-certs\") pod \"model-serving-api-54d89bd5fc-zn9sf\" (UID: \"472d3051-3545-4ff4-8e5b-d9c499350abb\") " pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:31.352171 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.352075    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"]
Jul 24 17:46:31.354072 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:31.354014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1143f9d8_d0c3_4b7f_8e8a_4e9ecd58f601.slice/crio-b041a2a1d22f725ac388f54882909aaac4b5de7a79f13cf2f8fea593510c23e5 WatchSource:0}: Error finding container b041a2a1d22f725ac388f54882909aaac4b5de7a79f13cf2f8fea593510c23e5: Status 404 returned error can't find the container with id b041a2a1d22f725ac388f54882909aaac4b5de7a79f13cf2f8fea593510c23e5
Jul 24 17:46:31.524524 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.524437    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:31.709574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.709534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs" event={"ID":"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601","Type":"ContainerStarted","Data":"b041a2a1d22f725ac388f54882909aaac4b5de7a79f13cf2f8fea593510c23e5"}
Jul 24 17:46:31.711909 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.711874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4" event={"ID":"22acf81d-ab18-4dce-8209-6f4385a5bce0","Type":"ContainerStarted","Data":"280df017dfabf3b4cef9d64790d95a358017262c522f1ad3e9d7441cab486cfb"}
Jul 24 17:46:31.715674 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:31.715637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zn9sf"]
Jul 24 17:46:31.720871 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:31.720834    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472d3051_3545_4ff4_8e5b_d9c499350abb.slice/crio-f6ce8f50a45861235baf08a4e2bdb1f434e6084edde0fc821541fb6668eec305 WatchSource:0}: Error finding container f6ce8f50a45861235baf08a4e2bdb1f434e6084edde0fc821541fb6668eec305: Status 404 returned error can't find the container with id f6ce8f50a45861235baf08a4e2bdb1f434e6084edde0fc821541fb6668eec305
Jul 24 17:46:32.719821 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:32.719779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf" event={"ID":"472d3051-3545-4ff4-8e5b-d9c499350abb","Type":"ContainerStarted","Data":"f6ce8f50a45861235baf08a4e2bdb1f434e6084edde0fc821541fb6668eec305"}
Jul 24 17:46:35.663227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:35.663183    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:46:35.663609 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:35.663256    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:46:36.675619 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.675588    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"]
Jul 24 17:46:36.679214 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.679195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.682106 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.682085    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gtt77\""
Jul 24 17:46:36.694020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.694000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"]
Jul 24 17:46:36.750937 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.750896    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs" event={"ID":"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601","Type":"ContainerStarted","Data":"cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549"}
Jul 24 17:46:36.751157 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.751060    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:36.753158 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.753120    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:36.753294 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.753223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4" event={"ID":"22acf81d-ab18-4dce-8209-6f4385a5bce0","Type":"ContainerStarted","Data":"e01c5790e70da40397fdb5f3d09202a98e16dd6ba55b8a757f94879234ea3c39"}
Jul 24 17:46:36.753359 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.753348    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:36.754985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.754964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf" event={"ID":"472d3051-3545-4ff4-8e5b-d9c499350abb","Type":"ContainerStarted","Data":"3b4498961b3f5d7e28045d259f2872758fffaabe862bd16bdfba7e153c61e948"}
Jul 24 17:46:36.755117 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.755071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:36.756555 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.756529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9" event={"ID":"f809a7ec-db72-4140-87c4-79cfc05ab3de","Type":"ContainerStarted","Data":"acde3bafdbf6ba34758dde3d694a6455a1d1fe4f41bf68d6b0c50b80f299a8f0"}
Jul 24 17:46:36.777783 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.777739    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs" podStartSLOduration=2.471198294 podStartE2EDuration="6.777725307s" totalImagesPullingTime="4.306527013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:36.776093886 +0000 UTC m=+595.808474246" watchObservedRunningTime="2026-07-24 17:46:36.777725307 +0000 UTC m=+595.810105648"
Jul 24 17:46:36.804214 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.804164    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf" podStartSLOduration=2.863058947 podStartE2EDuration="6.80414937s" totalImagesPullingTime="3.941090423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:36.802354453 +0000 UTC m=+595.834734811" watchObservedRunningTime="2026-07-24 17:46:36.80414937 +0000 UTC m=+595.836529759"
Jul 24 17:46:36.831185 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b9f2b9-dfbc-44ae-a996-088874667126-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831441 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8g6t\" (UniqueName: \"kubernetes.io/projected/47b9f2b9-dfbc-44ae-a996-088874667126-kube-api-access-f8g6t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831441 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b9f2b9-dfbc-44ae-a996-088874667126-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831571 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831620 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831620 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.831730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.831711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b9f2b9-dfbc-44ae-a996-088874667126-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.855369 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.855318    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-546fb58d4c-4qbp9" podStartSLOduration=2.268084709 podStartE2EDuration="7.855301275s" totalImagesPullingTime="5.587216566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:36.853193835 +0000 UTC m=+595.885574193" watchObservedRunningTime="2026-07-24 17:46:36.855301275 +0000 UTC m=+595.887681684"
Jul 24 17:46:36.882414 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.882354    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4" podStartSLOduration=3.018923536 podStartE2EDuration="7.882337857s" totalImagesPullingTime="4.863414321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:36.87988527 +0000 UTC m=+595.912265630" watchObservedRunningTime="2026-07-24 17:46:36.882337857 +0000 UTC m=+595.914718215"
Jul 24 17:46:36.932737 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b9f2b9-dfbc-44ae-a996-088874667126-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932737 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932955 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932955 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932955 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932955 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932955 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b9f2b9-dfbc-44ae-a996-088874667126-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.932955 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b9f2b9-dfbc-44ae-a996-088874667126-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.933287 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.932959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8g6t\" (UniqueName: \"kubernetes.io/projected/47b9f2b9-dfbc-44ae-a996-088874667126-kube-api-access-f8g6t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.933610 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.933554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.933610 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.933579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.933884 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.933855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.934108 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.934089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.934200 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.934174    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b9f2b9-dfbc-44ae-a996-088874667126-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.935589 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.935559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b9f2b9-dfbc-44ae-a996-088874667126-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.935928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.935905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b9f2b9-dfbc-44ae-a996-088874667126-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.941865 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.941839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b9f2b9-dfbc-44ae-a996-088874667126-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.942509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.942488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8g6t\" (UniqueName: \"kubernetes.io/projected/47b9f2b9-dfbc-44ae-a996-088874667126-kube-api-access-f8g6t\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq\" (UID: \"47b9f2b9-dfbc-44ae-a996-088874667126\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:36.989452 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:36.989419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:37.134839 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:37.134816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"]
Jul 24 17:46:37.136633 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:37.136607    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b9f2b9_dfbc_44ae_a996_088874667126.slice/crio-885140ffe0fa0fbff89fe623a73766a4161b8a3284dc5e6f99b69fc7677541e1 WatchSource:0}: Error finding container 885140ffe0fa0fbff89fe623a73766a4161b8a3284dc5e6f99b69fc7677541e1: Status 404 returned error can't find the container with id 885140ffe0fa0fbff89fe623a73766a4161b8a3284dc5e6f99b69fc7677541e1
Jul 24 17:46:37.762453 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:37.762413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq" event={"ID":"47b9f2b9-dfbc-44ae-a996-088874667126","Type":"ContainerStarted","Data":"885140ffe0fa0fbff89fe623a73766a4161b8a3284dc5e6f99b69fc7677541e1"}
Jul 24 17:46:39.832770 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:39.832732    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:46:39.833143 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:39.832819    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:46:39.833143 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:39.832867    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:46:40.783811 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:40.783762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq" event={"ID":"47b9f2b9-dfbc-44ae-a996-088874667126","Type":"ContainerStarted","Data":"b8c7ca940f6a4c422ae018114febb63c1471d16cca76b535abca930157149ed6"}
Jul 24 17:46:40.818633 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:40.818576    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq" podStartSLOduration=2.124870675 podStartE2EDuration="4.818561076s" totalImagesPullingTime="2.693690401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:40.816828789 +0000 UTC m=+599.849209147" watchObservedRunningTime="2026-07-24 17:46:40.818561076 +0000 UTC m=+599.850941433"
Jul 24 17:46:40.990131 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:40.990090    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:40.995293 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:40.995262    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:41.234980 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.234938    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"]
Jul 24 17:46:41.238081 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.238063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.241996 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.241969    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9b6p4\""
Jul 24 17:46:41.242133 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.242040    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 17:46:41.262555 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.262523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"]
Jul 24 17:46:41.281988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.281952    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"]
Jul 24 17:46:41.287338 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.287313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.291332 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.291258    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 17:46:41.291679 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.291659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nxckr\""
Jul 24 17:46:41.316879 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.316846    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"]
Jul 24 17:46:41.381084 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.381052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faf1cde-9b05-4a5c-be20-c4d60dad3e22-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jxm77\" (UID: \"5faf1cde-9b05-4a5c-be20-c4d60dad3e22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.381263 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.381164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5pv2\" (UniqueName: \"kubernetes.io/projected/c219d2db-c24f-4253-a89e-112b4aaf7a41-kube-api-access-g5pv2\") pod \"kserve-controller-manager-d6f4b65b8-24vw8\" (UID: \"c219d2db-c24f-4253-a89e-112b4aaf7a41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.381263 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.381199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/5faf1cde-9b05-4a5c-be20-c4d60dad3e22-kube-api-access-6wpxs\") pod \"llmisvc-controller-manager-777c6bd7d5-jxm77\" (UID: \"5faf1cde-9b05-4a5c-be20-c4d60dad3e22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.381263 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.381256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c219d2db-c24f-4253-a89e-112b4aaf7a41-cert\") pod \"kserve-controller-manager-d6f4b65b8-24vw8\" (UID: \"c219d2db-c24f-4253-a89e-112b4aaf7a41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.482249 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.482213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c219d2db-c24f-4253-a89e-112b4aaf7a41-cert\") pod \"kserve-controller-manager-d6f4b65b8-24vw8\" (UID: \"c219d2db-c24f-4253-a89e-112b4aaf7a41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.482436 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.482272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faf1cde-9b05-4a5c-be20-c4d60dad3e22-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jxm77\" (UID: \"5faf1cde-9b05-4a5c-be20-c4d60dad3e22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.482436 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.482336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5pv2\" (UniqueName: \"kubernetes.io/projected/c219d2db-c24f-4253-a89e-112b4aaf7a41-kube-api-access-g5pv2\") pod \"kserve-controller-manager-d6f4b65b8-24vw8\" (UID: \"c219d2db-c24f-4253-a89e-112b4aaf7a41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.482562 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.482451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/5faf1cde-9b05-4a5c-be20-c4d60dad3e22-kube-api-access-6wpxs\") pod \"llmisvc-controller-manager-777c6bd7d5-jxm77\" (UID: \"5faf1cde-9b05-4a5c-be20-c4d60dad3e22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.484830 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.484751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faf1cde-9b05-4a5c-be20-c4d60dad3e22-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jxm77\" (UID: \"5faf1cde-9b05-4a5c-be20-c4d60dad3e22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.510407 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.485356    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 17:46:41.510407 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.490803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/5faf1cde-9b05-4a5c-be20-c4d60dad3e22-kube-api-access-6wpxs\") pod \"llmisvc-controller-manager-777c6bd7d5-jxm77\" (UID: \"5faf1cde-9b05-4a5c-be20-c4d60dad3e22\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.510407 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.491153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5pv2\" (UniqueName: \"kubernetes.io/projected/c219d2db-c24f-4253-a89e-112b4aaf7a41-kube-api-access-g5pv2\") pod \"kserve-controller-manager-d6f4b65b8-24vw8\" (UID: \"c219d2db-c24f-4253-a89e-112b4aaf7a41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.510407 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.494606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c219d2db-c24f-4253-a89e-112b4aaf7a41-cert\") pod \"kserve-controller-manager-d6f4b65b8-24vw8\" (UID: \"c219d2db-c24f-4253-a89e-112b4aaf7a41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.551725 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.551701    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9b6p4\""
Jul 24 17:46:41.559966 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.559939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:41.600876 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.600561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:41.730467 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.730217    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"]
Jul 24 17:46:41.732918 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:41.732886    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc219d2db_c24f_4253_a89e_112b4aaf7a41.slice/crio-25b9dbe4b018117b915c7a18eeef583f76623f1d081dd4a912f9ea9403875274 WatchSource:0}: Error finding container 25b9dbe4b018117b915c7a18eeef583f76623f1d081dd4a912f9ea9403875274: Status 404 returned error can't find the container with id 25b9dbe4b018117b915c7a18eeef583f76623f1d081dd4a912f9ea9403875274
Jul 24 17:46:41.782129 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.782101    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"]
Jul 24 17:46:41.783326 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:46:41.783301    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5faf1cde_9b05_4a5c_be20_c4d60dad3e22.slice/crio-b6f9a85d664680b336a6029b24d9d7566c929da7f8f5a6b2d212001df84e89f8 WatchSource:0}: Error finding container b6f9a85d664680b336a6029b24d9d7566c929da7f8f5a6b2d212001df84e89f8: Status 404 returned error can't find the container with id b6f9a85d664680b336a6029b24d9d7566c929da7f8f5a6b2d212001df84e89f8
Jul 24 17:46:41.790017 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.789988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77" event={"ID":"5faf1cde-9b05-4a5c-be20-c4d60dad3e22","Type":"ContainerStarted","Data":"b6f9a85d664680b336a6029b24d9d7566c929da7f8f5a6b2d212001df84e89f8"}
Jul 24 17:46:41.791248 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.791218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8" event={"ID":"c219d2db-c24f-4253-a89e-112b4aaf7a41","Type":"ContainerStarted","Data":"25b9dbe4b018117b915c7a18eeef583f76623f1d081dd4a912f9ea9403875274"}
Jul 24 17:46:41.791510 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.791494    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:41.792478 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:41.792459    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq"
Jul 24 17:46:44.818922 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:44.818884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8" event={"ID":"c219d2db-c24f-4253-a89e-112b4aaf7a41","Type":"ContainerStarted","Data":"b0b07b61894ec1ba130eef6eb2ac1fe82418b6e0304b750c7143d27214b3f73e"}
Jul 24 17:46:44.819297 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:44.818987    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:46:44.879836 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:44.879780    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8" podStartSLOduration=1.613900436 podStartE2EDuration="3.8797612s" totalImagesPullingTime="2.265860764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:44.877187924 +0000 UTC m=+603.909568284" watchObservedRunningTime="2026-07-24 17:46:44.8797612 +0000 UTC m=+603.912141558"
Jul 24 17:46:45.824843 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:45.824805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77" event={"ID":"5faf1cde-9b05-4a5c-be20-c4d60dad3e22","Type":"ContainerStarted","Data":"59940277e294eab5e5261a3f54c7bcb82995bdf13f084557d0b2da0ab3aa1305"}
Jul 24 17:46:45.866904 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:45.866840    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77" podStartSLOduration=1.6073060529999998 podStartE2EDuration="4.866819824s" totalImagesPullingTime="3.259513771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:45.866077251 +0000 UTC m=+604.898457610" watchObservedRunningTime="2026-07-24 17:46:45.866819824 +0000 UTC m=+604.899200185"
Jul 24 17:46:46.830141 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:46.830096    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:46:47.155782 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.155748    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"]
Jul 24 17:46:47.155977 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.155956    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs" podUID="1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" containerName="discovery" containerID="cri-o://cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549" gracePeriod=30
Jul 24 17:46:47.405760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.405733    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:47.438998 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.438912    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-kubeconfig\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.438998 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.438956    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-ca-configmap\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.439262 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.439002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-dns-cert\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.439430 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.439385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:46:47.439604 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.439581    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-cacerts\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.439863 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.439841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-token\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.440116 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.440069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-local-certs\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.440269 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.440252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhhn4\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-kube-api-access-dhhn4\") pod \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\" (UID: \"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601\") "
Jul 24 17:46:47.440645 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.440627    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-ca-configmap\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.442306 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.442280    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:46:47.442306 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.442285    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:46:47.443065 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.443009    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-local-certs" (OuterVolumeSpecName: "local-certs") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:47.444088 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.443375    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-token" (OuterVolumeSpecName: "istio-token") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:47.444088 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.443735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-kube-api-access-dhhn4" (OuterVolumeSpecName: "kube-api-access-dhhn4") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "kube-api-access-dhhn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:47.444663 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.444392    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-cacerts" (OuterVolumeSpecName: "cacerts") pod "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" (UID: "1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:46:47.541958 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.541924    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhhn4\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-kube-api-access-dhhn4\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.541958 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.541953    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-kubeconfig\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.541958 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.541962    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-csr-dns-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.541958 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.541970    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-cacerts\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.542239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.541979    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-istio-token\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.542239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.541987    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601-local-certs\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:46:47.765814 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.765733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9t2x4"
Jul 24 17:46:47.767510 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.767492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zn9sf"
Jul 24 17:46:47.836323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.836291    2564 generic.go:356] "Generic (PLEG): container finished" podID="1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" containerID="cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549" exitCode=0
Jul 24 17:46:47.836777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.836345    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"
Jul 24 17:46:47.836777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.836376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs" event={"ID":"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601","Type":"ContainerDied","Data":"cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549"}
Jul 24 17:46:47.836777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.836425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs" event={"ID":"1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601","Type":"ContainerDied","Data":"b041a2a1d22f725ac388f54882909aaac4b5de7a79f13cf2f8fea593510c23e5"}
Jul 24 17:46:47.836777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.836449    2564 scope.go:117] "RemoveContainer" containerID="cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549"
Jul 24 17:46:47.847827 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.847798    2564 scope.go:117] "RemoveContainer" containerID="cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549"
Jul 24 17:46:47.848178 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:46:47.848150    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549\": container with ID starting with cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549 not found: ID does not exist" containerID="cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549"
Jul 24 17:46:47.848268 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.848191    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549"} err="failed to get container status \"cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549\": rpc error: code = NotFound desc = could not find container \"cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549\": container with ID starting with cf6e79d6cb5d1848dc51baca7d5e81a318a6accc7902229972a8e589ae1c8549 not found: ID does not exist"
Jul 24 17:46:47.868760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.868733    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"]
Jul 24 17:46:47.874729 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:47.874705    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jcrxs"]
Jul 24 17:46:49.465995 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:46:49.465960    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" path="/var/lib/kubelet/pods/1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601/volumes"
Jul 24 17:47:15.830153 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:15.830078    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-24vw8"
Jul 24 17:47:17.838998 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:17.838968    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jxm77"
Jul 24 17:47:30.390622 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.390582    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kg4w5"]
Jul 24 17:47:30.391156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.391139    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" containerName="discovery"
Jul 24 17:47:30.391248 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.391158    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" containerName="discovery"
Jul 24 17:47:30.391301 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.391247    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1143f9d8-d0c3-4b7f-8e8a-4e9ecd58f601" containerName="discovery"
Jul 24 17:47:30.402039 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.402006    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:30.404984 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.404958    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:47:30.405114 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.405009    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:47:30.405937 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.405918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4j8cd\""
Jul 24 17:47:30.423173 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.423148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kg4w5"]
Jul 24 17:47:30.426327 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.426306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhpg4\" (UniqueName: \"kubernetes.io/projected/6e7da544-cc84-4d72-91b9-ce23b4d969ae-kube-api-access-fhpg4\") pod \"kuadrant-operator-catalog-kg4w5\" (UID: \"6e7da544-cc84-4d72-91b9-ce23b4d969ae\") " pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:30.527194 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.527157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhpg4\" (UniqueName: \"kubernetes.io/projected/6e7da544-cc84-4d72-91b9-ce23b4d969ae-kube-api-access-fhpg4\") pod \"kuadrant-operator-catalog-kg4w5\" (UID: \"6e7da544-cc84-4d72-91b9-ce23b4d969ae\") " pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:30.540192 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.540166    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhpg4\" (UniqueName: \"kubernetes.io/projected/6e7da544-cc84-4d72-91b9-ce23b4d969ae-kube-api-access-fhpg4\") pod \"kuadrant-operator-catalog-kg4w5\" (UID: \"6e7da544-cc84-4d72-91b9-ce23b4d969ae\") " pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:30.711247 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.711152    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:30.728156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.728121    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kg4w5"]
Jul 24 17:47:30.861986 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:30.861957    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7da544_cc84_4d72_91b9_ce23b4d969ae.slice/crio-b18737842de37f203b336e5c55a69e069cd7a95467499b3ec55e9ff135f8a4ef WatchSource:0}: Error finding container b18737842de37f203b336e5c55a69e069cd7a95467499b3ec55e9ff135f8a4ef: Status 404 returned error can't find the container with id b18737842de37f203b336e5c55a69e069cd7a95467499b3ec55e9ff135f8a4ef
Jul 24 17:47:30.875818 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.875788    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kg4w5"]
Jul 24 17:47:30.955545 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.955515    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmtx7"]
Jul 24 17:47:30.958264 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.958246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:30.979692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:30.979668    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmtx7"]
Jul 24 17:47:31.037679 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:31.037636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwpmj\" (UniqueName: \"kubernetes.io/projected/a511a828-41d2-4c21-83ab-5994f8790f06-kube-api-access-pwpmj\") pod \"kuadrant-operator-catalog-rmtx7\" (UID: \"a511a828-41d2-4c21-83ab-5994f8790f06\") " pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:31.048199 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:31.048165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5" event={"ID":"6e7da544-cc84-4d72-91b9-ce23b4d969ae","Type":"ContainerStarted","Data":"b18737842de37f203b336e5c55a69e069cd7a95467499b3ec55e9ff135f8a4ef"}
Jul 24 17:47:31.139068 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:31.139015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwpmj\" (UniqueName: \"kubernetes.io/projected/a511a828-41d2-4c21-83ab-5994f8790f06-kube-api-access-pwpmj\") pod \"kuadrant-operator-catalog-rmtx7\" (UID: \"a511a828-41d2-4c21-83ab-5994f8790f06\") " pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:31.161918 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:31.161887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwpmj\" (UniqueName: \"kubernetes.io/projected/a511a828-41d2-4c21-83ab-5994f8790f06-kube-api-access-pwpmj\") pod \"kuadrant-operator-catalog-rmtx7\" (UID: \"a511a828-41d2-4c21-83ab-5994f8790f06\") " pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:31.268501 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:31.268432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:31.423134 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:31.423107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rmtx7"]
Jul 24 17:47:31.510319 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:31.510260    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda511a828_41d2_4c21_83ab_5994f8790f06.slice/crio-a0636426e6068cfb33ead2f28568459b9e7002f26f13c9edd6b1b86443a51f4b WatchSource:0}: Error finding container a0636426e6068cfb33ead2f28568459b9e7002f26f13c9edd6b1b86443a51f4b: Status 404 returned error can't find the container with id a0636426e6068cfb33ead2f28568459b9e7002f26f13c9edd6b1b86443a51f4b
Jul 24 17:47:32.055551 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:32.055517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7" event={"ID":"a511a828-41d2-4c21-83ab-5994f8790f06","Type":"ContainerStarted","Data":"a0636426e6068cfb33ead2f28568459b9e7002f26f13c9edd6b1b86443a51f4b"}
Jul 24 17:47:33.061768 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.061729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7" event={"ID":"a511a828-41d2-4c21-83ab-5994f8790f06","Type":"ContainerStarted","Data":"f4aaba6b7f453e8d55d38e0c6e288a33f3e135a92ccbf8ef634d93e0f0cb2106"}
Jul 24 17:47:33.063173 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.063149    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5" event={"ID":"6e7da544-cc84-4d72-91b9-ce23b4d969ae","Type":"ContainerStarted","Data":"e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf"}
Jul 24 17:47:33.063303 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.063230    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5" podUID="6e7da544-cc84-4d72-91b9-ce23b4d969ae" containerName="registry-server" containerID="cri-o://e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf" gracePeriod=2
Jul 24 17:47:33.087113 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.087071    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7" podStartSLOduration=2.088585744 podStartE2EDuration="3.087057497s" totalImagesPullingTime="998.471753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:47:33.0856595 +0000 UTC m=+652.118039859" watchObservedRunningTime="2026-07-24 17:47:33.087057497 +0000 UTC m=+652.119437853"
Jul 24 17:47:33.102587 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.102549    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5" podStartSLOduration=1.455780924 podStartE2EDuration="3.102537446s" totalImagesPullingTime="1.646756522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:47:33.101550423 +0000 UTC m=+652.133930780" watchObservedRunningTime="2026-07-24 17:47:33.102537446 +0000 UTC m=+652.134917802"
Jul 24 17:47:33.314211 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.314157    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:33.359945 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.359919    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhpg4\" (UniqueName: \"kubernetes.io/projected/6e7da544-cc84-4d72-91b9-ce23b4d969ae-kube-api-access-fhpg4\") pod \"6e7da544-cc84-4d72-91b9-ce23b4d969ae\" (UID: \"6e7da544-cc84-4d72-91b9-ce23b4d969ae\") "
Jul 24 17:47:33.362031 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.361997    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e7da544-cc84-4d72-91b9-ce23b4d969ae-kube-api-access-fhpg4" (OuterVolumeSpecName: "kube-api-access-fhpg4") pod "6e7da544-cc84-4d72-91b9-ce23b4d969ae" (UID: "6e7da544-cc84-4d72-91b9-ce23b4d969ae"). InnerVolumeSpecName "kube-api-access-fhpg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:33.460977 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:33.460944    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhpg4\" (UniqueName: \"kubernetes.io/projected/6e7da544-cc84-4d72-91b9-ce23b4d969ae-kube-api-access-fhpg4\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:34.068987 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.068954    2564 generic.go:356] "Generic (PLEG): container finished" podID="6e7da544-cc84-4d72-91b9-ce23b4d969ae" containerID="e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf" exitCode=0
Jul 24 17:47:34.069395 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.069003    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5"
Jul 24 17:47:34.069395 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.069072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5" event={"ID":"6e7da544-cc84-4d72-91b9-ce23b4d969ae","Type":"ContainerDied","Data":"e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf"}
Jul 24 17:47:34.069395 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.069130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kg4w5" event={"ID":"6e7da544-cc84-4d72-91b9-ce23b4d969ae","Type":"ContainerDied","Data":"b18737842de37f203b336e5c55a69e069cd7a95467499b3ec55e9ff135f8a4ef"}
Jul 24 17:47:34.069395 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.069161    2564 scope.go:117] "RemoveContainer" containerID="e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf"
Jul 24 17:47:34.078005 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.077991    2564 scope.go:117] "RemoveContainer" containerID="e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf"
Jul 24 17:47:34.078263 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:47:34.078245    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf\": container with ID starting with e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf not found: ID does not exist" containerID="e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf"
Jul 24 17:47:34.078320 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.078270    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf"} err="failed to get container status \"e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf\": rpc error: code = NotFound desc = could not find container \"e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf\": container with ID starting with e929ab2504a28ff9534e758cc3b09a07d928b7e9ffd23fa588839ed867468cdf not found: ID does not exist"
Jul 24 17:47:34.088745 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.088667    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kg4w5"]
Jul 24 17:47:34.093643 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:34.093616    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kg4w5"]
Jul 24 17:47:35.459520 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:35.459488    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e7da544-cc84-4d72-91b9-ce23b4d969ae" path="/var/lib/kubelet/pods/6e7da544-cc84-4d72-91b9-ce23b4d969ae/volumes"
Jul 24 17:47:41.269182 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:41.269150    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:41.269583 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:41.269204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:41.290832 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:41.290809    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:42.128808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:42.128779    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rmtx7"
Jul 24 17:47:45.738692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.738653    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"]
Jul 24 17:47:45.739067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.739002    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e7da544-cc84-4d72-91b9-ce23b4d969ae" containerName="registry-server"
Jul 24 17:47:45.739067 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.739012    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e7da544-cc84-4d72-91b9-ce23b4d969ae" containerName="registry-server"
Jul 24 17:47:45.739145 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.739109    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e7da544-cc84-4d72-91b9-ce23b4d969ae" containerName="registry-server"
Jul 24 17:47:45.741991 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.741967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.744939 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.744913    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sd8r8\""
Jul 24 17:47:45.753384 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.753360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"]
Jul 24 17:47:45.856613 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.856580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.856819 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.856639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp2zg\" (UniqueName: \"kubernetes.io/projected/7a0f3f4d-bf78-40e7-b787-8b8028693880-kube-api-access-rp2zg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.856819 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.856750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.957871 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.957839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.958013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.957876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.958013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.957907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp2zg\" (UniqueName: \"kubernetes.io/projected/7a0f3f4d-bf78-40e7-b787-8b8028693880-kube-api-access-rp2zg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.958228 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.958208    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.958298 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.958255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:45.968461 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:45.968434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp2zg\" (UniqueName: \"kubernetes.io/projected/7a0f3f4d-bf78-40e7-b787-8b8028693880-kube-api-access-rp2zg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:46.051152 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.051073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:46.192146 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:46.192118    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0f3f4d_bf78_40e7_b787_8b8028693880.slice/crio-c8714c5dcff1426bf4949d84ae0ba7e9c1134743f86230276209c7a934fd1303 WatchSource:0}: Error finding container c8714c5dcff1426bf4949d84ae0ba7e9c1134743f86230276209c7a934fd1303: Status 404 returned error can't find the container with id c8714c5dcff1426bf4949d84ae0ba7e9c1134743f86230276209c7a934fd1303
Jul 24 17:47:46.192309 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.192286    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"]
Jul 24 17:47:46.529798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.529764    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"]
Jul 24 17:47:46.533279 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.533262    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.543348 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.543326    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"]
Jul 24 17:47:46.563236 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.563210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.563350 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.563303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg8jr\" (UniqueName: \"kubernetes.io/projected/7209ce0b-7bbc-4613-88ed-3270bd4a159b-kube-api-access-xg8jr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.563350 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.563339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.664529 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.664482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg8jr\" (UniqueName: \"kubernetes.io/projected/7209ce0b-7bbc-4613-88ed-3270bd4a159b-kube-api-access-xg8jr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.664723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.664589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.664723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.664637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.664961 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.664945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.665082 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.665060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.673087 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.673064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg8jr\" (UniqueName: \"kubernetes.io/projected/7209ce0b-7bbc-4613-88ed-3270bd4a159b-kube-api-access-xg8jr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.842699 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.842607    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:46.995489 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:46.995465    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"]
Jul 24 17:47:46.997069 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:46.997035    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7209ce0b_7bbc_4613_88ed_3270bd4a159b.slice/crio-649cbfa8d6e0a4afdd5981589534c79b2d2c5912bf15322a64699b72fbdf8369 WatchSource:0}: Error finding container 649cbfa8d6e0a4afdd5981589534c79b2d2c5912bf15322a64699b72fbdf8369: Status 404 returned error can't find the container with id 649cbfa8d6e0a4afdd5981589534c79b2d2c5912bf15322a64699b72fbdf8369
Jul 24 17:47:47.138212 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.138181    2564 generic.go:356] "Generic (PLEG): container finished" podID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerID="2d23a8db046925b6bedf6451bba29005c99a2734f3154d5285ab7f0f7c6d6e7d" exitCode=0
Jul 24 17:47:47.138330 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.138266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd" event={"ID":"7209ce0b-7bbc-4613-88ed-3270bd4a159b","Type":"ContainerDied","Data":"2d23a8db046925b6bedf6451bba29005c99a2734f3154d5285ab7f0f7c6d6e7d"}
Jul 24 17:47:47.138398 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.138333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd" event={"ID":"7209ce0b-7bbc-4613-88ed-3270bd4a159b","Type":"ContainerStarted","Data":"649cbfa8d6e0a4afdd5981589534c79b2d2c5912bf15322a64699b72fbdf8369"}
Jul 24 17:47:47.138799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.138770    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:47:47.139715 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.139692    2564 generic.go:356] "Generic (PLEG): container finished" podID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerID="f54d8750715904f0d3c65dc6e1d6c529d3eed01b1e07fb63bc0d313633f18077" exitCode=0
Jul 24 17:47:47.139804 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.139751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9" event={"ID":"7a0f3f4d-bf78-40e7-b787-8b8028693880","Type":"ContainerDied","Data":"f54d8750715904f0d3c65dc6e1d6c529d3eed01b1e07fb63bc0d313633f18077"}
Jul 24 17:47:47.139855 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.139803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9" event={"ID":"7a0f3f4d-bf78-40e7-b787-8b8028693880","Type":"ContainerStarted","Data":"c8714c5dcff1426bf4949d84ae0ba7e9c1134743f86230276209c7a934fd1303"}
Jul 24 17:47:47.179093 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.179054    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"]
Jul 24 17:47:47.182855 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.182840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.203365 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.203336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"]
Jul 24 17:47:47.270225 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.270193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgp9r\" (UniqueName: \"kubernetes.io/projected/070a0a4e-c277-4871-96b7-ddf83a8d9e91-kube-api-access-wgp9r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.270403 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.270233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.270403 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.270334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.371044 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.370946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.371044 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.370993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgp9r\" (UniqueName: \"kubernetes.io/projected/070a0a4e-c277-4871-96b7-ddf83a8d9e91-kube-api-access-wgp9r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.371044 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.371035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.371326 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.371306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.371387 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.371339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.387804 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.387775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgp9r\" (UniqueName: \"kubernetes.io/projected/070a0a4e-c277-4871-96b7-ddf83a8d9e91-kube-api-access-wgp9r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.491652 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.491620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:47.589278 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.589210    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"]
Jul 24 17:47:47.595728 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.595704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.625914 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.625843    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"]
Jul 24 17:47:47.657113 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.657087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"]
Jul 24 17:47:47.673897 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.673875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.673993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.673905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7l78\" (UniqueName: \"kubernetes.io/projected/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-kube-api-access-v7l78\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.673993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.673964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.708280 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:47.708252    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070a0a4e_c277_4871_96b7_ddf83a8d9e91.slice/crio-8a730df367149cc214dde704883d05cddf7699bf7f9f5ab3d5049da72d1b7678 WatchSource:0}: Error finding container 8a730df367149cc214dde704883d05cddf7699bf7f9f5ab3d5049da72d1b7678: Status 404 returned error can't find the container with id 8a730df367149cc214dde704883d05cddf7699bf7f9f5ab3d5049da72d1b7678
Jul 24 17:47:47.779988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.775520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.779988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.775573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7l78\" (UniqueName: \"kubernetes.io/projected/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-kube-api-access-v7l78\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.779988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.775652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.779988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.776100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.779988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.776367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.788262 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.788238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7l78\" (UniqueName: \"kubernetes.io/projected/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-kube-api-access-v7l78\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:47.913120 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:47.913093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:48.044770 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.044743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"]
Jul 24 17:47:48.046479 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:48.046450    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda203e3b0_b718_4dd2_899c_fe03c0fa56fa.slice/crio-3d975d68038965ab4b96a8938f708797008ff2bcaca6a0d183508df4feab6272 WatchSource:0}: Error finding container 3d975d68038965ab4b96a8938f708797008ff2bcaca6a0d183508df4feab6272: Status 404 returned error can't find the container with id 3d975d68038965ab4b96a8938f708797008ff2bcaca6a0d183508df4feab6272
Jul 24 17:47:48.150206 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.150170    2564 generic.go:356] "Generic (PLEG): container finished" podID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerID="e9c9ae0abbf50ab21d41eb1ef2860345ffcca1dba05b30525293b7a497e127d1" exitCode=0
Jul 24 17:47:48.150461 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.150231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9" event={"ID":"7a0f3f4d-bf78-40e7-b787-8b8028693880","Type":"ContainerDied","Data":"e9c9ae0abbf50ab21d41eb1ef2860345ffcca1dba05b30525293b7a497e127d1"}
Jul 24 17:47:48.152586 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.152564    2564 generic.go:356] "Generic (PLEG): container finished" podID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerID="bbf085c84e5976b89799f926d9892e59ec8f45811457999113089bfde871fa79" exitCode=0
Jul 24 17:47:48.152716 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.152645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8" event={"ID":"070a0a4e-c277-4871-96b7-ddf83a8d9e91","Type":"ContainerDied","Data":"bbf085c84e5976b89799f926d9892e59ec8f45811457999113089bfde871fa79"}
Jul 24 17:47:48.152716 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.152693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8" event={"ID":"070a0a4e-c277-4871-96b7-ddf83a8d9e91","Type":"ContainerStarted","Data":"8a730df367149cc214dde704883d05cddf7699bf7f9f5ab3d5049da72d1b7678"}
Jul 24 17:47:48.154915 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.154894    2564 generic.go:356] "Generic (PLEG): container finished" podID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerID="11ac768a49bf5a35f872a3f20a1b14b2bb75874144d3c87090a5c512aeaff929" exitCode=0
Jul 24 17:47:48.155048 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.154990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd" event={"ID":"7209ce0b-7bbc-4613-88ed-3270bd4a159b","Type":"ContainerDied","Data":"11ac768a49bf5a35f872a3f20a1b14b2bb75874144d3c87090a5c512aeaff929"}
Jul 24 17:47:48.157495 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.157465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4" event={"ID":"a203e3b0-b718-4dd2-899c-fe03c0fa56fa","Type":"ContainerStarted","Data":"7963773fff69244c135b128c6ce9a5c7a7188ddfd06d5927413836a3cd0943ef"}
Jul 24 17:47:48.157588 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:48.157503    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4" event={"ID":"a203e3b0-b718-4dd2-899c-fe03c0fa56fa","Type":"ContainerStarted","Data":"3d975d68038965ab4b96a8938f708797008ff2bcaca6a0d183508df4feab6272"}
Jul 24 17:47:49.164257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.164228    2564 generic.go:356] "Generic (PLEG): container finished" podID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerID="d551193fd871cfd66b3b781409d9af4c4d1fac584b6db68c16101ba3faf4089d" exitCode=0
Jul 24 17:47:49.164625 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.164287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd" event={"ID":"7209ce0b-7bbc-4613-88ed-3270bd4a159b","Type":"ContainerDied","Data":"d551193fd871cfd66b3b781409d9af4c4d1fac584b6db68c16101ba3faf4089d"}
Jul 24 17:47:49.166074 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.166048    2564 generic.go:356] "Generic (PLEG): container finished" podID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerID="7963773fff69244c135b128c6ce9a5c7a7188ddfd06d5927413836a3cd0943ef" exitCode=0
Jul 24 17:47:49.166074 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.166067    2564 generic.go:356] "Generic (PLEG): container finished" podID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerID="b85bdd3cac20fb915c443d1dc8733e44c53b82aa3f13140dfb3314c86dfc3e36" exitCode=0
Jul 24 17:47:49.166267 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.166115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4" event={"ID":"a203e3b0-b718-4dd2-899c-fe03c0fa56fa","Type":"ContainerDied","Data":"7963773fff69244c135b128c6ce9a5c7a7188ddfd06d5927413836a3cd0943ef"}
Jul 24 17:47:49.166267 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.166155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4" event={"ID":"a203e3b0-b718-4dd2-899c-fe03c0fa56fa","Type":"ContainerDied","Data":"b85bdd3cac20fb915c443d1dc8733e44c53b82aa3f13140dfb3314c86dfc3e36"}
Jul 24 17:47:49.168211 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.168191    2564 generic.go:356] "Generic (PLEG): container finished" podID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerID="bbed5446aaceb60de26f0c0a21994a3354950a5d23acdfa2919225b128c1f867" exitCode=0
Jul 24 17:47:49.168351 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.168265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9" event={"ID":"7a0f3f4d-bf78-40e7-b787-8b8028693880","Type":"ContainerDied","Data":"bbed5446aaceb60de26f0c0a21994a3354950a5d23acdfa2919225b128c1f867"}
Jul 24 17:47:49.169931 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.169910    2564 generic.go:356] "Generic (PLEG): container finished" podID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerID="8b689c0279a86f188549633201b5a48a9041865e87e3e8d63603004cbda5c1c1" exitCode=0
Jul 24 17:47:49.170038 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:49.169996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8" event={"ID":"070a0a4e-c277-4871-96b7-ddf83a8d9e91","Type":"ContainerDied","Data":"8b689c0279a86f188549633201b5a48a9041865e87e3e8d63603004cbda5c1c1"}
Jul 24 17:47:50.177478 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.177439    2564 generic.go:356] "Generic (PLEG): container finished" podID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerID="052716ec4ea9760fbca1f2d36ba05eeea5c950920aaff72eb750591ab35e43b4" exitCode=0
Jul 24 17:47:50.177878 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.177524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4" event={"ID":"a203e3b0-b718-4dd2-899c-fe03c0fa56fa","Type":"ContainerDied","Data":"052716ec4ea9760fbca1f2d36ba05eeea5c950920aaff72eb750591ab35e43b4"}
Jul 24 17:47:50.179352 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.179331    2564 generic.go:356] "Generic (PLEG): container finished" podID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerID="28695467d4e93e0b1c84a3f9bd08be8bfe64572f7fdec9b9fe893f840a62f017" exitCode=0
Jul 24 17:47:50.179446 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.179405    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8" event={"ID":"070a0a4e-c277-4871-96b7-ddf83a8d9e91","Type":"ContainerDied","Data":"28695467d4e93e0b1c84a3f9bd08be8bfe64572f7fdec9b9fe893f840a62f017"}
Jul 24 17:47:50.334767 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.334745    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:50.341541 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.341521    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:50.403019 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.402992    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-util\") pod \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") "
Jul 24 17:47:50.403199 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp2zg\" (UniqueName: \"kubernetes.io/projected/7a0f3f4d-bf78-40e7-b787-8b8028693880-kube-api-access-rp2zg\") pod \"7a0f3f4d-bf78-40e7-b787-8b8028693880\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") "
Jul 24 17:47:50.403199 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg8jr\" (UniqueName: \"kubernetes.io/projected/7209ce0b-7bbc-4613-88ed-3270bd4a159b-kube-api-access-xg8jr\") pod \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") "
Jul 24 17:47:50.403199 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-bundle\") pod \"7a0f3f4d-bf78-40e7-b787-8b8028693880\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") "
Jul 24 17:47:50.403199 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403143    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-bundle\") pod \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\" (UID: \"7209ce0b-7bbc-4613-88ed-3270bd4a159b\") "
Jul 24 17:47:50.403199 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403181    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-util\") pod \"7a0f3f4d-bf78-40e7-b787-8b8028693880\" (UID: \"7a0f3f4d-bf78-40e7-b787-8b8028693880\") "
Jul 24 17:47:50.403767 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403716    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-bundle" (OuterVolumeSpecName: "bundle") pod "7209ce0b-7bbc-4613-88ed-3270bd4a159b" (UID: "7209ce0b-7bbc-4613-88ed-3270bd4a159b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:50.403935 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.403882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-bundle" (OuterVolumeSpecName: "bundle") pod "7a0f3f4d-bf78-40e7-b787-8b8028693880" (UID: "7a0f3f4d-bf78-40e7-b787-8b8028693880"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:50.405345 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.405319    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0f3f4d-bf78-40e7-b787-8b8028693880-kube-api-access-rp2zg" (OuterVolumeSpecName: "kube-api-access-rp2zg") pod "7a0f3f4d-bf78-40e7-b787-8b8028693880" (UID: "7a0f3f4d-bf78-40e7-b787-8b8028693880"). InnerVolumeSpecName "kube-api-access-rp2zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:50.405598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.405581    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7209ce0b-7bbc-4613-88ed-3270bd4a159b-kube-api-access-xg8jr" (OuterVolumeSpecName: "kube-api-access-xg8jr") pod "7209ce0b-7bbc-4613-88ed-3270bd4a159b" (UID: "7209ce0b-7bbc-4613-88ed-3270bd4a159b"). InnerVolumeSpecName "kube-api-access-xg8jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:50.409287 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.409260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-util" (OuterVolumeSpecName: "util") pod "7a0f3f4d-bf78-40e7-b787-8b8028693880" (UID: "7a0f3f4d-bf78-40e7-b787-8b8028693880"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:50.409537 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.409517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-util" (OuterVolumeSpecName: "util") pod "7209ce0b-7bbc-4613-88ed-3270bd4a159b" (UID: "7209ce0b-7bbc-4613-88ed-3270bd4a159b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:50.504574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.504542    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg8jr\" (UniqueName: \"kubernetes.io/projected/7209ce0b-7bbc-4613-88ed-3270bd4a159b-kube-api-access-xg8jr\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.504574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.504574    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.504785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.504589    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.504785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.504601    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0f3f4d-bf78-40e7-b787-8b8028693880-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.504785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.504613    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7209ce0b-7bbc-4613-88ed-3270bd4a159b-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:50.504785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:50.504624    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp2zg\" (UniqueName: \"kubernetes.io/projected/7a0f3f4d-bf78-40e7-b787-8b8028693880-kube-api-access-rp2zg\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:51.186237 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.186206    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd"
Jul 24 17:47:51.186661 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.186209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd" event={"ID":"7209ce0b-7bbc-4613-88ed-3270bd4a159b","Type":"ContainerDied","Data":"649cbfa8d6e0a4afdd5981589534c79b2d2c5912bf15322a64699b72fbdf8369"}
Jul 24 17:47:51.186661 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.186361    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="649cbfa8d6e0a4afdd5981589534c79b2d2c5912bf15322a64699b72fbdf8369"
Jul 24 17:47:51.188057 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.188034    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9"
Jul 24 17:47:51.188057 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.188043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9" event={"ID":"7a0f3f4d-bf78-40e7-b787-8b8028693880","Type":"ContainerDied","Data":"c8714c5dcff1426bf4949d84ae0ba7e9c1134743f86230276209c7a934fd1303"}
Jul 24 17:47:51.188212 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.188077    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8714c5dcff1426bf4949d84ae0ba7e9c1134743f86230276209c7a934fd1303"
Jul 24 17:47:51.321692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.321668    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:51.345564 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.345544    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:51.412723 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.412695    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-util\") pod \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") "
Jul 24 17:47:51.412859 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.412733    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-util\") pod \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") "
Jul 24 17:47:51.412859 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.412769    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-bundle\") pod \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") "
Jul 24 17:47:51.412859 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.412812    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7l78\" (UniqueName: \"kubernetes.io/projected/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-kube-api-access-v7l78\") pod \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\" (UID: \"a203e3b0-b718-4dd2-899c-fe03c0fa56fa\") "
Jul 24 17:47:51.413013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.412868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-bundle\") pod \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") "
Jul 24 17:47:51.413013 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.412910    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgp9r\" (UniqueName: \"kubernetes.io/projected/070a0a4e-c277-4871-96b7-ddf83a8d9e91-kube-api-access-wgp9r\") pod \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\" (UID: \"070a0a4e-c277-4871-96b7-ddf83a8d9e91\") "
Jul 24 17:47:51.413322 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.413296    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-bundle" (OuterVolumeSpecName: "bundle") pod "a203e3b0-b718-4dd2-899c-fe03c0fa56fa" (UID: "a203e3b0-b718-4dd2-899c-fe03c0fa56fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:51.413461 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.413434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-bundle" (OuterVolumeSpecName: "bundle") pod "070a0a4e-c277-4871-96b7-ddf83a8d9e91" (UID: "070a0a4e-c277-4871-96b7-ddf83a8d9e91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:51.414894 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.414870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-kube-api-access-v7l78" (OuterVolumeSpecName: "kube-api-access-v7l78") pod "a203e3b0-b718-4dd2-899c-fe03c0fa56fa" (UID: "a203e3b0-b718-4dd2-899c-fe03c0fa56fa"). InnerVolumeSpecName "kube-api-access-v7l78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:51.415071 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.414952    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070a0a4e-c277-4871-96b7-ddf83a8d9e91-kube-api-access-wgp9r" (OuterVolumeSpecName: "kube-api-access-wgp9r") pod "070a0a4e-c277-4871-96b7-ddf83a8d9e91" (UID: "070a0a4e-c277-4871-96b7-ddf83a8d9e91"). InnerVolumeSpecName "kube-api-access-wgp9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:47:51.417956 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.417927    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-util" (OuterVolumeSpecName: "util") pod "a203e3b0-b718-4dd2-899c-fe03c0fa56fa" (UID: "a203e3b0-b718-4dd2-899c-fe03c0fa56fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:51.418659 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.418641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-util" (OuterVolumeSpecName: "util") pod "070a0a4e-c277-4871-96b7-ddf83a8d9e91" (UID: "070a0a4e-c277-4871-96b7-ddf83a8d9e91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:47:51.513777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.513745    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgp9r\" (UniqueName: \"kubernetes.io/projected/070a0a4e-c277-4871-96b7-ddf83a8d9e91-kube-api-access-wgp9r\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:51.513777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.513777    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:51.514016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.513789    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-util\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:51.514016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.513800    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:51.514016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.513811    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7l78\" (UniqueName: \"kubernetes.io/projected/a203e3b0-b718-4dd2-899c-fe03c0fa56fa-kube-api-access-v7l78\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:51.514016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:51.513825    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/070a0a4e-c277-4871-96b7-ddf83a8d9e91-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:47:52.194413 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:52.194383    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8"
Jul 24 17:47:52.194783 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:52.194413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8" event={"ID":"070a0a4e-c277-4871-96b7-ddf83a8d9e91","Type":"ContainerDied","Data":"8a730df367149cc214dde704883d05cddf7699bf7f9f5ab3d5049da72d1b7678"}
Jul 24 17:47:52.194783 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:52.194468    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a730df367149cc214dde704883d05cddf7699bf7f9f5ab3d5049da72d1b7678"
Jul 24 17:47:52.196442 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:52.196416    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4" event={"ID":"a203e3b0-b718-4dd2-899c-fe03c0fa56fa","Type":"ContainerDied","Data":"3d975d68038965ab4b96a8938f708797008ff2bcaca6a0d183508df4feab6272"}
Jul 24 17:47:52.196567 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:52.196457    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d975d68038965ab4b96a8938f708797008ff2bcaca6a0d183508df4feab6272"
Jul 24 17:47:52.196567 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:52.196408    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4"
Jul 24 17:47:57.319218 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319181    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"]
Jul 24 17:47:57.319709 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319690    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="pull"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319712    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="pull"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319729    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="util"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319737    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="util"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319748    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="extract"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319756    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="extract"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319764    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="extract"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319772    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="extract"
Jul 24 17:47:57.319799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319801    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="pull"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319810    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="pull"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319837    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="util"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319845    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="util"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319854    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319861    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319878    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="util"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319886    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="util"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319902    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="pull"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319911    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="pull"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319922    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="util"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319930    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="util"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319942    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319951    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319965    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="pull"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.319973    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="pull"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.320088    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="070a0a4e-c277-4871-96b7-ddf83a8d9e91" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.320101    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7209ce0b-7bbc-4613-88ed-3270bd4a159b" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.320111    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0f3f4d-bf78-40e7-b787-8b8028693880" containerName="extract"
Jul 24 17:47:57.320239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.320122    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a203e3b0-b718-4dd2-899c-fe03c0fa56fa" containerName="extract"
Jul 24 17:47:57.324614 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.324596    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:47:57.330948 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.330926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-grk2p\""
Jul 24 17:47:57.350330 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.350308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"]
Jul 24 17:47:57.463038 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.463001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd45s\" (UniqueName: \"kubernetes.io/projected/27394099-df24-4c6c-959e-bdd64196a1e5-kube-api-access-hd45s\") pod \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" (UID: \"27394099-df24-4c6c-959e-bdd64196a1e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:47:57.564296 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.564263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd45s\" (UniqueName: \"kubernetes.io/projected/27394099-df24-4c6c-959e-bdd64196a1e5-kube-api-access-hd45s\") pod \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" (UID: \"27394099-df24-4c6c-959e-bdd64196a1e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:47:57.586589 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.586522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd45s\" (UniqueName: \"kubernetes.io/projected/27394099-df24-4c6c-959e-bdd64196a1e5-kube-api-access-hd45s\") pod \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" (UID: \"27394099-df24-4c6c-959e-bdd64196a1e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:47:57.634069 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.634040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:47:57.776785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:57.776756    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"]
Jul 24 17:47:57.780116 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:57.780089    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27394099_df24_4c6c_959e_bdd64196a1e5.slice/crio-623fa76befa7fbd3d1a56e210887d8e1aede7eaff7ad1a0ce38e4abd02bd25ca WatchSource:0}: Error finding container 623fa76befa7fbd3d1a56e210887d8e1aede7eaff7ad1a0ce38e4abd02bd25ca: Status 404 returned error can't find the container with id 623fa76befa7fbd3d1a56e210887d8e1aede7eaff7ad1a0ce38e4abd02bd25ca
Jul 24 17:47:58.227208 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:58.227177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n" event={"ID":"27394099-df24-4c6c-959e-bdd64196a1e5","Type":"ContainerStarted","Data":"623fa76befa7fbd3d1a56e210887d8e1aede7eaff7ad1a0ce38e4abd02bd25ca"}
Jul 24 17:47:59.234526 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.234490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n" event={"ID":"27394099-df24-4c6c-959e-bdd64196a1e5","Type":"ContainerStarted","Data":"31e490e3d7ed62962410cbf5e0ff54256b48c00c1ce139ae58abfc894a833139"}
Jul 24 17:47:59.234868 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.234575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:47:59.279753 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.279704    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n" podStartSLOduration=1.020004923 podStartE2EDuration="2.2796887s" totalImagesPullingTime="1.259683777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:47:59.277950796 +0000 UTC m=+678.310331152" watchObservedRunningTime="2026-07-24 17:47:59.2796887 +0000 UTC m=+678.312069103"
Jul 24 17:47:59.396741 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.396710    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58b8c994-vqg99"]
Jul 24 17:47:59.400288 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.400269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.414796 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.414774    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b8c994-vqg99"]
Jul 24 17:47:59.482449 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-trusted-ca-bundle\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.482598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwv8\" (UniqueName: \"kubernetes.io/projected/ca98dde1-5ffc-4636-9578-e7098dc7ae56-kube-api-access-5lwv8\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.482598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-config\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.482598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-service-ca\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.482598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-serving-cert\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.482598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-oauth-config\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.482773 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.482632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-oauth-serving-cert\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.583895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.583853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-trusted-ca-bundle\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.583895 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.583898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwv8\" (UniqueName: \"kubernetes.io/projected/ca98dde1-5ffc-4636-9578-e7098dc7ae56-kube-api-access-5lwv8\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.584157 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-config\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.584157 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-service-ca\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.584157 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-serving-cert\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.584310 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-oauth-config\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.584363 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-oauth-serving-cert\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.584803 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-config\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.585156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-service-ca\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.585156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584850    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-trusted-ca-bundle\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.585156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.584927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca98dde1-5ffc-4636-9578-e7098dc7ae56-oauth-serving-cert\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.586558 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.586537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-serving-cert\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.586558 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.586548    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca98dde1-5ffc-4636-9578-e7098dc7ae56-console-oauth-config\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.593998 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.593976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwv8\" (UniqueName: \"kubernetes.io/projected/ca98dde1-5ffc-4636-9578-e7098dc7ae56-kube-api-access-5lwv8\") pod \"console-58b8c994-vqg99\" (UID: \"ca98dde1-5ffc-4636-9578-e7098dc7ae56\") " pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.710154 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.710073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:47:59.884282 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:47:59.884258    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b8c994-vqg99"]
Jul 24 17:47:59.885855 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:47:59.885828    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca98dde1_5ffc_4636_9578_e7098dc7ae56.slice/crio-42dacf27b338a9b27b67ecbfec02217807a508809ce2671a4d7fe101d838fa57 WatchSource:0}: Error finding container 42dacf27b338a9b27b67ecbfec02217807a508809ce2671a4d7fe101d838fa57: Status 404 returned error can't find the container with id 42dacf27b338a9b27b67ecbfec02217807a508809ce2671a4d7fe101d838fa57
Jul 24 17:48:00.242705 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:00.242659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b8c994-vqg99" event={"ID":"ca98dde1-5ffc-4636-9578-e7098dc7ae56","Type":"ContainerStarted","Data":"4bf39dc0c37c4c8e25dbc38dedef9d2157a3ff59d63e858d64fb6184b482f5ed"}
Jul 24 17:48:00.243101 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:00.242722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b8c994-vqg99" event={"ID":"ca98dde1-5ffc-4636-9578-e7098dc7ae56","Type":"ContainerStarted","Data":"42dacf27b338a9b27b67ecbfec02217807a508809ce2671a4d7fe101d838fa57"}
Jul 24 17:48:00.280253 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:00.280197    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58b8c994-vqg99" podStartSLOduration=1.280180177 podStartE2EDuration="1.280180177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:00.27736691 +0000 UTC m=+679.309747279" watchObservedRunningTime="2026-07-24 17:48:00.280180177 +0000 UTC m=+679.312560534"
Jul 24 17:48:01.440859 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.440817    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"]
Jul 24 17:48:01.446055 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.446017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:01.449410 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.449392    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k55z2\""
Jul 24 17:48:01.460961 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.460937    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"]
Jul 24 17:48:01.500990 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.500958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-str8m\" (UniqueName: \"kubernetes.io/projected/d3ead26a-5893-4742-909d-7dbe33c7e92d-kube-api-access-str8m\") pod \"authorino-operator-75cc8d5cb7-rq2lm\" (UID: \"d3ead26a-5893-4742-909d-7dbe33c7e92d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:01.602272 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.602233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-str8m\" (UniqueName: \"kubernetes.io/projected/d3ead26a-5893-4742-909d-7dbe33c7e92d-kube-api-access-str8m\") pod \"authorino-operator-75cc8d5cb7-rq2lm\" (UID: \"d3ead26a-5893-4742-909d-7dbe33c7e92d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:01.616855 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.616823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-str8m\" (UniqueName: \"kubernetes.io/projected/d3ead26a-5893-4742-909d-7dbe33c7e92d-kube-api-access-str8m\") pod \"authorino-operator-75cc8d5cb7-rq2lm\" (UID: \"d3ead26a-5893-4742-909d-7dbe33c7e92d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:01.757133 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.757050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:01.929827 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:01.929787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"]
Jul 24 17:48:01.934308 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:48:01.934281    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ead26a_5893_4742_909d_7dbe33c7e92d.slice/crio-47a76679d5addd8018f75286a98fe80dfc335b34552bca9d5c3a1200f80bb0e8 WatchSource:0}: Error finding container 47a76679d5addd8018f75286a98fe80dfc335b34552bca9d5c3a1200f80bb0e8: Status 404 returned error can't find the container with id 47a76679d5addd8018f75286a98fe80dfc335b34552bca9d5c3a1200f80bb0e8
Jul 24 17:48:02.253393 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:02.253357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm" event={"ID":"d3ead26a-5893-4742-909d-7dbe33c7e92d","Type":"ContainerStarted","Data":"47a76679d5addd8018f75286a98fe80dfc335b34552bca9d5c3a1200f80bb0e8"}
Jul 24 17:48:04.267753 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:04.267714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm" event={"ID":"d3ead26a-5893-4742-909d-7dbe33c7e92d","Type":"ContainerStarted","Data":"a6c1a0ab6b408ba609c1f7d054f92684e6052e471c10255c1acc762b3792d353"}
Jul 24 17:48:04.268173 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:04.267884    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:04.297682 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:04.297638    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm" podStartSLOduration=1.164177971 podStartE2EDuration="3.297623576s" totalImagesPullingTime="2.133445605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:04.295228957 +0000 UTC m=+683.327609314" watchObservedRunningTime="2026-07-24 17:48:04.297623576 +0000 UTC m=+683.330004002"
Jul 24 17:48:06.374442 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.374408    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"]
Jul 24 17:48:06.377904 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.377887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.381448 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.381433    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hl7tc\""
Jul 24 17:48:06.394041 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.393994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"]
Jul 24 17:48:06.450721 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.450690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt95r\" (UniqueName: \"kubernetes.io/projected/4e297230-3f6a-41f9-8865-228a800dd6a7-kube-api-access-qt95r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.450882 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.450794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e297230-3f6a-41f9-8865-228a800dd6a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.552088 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.552055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt95r\" (UniqueName: \"kubernetes.io/projected/4e297230-3f6a-41f9-8865-228a800dd6a7-kube-api-access-qt95r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.552281 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.552129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e297230-3f6a-41f9-8865-228a800dd6a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.552506 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.552483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e297230-3f6a-41f9-8865-228a800dd6a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.560429 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.560402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt95r\" (UniqueName: \"kubernetes.io/projected/4e297230-3f6a-41f9-8865-228a800dd6a7-kube-api-access-qt95r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.686965 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.686932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:06.852529 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:06.852502    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"]
Jul 24 17:48:06.853874 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:48:06.853850    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e297230_3f6a_41f9_8865_228a800dd6a7.slice/crio-599ea656f97be10a7212255666db0012378e642aa878c44f0324c0a1a0ddc0a7 WatchSource:0}: Error finding container 599ea656f97be10a7212255666db0012378e642aa878c44f0324c0a1a0ddc0a7: Status 404 returned error can't find the container with id 599ea656f97be10a7212255666db0012378e642aa878c44f0324c0a1a0ddc0a7
Jul 24 17:48:07.287677 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:07.287645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j" event={"ID":"4e297230-3f6a-41f9-8865-228a800dd6a7","Type":"ContainerStarted","Data":"599ea656f97be10a7212255666db0012378e642aa878c44f0324c0a1a0ddc0a7"}
Jul 24 17:48:09.710798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:09.710756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:48:09.711234 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:09.710834    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:48:09.716613 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:09.716553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:48:10.245135 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:10.245096    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:10.313143 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:10.313102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58b8c994-vqg99"
Jul 24 17:48:10.366507 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:10.366474    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559ccfbd59-jpctr"]
Jul 24 17:48:11.315429 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:11.315390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j" event={"ID":"4e297230-3f6a-41f9-8865-228a800dd6a7","Type":"ContainerStarted","Data":"47cd18c4e6d56cc3d7dbf3b3783afa22af62bd06ae1c3d62875f0cec44a78a7d"}
Jul 24 17:48:11.336734 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:11.336681    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j" podStartSLOduration=1.427294684 podStartE2EDuration="5.336663612s" totalImagesPullingTime="3.909368928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:11.334126035 +0000 UTC m=+690.366506384" watchObservedRunningTime="2026-07-24 17:48:11.336663612 +0000 UTC m=+690.369043970"
Jul 24 17:48:12.321192 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:12.321159    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:15.275794 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:15.275755    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rq2lm"
Jul 24 17:48:23.328905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:23.328871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:24.582132 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.582095    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"]
Jul 24 17:48:24.586872 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.586856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.598777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.598750    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"]
Jul 24 17:48:24.630183 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.630155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhdnt\" (UniqueName: \"kubernetes.io/projected/4e5d2781-cf29-4827-a678-b2d47ba6d610-kube-api-access-jhdnt\") pod \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.630333 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.630273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5d2781-cf29-4827-a678-b2d47ba6d610-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.731529 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.731497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5d2781-cf29-4827-a678-b2d47ba6d610-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.731529 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.731542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhdnt\" (UniqueName: \"kubernetes.io/projected/4e5d2781-cf29-4827-a678-b2d47ba6d610-kube-api-access-jhdnt\") pod \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.731905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.731885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5d2781-cf29-4827-a678-b2d47ba6d610-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.740693 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.740666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhdnt\" (UniqueName: \"kubernetes.io/projected/4e5d2781-cf29-4827-a678-b2d47ba6d610-kube-api-access-jhdnt\") pod \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:24.896576 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:24.896543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:25.030010 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.029981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"]
Jul 24 17:48:25.032097 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:48:25.032055    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5d2781_cf29_4827_a678_b2d47ba6d610.slice/crio-7b959fb330ff157525bcc3f5eefeb6c9af3a0a4679723ca9b5cca8c752f7f186 WatchSource:0}: Error finding container 7b959fb330ff157525bcc3f5eefeb6c9af3a0a4679723ca9b5cca8c752f7f186: Status 404 returned error can't find the container with id 7b959fb330ff157525bcc3f5eefeb6c9af3a0a4679723ca9b5cca8c752f7f186
Jul 24 17:48:25.162908 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.162820    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"]
Jul 24 17:48:25.168802 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.168764    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"]
Jul 24 17:48:25.182242 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.182217    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"]
Jul 24 17:48:25.182475 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.182428    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" containerName="manager" containerID="cri-o://47cd18c4e6d56cc3d7dbf3b3783afa22af62bd06ae1c3d62875f0cec44a78a7d" gracePeriod=2
Jul 24 17:48:25.189101 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.189071    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"]
Jul 24 17:48:25.191219 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.189869    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" containerName="manager"
Jul 24 17:48:25.191219 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.189893    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" containerName="manager"
Jul 24 17:48:25.191219 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.190067    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" containerName="manager"
Jul 24 17:48:25.193681 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.193656    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"]
Jul 24 17:48:25.193774 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.193761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.195989 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.195960    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:25.201161 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.201108    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"]
Jul 24 17:48:25.201760 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.201359    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" containerName="manager" containerID="cri-o://31e490e3d7ed62962410cbf5e0ff54256b48c00c1ce139ae58abfc894a833139" gracePeriod=2
Jul 24 17:48:25.206897 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.206543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"]
Jul 24 17:48:25.210080 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.210059    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"]
Jul 24 17:48:25.213402 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.213379    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"]
Jul 24 17:48:25.213935 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.213918    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" containerName="manager"
Jul 24 17:48:25.214016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.213937    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" containerName="manager"
Jul 24 17:48:25.214016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.213950    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" containerName="manager"
Jul 24 17:48:25.214016 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.213959    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" containerName="manager"
Jul 24 17:48:25.214192 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.214077    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" containerName="manager"
Jul 24 17:48:25.214192 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.214091    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" containerName="manager"
Jul 24 17:48:25.219300 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.219280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.226401 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.226370    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:25.228562 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.228529    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:25.235431 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.235400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2mr7\" (UniqueName: \"kubernetes.io/projected/b3b60ca4-c963-43e0-aa0a-b0006993fe87-kube-api-access-v2mr7\") pod \"kuadrant-operator-controller-manager-55467d9f7-5vcwk\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.235552 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.235454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxzrg\" (UniqueName: \"kubernetes.io/projected/a5f91469-7ed8-42ad-abad-4c7fadee79cb-kube-api-access-gxzrg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmpr5\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.235628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.235594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f91469-7ed8-42ad-abad-4c7fadee79cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmpr5\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.235722 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.235649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3b60ca4-c963-43e0-aa0a-b0006993fe87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5vcwk\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.237451 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.237428    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"]
Jul 24 17:48:25.336923 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.336890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3b60ca4-c963-43e0-aa0a-b0006993fe87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5vcwk\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.337122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.336930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2mr7\" (UniqueName: \"kubernetes.io/projected/b3b60ca4-c963-43e0-aa0a-b0006993fe87-kube-api-access-v2mr7\") pod \"kuadrant-operator-controller-manager-55467d9f7-5vcwk\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.337122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.336956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxzrg\" (UniqueName: \"kubernetes.io/projected/a5f91469-7ed8-42ad-abad-4c7fadee79cb-kube-api-access-gxzrg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmpr5\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.337122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.337093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f91469-7ed8-42ad-abad-4c7fadee79cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmpr5\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.337289 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.337261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3b60ca4-c963-43e0-aa0a-b0006993fe87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5vcwk\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.337525 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.337507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f91469-7ed8-42ad-abad-4c7fadee79cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmpr5\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.346711 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.346683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2mr7\" (UniqueName: \"kubernetes.io/projected/b3b60ca4-c963-43e0-aa0a-b0006993fe87-kube-api-access-v2mr7\") pod \"kuadrant-operator-controller-manager-55467d9f7-5vcwk\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.346856 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.346785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxzrg\" (UniqueName: \"kubernetes.io/projected/a5f91469-7ed8-42ad-abad-4c7fadee79cb-kube-api-access-gxzrg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmpr5\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.395020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.394991    2564 generic.go:356] "Generic (PLEG): container finished" podID="4e297230-3f6a-41f9-8865-228a800dd6a7" containerID="47cd18c4e6d56cc3d7dbf3b3783afa22af62bd06ae1c3d62875f0cec44a78a7d" exitCode=0
Jul 24 17:48:25.397293 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.397274    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8" container="manager"
Jul 24 17:48:25.399138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.399110    2564 generic.go:356] "Generic (PLEG): container finished" podID="27394099-df24-4c6c-959e-bdd64196a1e5" containerID="31e490e3d7ed62962410cbf5e0ff54256b48c00c1ce139ae58abfc894a833139" exitCode=0
Jul 24 17:48:25.399507 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.399482    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:25.401461 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.401432    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:25.403408 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.403388    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:25.430731 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.430701    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:25.433079 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.433012    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:25.434834 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.434813    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:25.436527 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.436501    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:25.459368 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.459346    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:25.461718 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.461692    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q4d7j\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:25.463686 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.463666    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:25.465504 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:25.465483    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qw2n\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:25.538244 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.538220    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e297230-3f6a-41f9-8865-228a800dd6a7-extensions-socket-volume\") pod \"4e297230-3f6a-41f9-8865-228a800dd6a7\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") "
Jul 24 17:48:25.538355 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.538274    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt95r\" (UniqueName: \"kubernetes.io/projected/4e297230-3f6a-41f9-8865-228a800dd6a7-kube-api-access-qt95r\") pod \"4e297230-3f6a-41f9-8865-228a800dd6a7\" (UID: \"4e297230-3f6a-41f9-8865-228a800dd6a7\") "
Jul 24 17:48:25.538355 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.538326    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd45s\" (UniqueName: \"kubernetes.io/projected/27394099-df24-4c6c-959e-bdd64196a1e5-kube-api-access-hd45s\") pod \"27394099-df24-4c6c-959e-bdd64196a1e5\" (UID: \"27394099-df24-4c6c-959e-bdd64196a1e5\") "
Jul 24 17:48:25.538697 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.538672    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e297230-3f6a-41f9-8865-228a800dd6a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e297230-3f6a-41f9-8865-228a800dd6a7" (UID: "4e297230-3f6a-41f9-8865-228a800dd6a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:25.540299 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.540278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27394099-df24-4c6c-959e-bdd64196a1e5-kube-api-access-hd45s" (OuterVolumeSpecName: "kube-api-access-hd45s") pod "27394099-df24-4c6c-959e-bdd64196a1e5" (UID: "27394099-df24-4c6c-959e-bdd64196a1e5"). InnerVolumeSpecName "kube-api-access-hd45s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:25.540378 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.540320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e297230-3f6a-41f9-8865-228a800dd6a7-kube-api-access-qt95r" (OuterVolumeSpecName: "kube-api-access-qt95r") pod "4e297230-3f6a-41f9-8865-228a800dd6a7" (UID: "4e297230-3f6a-41f9-8865-228a800dd6a7"). InnerVolumeSpecName "kube-api-access-qt95r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:25.610552 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.610521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:25.618503 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.618481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:25.639967 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.639937    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd45s\" (UniqueName: \"kubernetes.io/projected/27394099-df24-4c6c-959e-bdd64196a1e5-kube-api-access-hd45s\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:25.639967 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.639967    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e297230-3f6a-41f9-8865-228a800dd6a7-extensions-socket-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:25.640176 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.639979    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt95r\" (UniqueName: \"kubernetes.io/projected/4e297230-3f6a-41f9-8865-228a800dd6a7-kube-api-access-qt95r\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:25.770405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.770378    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"]
Jul 24 17:48:25.771190 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:48:25.771166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b60ca4_c963_43e0_aa0a_b0006993fe87.slice/crio-5a1805ee3d0b1a6b2fec6d30bd288148468b53d283efbf2dce8206633396a21c WatchSource:0}: Error finding container 5a1805ee3d0b1a6b2fec6d30bd288148468b53d283efbf2dce8206633396a21c: Status 404 returned error can't find the container with id 5a1805ee3d0b1a6b2fec6d30bd288148468b53d283efbf2dce8206633396a21c
Jul 24 17:48:25.816896 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:25.816869    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"]
Jul 24 17:48:26.407310 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.407282    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qw2n"
Jul 24 17:48:26.407310 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.407295    2564 scope.go:117] "RemoveContainer" containerID="31e490e3d7ed62962410cbf5e0ff54256b48c00c1ce139ae58abfc894a833139"
Jul 24 17:48:26.409091 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.409064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk" event={"ID":"b3b60ca4-c963-43e0-aa0a-b0006993fe87","Type":"ContainerStarted","Data":"70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d"}
Jul 24 17:48:26.409231 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.409122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk" event={"ID":"b3b60ca4-c963-43e0-aa0a-b0006993fe87","Type":"ContainerStarted","Data":"5a1805ee3d0b1a6b2fec6d30bd288148468b53d283efbf2dce8206633396a21c"}
Jul 24 17:48:26.409727 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.409708    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:26.410910 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.410892    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4d7j"
Jul 24 17:48:26.412871 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.412823    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" containerName="manager" containerID="cri-o://85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37" gracePeriod=2
Jul 24 17:48:26.414893 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.414867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5" event={"ID":"a5f91469-7ed8-42ad-abad-4c7fadee79cb","Type":"ContainerStarted","Data":"bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034"}
Jul 24 17:48:26.415001 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.414912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5" event={"ID":"a5f91469-7ed8-42ad-abad-4c7fadee79cb","Type":"ContainerStarted","Data":"c86fe15085830ebe2ae6e68a9cf8d7ca641d5e1ce52aabe2aea530a438e97b9c"}
Jul 24 17:48:26.415092 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.415051    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:26.417713 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.417693    2564 scope.go:117] "RemoveContainer" containerID="47cd18c4e6d56cc3d7dbf3b3783afa22af62bd06ae1c3d62875f0cec44a78a7d"
Jul 24 17:48:26.433804 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.433765    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk" podStartSLOduration=1.433750549 podStartE2EDuration="1.433750549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:26.432626155 +0000 UTC m=+705.465006513" watchObservedRunningTime="2026-07-24 17:48:26.433750549 +0000 UTC m=+705.466130905"
Jul 24 17:48:26.454654 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.454611    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5" podStartSLOduration=1.454598103 podStartE2EDuration="1.454598103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:26.45319567 +0000 UTC m=+705.485576028" watchObservedRunningTime="2026-07-24 17:48:26.454598103 +0000 UTC m=+705.486978459"
Jul 24 17:48:26.646065 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.646040    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:26.648564 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:26.648534    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:26.751604 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.751575    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5d2781-cf29-4827-a678-b2d47ba6d610-extensions-socket-volume\") pod \"4e5d2781-cf29-4827-a678-b2d47ba6d610\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") "
Jul 24 17:48:26.751730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.751672    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhdnt\" (UniqueName: \"kubernetes.io/projected/4e5d2781-cf29-4827-a678-b2d47ba6d610-kube-api-access-jhdnt\") pod \"4e5d2781-cf29-4827-a678-b2d47ba6d610\" (UID: \"4e5d2781-cf29-4827-a678-b2d47ba6d610\") "
Jul 24 17:48:26.751890 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.751863    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5d2781-cf29-4827-a678-b2d47ba6d610-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e5d2781-cf29-4827-a678-b2d47ba6d610" (UID: "4e5d2781-cf29-4827-a678-b2d47ba6d610"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:26.753624 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.753604    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5d2781-cf29-4827-a678-b2d47ba6d610-kube-api-access-jhdnt" (OuterVolumeSpecName: "kube-api-access-jhdnt") pod "4e5d2781-cf29-4827-a678-b2d47ba6d610" (UID: "4e5d2781-cf29-4827-a678-b2d47ba6d610"). InnerVolumeSpecName "kube-api-access-jhdnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:26.852808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.852770    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5d2781-cf29-4827-a678-b2d47ba6d610-extensions-socket-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:26.852808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:26.852798    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhdnt\" (UniqueName: \"kubernetes.io/projected/4e5d2781-cf29-4827-a678-b2d47ba6d610-kube-api-access-jhdnt\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:27.423257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.423223    2564 generic.go:356] "Generic (PLEG): container finished" podID="4e5d2781-cf29-4827-a678-b2d47ba6d610" containerID="85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37" exitCode=2
Jul 24 17:48:27.423431 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.423264    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:27.423431 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.423312    2564 scope.go:117] "RemoveContainer" containerID="85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37"
Jul 24 17:48:27.426659 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:27.426633    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:27.432899 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.432880    2564 scope.go:117] "RemoveContainer" containerID="85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37"
Jul 24 17:48:27.433203 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:27.433185    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37\": container with ID starting with 85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37 not found: ID does not exist" containerID="85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37"
Jul 24 17:48:27.433240 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.433212    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37"} err="failed to get container status \"85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37\": rpc error: code = NotFound desc = could not find container \"85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37\": container with ID starting with 85fe2b6d630ddba6784ff3ec43a9b650da84a3db8c11aadf4b6716ef7d1e7f37 not found: ID does not exist"
Jul 24 17:48:27.433662 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:27.433643    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-qngb8\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qngb8"
Jul 24 17:48:27.459666 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.459641    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27394099-df24-4c6c-959e-bdd64196a1e5" path="/var/lib/kubelet/pods/27394099-df24-4c6c-959e-bdd64196a1e5/volumes"
Jul 24 17:48:27.460001 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.459987    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e297230-3f6a-41f9-8865-228a800dd6a7" path="/var/lib/kubelet/pods/4e297230-3f6a-41f9-8865-228a800dd6a7/volumes"
Jul 24 17:48:27.460348 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:27.460335    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e5d2781-cf29-4827-a678-b2d47ba6d610" path="/var/lib/kubelet/pods/4e5d2781-cf29-4827-a678-b2d47ba6d610/volumes"
Jul 24 17:48:35.387755 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.387631    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559ccfbd59-jpctr" podUID="8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" containerName="console" containerID="cri-o://6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6" gracePeriod=15
Jul 24 17:48:35.664130 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.664102    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:48:35.735753 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrd2n\" (UniqueName: \"kubernetes.io/projected/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-kube-api-access-qrd2n\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.735928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735778    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-serving-cert\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.735928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-oauth-serving-cert\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.735928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-trusted-ca-bundle\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.735928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735879    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-oauth-config\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.735928 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-service-ca\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.736227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.735945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-config\") pod \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\" (UID: \"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9\") "
Jul 24 17:48:35.736392 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.736305    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:48:35.736479 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.736418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:48:35.736479 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.736460    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-config" (OuterVolumeSpecName: "console-config") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:48:35.736671 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.736648    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:48:35.737970 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.737940    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-kube-api-access-qrd2n" (OuterVolumeSpecName: "kube-api-access-qrd2n") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "kube-api-access-qrd2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:35.738145 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.737981    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:48:35.738145 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.738056    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" (UID: "8b7ed4cc-0ca5-40d2-820a-f875e804d5c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:48:35.836949 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836919    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:35.836949 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836945    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:35.836949 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836954    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrd2n\" (UniqueName: \"kubernetes.io/projected/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-kube-api-access-qrd2n\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:35.837246 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836963    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:35.837246 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836972    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-oauth-serving-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:35.837246 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836980    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-trusted-ca-bundle\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:35.837246 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:35.836988    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9-console-oauth-config\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:36.483722 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.483689    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" containerID="6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6" exitCode=0
Jul 24 17:48:36.484227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.483737    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559ccfbd59-jpctr"
Jul 24 17:48:36.484227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.483781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559ccfbd59-jpctr" event={"ID":"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9","Type":"ContainerDied","Data":"6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6"}
Jul 24 17:48:36.484227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.483851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559ccfbd59-jpctr" event={"ID":"8b7ed4cc-0ca5-40d2-820a-f875e804d5c9","Type":"ContainerDied","Data":"a422f0e323496f00eb7112d3e5012e369ad9a51ffcb5606bc02d3416e129e973"}
Jul 24 17:48:36.484227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.483885    2564 scope.go:117] "RemoveContainer" containerID="6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6"
Jul 24 17:48:36.494365 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.494348    2564 scope.go:117] "RemoveContainer" containerID="6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6"
Jul 24 17:48:36.494677 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:36.494659    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6\": container with ID starting with 6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6 not found: ID does not exist" containerID="6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6"
Jul 24 17:48:36.494745 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.494689    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6"} err="failed to get container status \"6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6\": rpc error: code = NotFound desc = could not find container \"6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6\": container with ID starting with 6291b4fd1a34c11139b296d447d48c86db1ed52a72a9d8b1adbe712271d00ba6 not found: ID does not exist"
Jul 24 17:48:36.509320 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.509292    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559ccfbd59-jpctr"]
Jul 24 17:48:36.513012 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:36.512987    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559ccfbd59-jpctr"]
Jul 24 17:48:37.425691 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:37.425663    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:37.461142 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:37.461114    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" path="/var/lib/kubelet/pods/8b7ed4cc-0ca5-40d2-820a-f875e804d5c9/volumes"
Jul 24 17:48:38.432819 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.432788    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:38.486932 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.486900    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"]
Jul 24 17:48:38.487126 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.487094    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5" podUID="a5f91469-7ed8-42ad-abad-4c7fadee79cb" containerName="manager" containerID="cri-o://bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034" gracePeriod=10
Jul 24 17:48:38.743921 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.743898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:38.828369 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828334    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"]
Jul 24 17:48:38.828744 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828731    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f91469-7ed8-42ad-abad-4c7fadee79cb" containerName="manager"
Jul 24 17:48:38.828785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828745    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f91469-7ed8-42ad-abad-4c7fadee79cb" containerName="manager"
Jul 24 17:48:38.828785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828762    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" containerName="console"
Jul 24 17:48:38.828785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828767    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" containerName="console"
Jul 24 17:48:38.828883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828831    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f91469-7ed8-42ad-abad-4c7fadee79cb" containerName="manager"
Jul 24 17:48:38.828883 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.828841    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7ed4cc-0ca5-40d2-820a-f875e804d5c9" containerName="console"
Jul 24 17:48:38.833060 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.833015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:38.843686 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.843662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"]
Jul 24 17:48:38.866419 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.866387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxzrg\" (UniqueName: \"kubernetes.io/projected/a5f91469-7ed8-42ad-abad-4c7fadee79cb-kube-api-access-gxzrg\") pod \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") "
Jul 24 17:48:38.866620 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.866514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f91469-7ed8-42ad-abad-4c7fadee79cb-extensions-socket-volume\") pod \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\" (UID: \"a5f91469-7ed8-42ad-abad-4c7fadee79cb\") "
Jul 24 17:48:38.866894 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.866871    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f91469-7ed8-42ad-abad-4c7fadee79cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a5f91469-7ed8-42ad-abad-4c7fadee79cb" (UID: "a5f91469-7ed8-42ad-abad-4c7fadee79cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:38.868692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.868660    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f91469-7ed8-42ad-abad-4c7fadee79cb-kube-api-access-gxzrg" (OuterVolumeSpecName: "kube-api-access-gxzrg") pod "a5f91469-7ed8-42ad-abad-4c7fadee79cb" (UID: "a5f91469-7ed8-42ad-abad-4c7fadee79cb"). InnerVolumeSpecName "kube-api-access-gxzrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:38.967996 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.967957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ab6486-8552-4fe9-8e97-3b4491d68296-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6m55f\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:38.968185 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.968005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxcqx\" (UniqueName: \"kubernetes.io/projected/e2ab6486-8552-4fe9-8e97-3b4491d68296-kube-api-access-jxcqx\") pod \"kuadrant-operator-controller-manager-86878c769f-6m55f\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:38.968185 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.968107    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5f91469-7ed8-42ad-abad-4c7fadee79cb-extensions-socket-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:38.968185 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:38.968118    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxzrg\" (UniqueName: \"kubernetes.io/projected/a5f91469-7ed8-42ad-abad-4c7fadee79cb-kube-api-access-gxzrg\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:39.068968 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.068882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ab6486-8552-4fe9-8e97-3b4491d68296-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6m55f\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:39.068968 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.068928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxcqx\" (UniqueName: \"kubernetes.io/projected/e2ab6486-8552-4fe9-8e97-3b4491d68296-kube-api-access-jxcqx\") pod \"kuadrant-operator-controller-manager-86878c769f-6m55f\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:39.069304 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.069282    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ab6486-8552-4fe9-8e97-3b4491d68296-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6m55f\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:39.077575 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.077545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxcqx\" (UniqueName: \"kubernetes.io/projected/e2ab6486-8552-4fe9-8e97-3b4491d68296-kube-api-access-jxcqx\") pod \"kuadrant-operator-controller-manager-86878c769f-6m55f\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:39.143585 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.143551    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:39.284426 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.284403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"]
Jul 24 17:48:39.284965 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:48:39.284937    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ab6486_8552_4fe9_8e97_3b4491d68296.slice/crio-d906305fe8506ac391b9b3c10c834b4cf23577175db53e90ca0455c051f21fc3 WatchSource:0}: Error finding container d906305fe8506ac391b9b3c10c834b4cf23577175db53e90ca0455c051f21fc3: Status 404 returned error can't find the container with id d906305fe8506ac391b9b3c10c834b4cf23577175db53e90ca0455c051f21fc3
Jul 24 17:48:39.507250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.507213    2564 generic.go:356] "Generic (PLEG): container finished" podID="a5f91469-7ed8-42ad-abad-4c7fadee79cb" containerID="bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034" exitCode=0
Jul 24 17:48:39.507693 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.507274    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"
Jul 24 17:48:39.507693 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.507296    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5" event={"ID":"a5f91469-7ed8-42ad-abad-4c7fadee79cb","Type":"ContainerDied","Data":"bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034"}
Jul 24 17:48:39.507693 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.507355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5" event={"ID":"a5f91469-7ed8-42ad-abad-4c7fadee79cb","Type":"ContainerDied","Data":"c86fe15085830ebe2ae6e68a9cf8d7ca641d5e1ce52aabe2aea530a438e97b9c"}
Jul 24 17:48:39.507693 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.507384    2564 scope.go:117] "RemoveContainer" containerID="bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034"
Jul 24 17:48:39.509460 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.509432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f" event={"ID":"e2ab6486-8552-4fe9-8e97-3b4491d68296","Type":"ContainerStarted","Data":"b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0"}
Jul 24 17:48:39.509588 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.509488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f" event={"ID":"e2ab6486-8552-4fe9-8e97-3b4491d68296","Type":"ContainerStarted","Data":"d906305fe8506ac391b9b3c10c834b4cf23577175db53e90ca0455c051f21fc3"}
Jul 24 17:48:39.509588 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.509560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:39.519826 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.519808    2564 scope.go:117] "RemoveContainer" containerID="bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034"
Jul 24 17:48:39.520111 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:39.520089    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034\": container with ID starting with bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034 not found: ID does not exist" containerID="bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034"
Jul 24 17:48:39.520164 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.520121    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034"} err="failed to get container status \"bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034\": rpc error: code = NotFound desc = could not find container \"bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034\": container with ID starting with bd7b230ea6dfc7270d67b9fd58bf12a344b997e8d178ea3681d7c087163f6034 not found: ID does not exist"
Jul 24 17:48:39.530482 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.530432    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f" podStartSLOduration=1.5304173159999999 podStartE2EDuration="1.530417316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:39.52853584 +0000 UTC m=+718.560916198" watchObservedRunningTime="2026-07-24 17:48:39.530417316 +0000 UTC m=+718.562797673"
Jul 24 17:48:39.544755 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.544722    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"]
Jul 24 17:48:39.549227 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:39.549200    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmpr5"]
Jul 24 17:48:41.461703 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:41.461662    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f91469-7ed8-42ad-abad-4c7fadee79cb" path="/var/lib/kubelet/pods/a5f91469-7ed8-42ad-abad-4c7fadee79cb/volumes"
Jul 24 17:48:50.522051 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.521997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:48:50.577730 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.577688    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"]
Jul 24 17:48:50.578093 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.577999    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk" podUID="b3b60ca4-c963-43e0-aa0a-b0006993fe87" containerName="manager" containerID="cri-o://70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d" gracePeriod=10
Jul 24 17:48:50.836602 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.836575    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:50.975871 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.975832    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2mr7\" (UniqueName: \"kubernetes.io/projected/b3b60ca4-c963-43e0-aa0a-b0006993fe87-kube-api-access-v2mr7\") pod \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") "
Jul 24 17:48:50.976074 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.975909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3b60ca4-c963-43e0-aa0a-b0006993fe87-extensions-socket-volume\") pod \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\" (UID: \"b3b60ca4-c963-43e0-aa0a-b0006993fe87\") "
Jul 24 17:48:50.976284 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.976258    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b60ca4-c963-43e0-aa0a-b0006993fe87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b3b60ca4-c963-43e0-aa0a-b0006993fe87" (UID: "b3b60ca4-c963-43e0-aa0a-b0006993fe87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:50.977996 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:50.977975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b60ca4-c963-43e0-aa0a-b0006993fe87-kube-api-access-v2mr7" (OuterVolumeSpecName: "kube-api-access-v2mr7") pod "b3b60ca4-c963-43e0-aa0a-b0006993fe87" (UID: "b3b60ca4-c963-43e0-aa0a-b0006993fe87"). InnerVolumeSpecName "kube-api-access-v2mr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:51.077297 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.077210    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2mr7\" (UniqueName: \"kubernetes.io/projected/b3b60ca4-c963-43e0-aa0a-b0006993fe87-kube-api-access-v2mr7\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:51.077297 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.077240    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3b60ca4-c963-43e0-aa0a-b0006993fe87-extensions-socket-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:48:51.578572 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.578538    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3b60ca4-c963-43e0-aa0a-b0006993fe87" containerID="70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d" exitCode=0
Jul 24 17:48:51.578988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.578581    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"
Jul 24 17:48:51.578988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.578601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk" event={"ID":"b3b60ca4-c963-43e0-aa0a-b0006993fe87","Type":"ContainerDied","Data":"70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d"}
Jul 24 17:48:51.578988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.578653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk" event={"ID":"b3b60ca4-c963-43e0-aa0a-b0006993fe87","Type":"ContainerDied","Data":"5a1805ee3d0b1a6b2fec6d30bd288148468b53d283efbf2dce8206633396a21c"}
Jul 24 17:48:51.578988 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.578683    2564 scope.go:117] "RemoveContainer" containerID="70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d"
Jul 24 17:48:51.590230 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.590211    2564 scope.go:117] "RemoveContainer" containerID="70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d"
Jul 24 17:48:51.590500 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:48:51.590482    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d\": container with ID starting with 70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d not found: ID does not exist" containerID="70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d"
Jul 24 17:48:51.590566 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.590507    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d"} err="failed to get container status \"70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d\": rpc error: code = NotFound desc = could not find container \"70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d\": container with ID starting with 70d4ac922e4a7f7cfdb1acb4c378482728a166b25ab3e683bddb8d4740d2de1d not found: ID does not exist"
Jul 24 17:48:51.608001 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.607969    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"]
Jul 24 17:48:51.614655 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:51.614629    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5vcwk"]
Jul 24 17:48:53.460242 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:53.460211    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b60ca4-c963-43e0-aa0a-b0006993fe87" path="/var/lib/kubelet/pods/b3b60ca4-c963-43e0-aa0a-b0006993fe87/volumes"
Jul 24 17:48:54.852581 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.852545    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"]
Jul 24 17:48:54.852976 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.852962    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b60ca4-c963-43e0-aa0a-b0006993fe87" containerName="manager"
Jul 24 17:48:54.853046 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.852977    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b60ca4-c963-43e0-aa0a-b0006993fe87" containerName="manager"
Jul 24 17:48:54.853090 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.853052    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b60ca4-c963-43e0-aa0a-b0006993fe87" containerName="manager"
Jul 24 17:48:54.855448 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.855431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:54.857989 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.857971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pzht2\""
Jul 24 17:48:54.867962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:54.867939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"]
Jul 24 17:48:55.012786 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.012750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.012993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.012798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.012993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.012820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnv5\" (UniqueName: \"kubernetes.io/projected/861bb1fa-7cd8-4006-9a87-0351a1806588-kube-api-access-8jnv5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.012993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.012949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.013137 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.013009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.013137 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.013094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861bb1fa-7cd8-4006-9a87-0351a1806588-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.013137 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.013133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.013250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.013163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.013250 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.013194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.113773 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.113773 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.113773 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861bb1fa-7cd8-4006-9a87-0351a1806588-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.113773 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.113982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114122 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114317 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnv5\" (UniqueName: \"kubernetes.io/projected/861bb1fa-7cd8-4006-9a87-0351a1806588-kube-api-access-8jnv5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114317 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114317 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114434 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114475 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.114941 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.114918    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861bb1fa-7cd8-4006-9a87-0351a1806588-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.116306 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.116284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.116514 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.116494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.121664 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.121637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861bb1fa-7cd8-4006-9a87-0351a1806588-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.122216 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.122198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnv5\" (UniqueName: \"kubernetes.io/projected/861bb1fa-7cd8-4006-9a87-0351a1806588-kube-api-access-8jnv5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nc7ns\" (UID: \"861bb1fa-7cd8-4006-9a87-0351a1806588\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.166777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.166741    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:55.300677 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.300648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"]
Jul 24 17:48:55.302334 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:48:55.302308    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861bb1fa_7cd8_4006_9a87_0351a1806588.slice/crio-f76a8ebc751f418357865b28e2a78db675b3c45218245f6ab1659bd75c41fc27 WatchSource:0}: Error finding container f76a8ebc751f418357865b28e2a78db675b3c45218245f6ab1659bd75c41fc27: Status 404 returned error can't find the container with id f76a8ebc751f418357865b28e2a78db675b3c45218245f6ab1659bd75c41fc27
Jul 24 17:48:55.304446 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.304408    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:55.304558 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.304477    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:55.304558 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.304506    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:48:55.604839 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.604803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" event={"ID":"861bb1fa-7cd8-4006-9a87-0351a1806588","Type":"ContainerStarted","Data":"40e3fa47cccfd9fa9841d9b1a33ef633bba608751594dccbe1b8f2b17e7874f8"}
Jul 24 17:48:55.605058 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.604858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" event={"ID":"861bb1fa-7cd8-4006-9a87-0351a1806588","Type":"ContainerStarted","Data":"f76a8ebc751f418357865b28e2a78db675b3c45218245f6ab1659bd75c41fc27"}
Jul 24 17:48:55.626858 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:55.626756    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" podStartSLOduration=1.626740951 podStartE2EDuration="1.626740951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:55.624771155 +0000 UTC m=+734.657151513" watchObservedRunningTime="2026-07-24 17:48:55.626740951 +0000 UTC m=+734.659121308"
Jul 24 17:48:56.167574 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:56.167535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:56.172339 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:56.172317    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:56.611292 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:56.611202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:48:56.612305 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:48:56.612280    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:49:09.404771 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.404734    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:09.408269 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.408252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.412417 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.412390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 17:49:09.412528 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.412447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sd8r8\""
Jul 24 17:49:09.419813 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.419786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:09.433173 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.433141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpj47\" (UniqueName: \"kubernetes.io/projected/1af8c5f9-8fbb-476d-8d6d-6b407287c753-kube-api-access-lpj47\") pod \"limitador-limitador-64c94fd64f-ctm2b\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.433323 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.433201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1af8c5f9-8fbb-476d-8d6d-6b407287c753-config-file\") pod \"limitador-limitador-64c94fd64f-ctm2b\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.503756 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.503718    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:09.534436 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.534406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpj47\" (UniqueName: \"kubernetes.io/projected/1af8c5f9-8fbb-476d-8d6d-6b407287c753-kube-api-access-lpj47\") pod \"limitador-limitador-64c94fd64f-ctm2b\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.534616 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.534447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1af8c5f9-8fbb-476d-8d6d-6b407287c753-config-file\") pod \"limitador-limitador-64c94fd64f-ctm2b\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.535009 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.534988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1af8c5f9-8fbb-476d-8d6d-6b407287c753-config-file\") pod \"limitador-limitador-64c94fd64f-ctm2b\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.543369 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.543345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpj47\" (UniqueName: \"kubernetes.io/projected/1af8c5f9-8fbb-476d-8d6d-6b407287c753-kube-api-access-lpj47\") pod \"limitador-limitador-64c94fd64f-ctm2b\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.719006 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.718929    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:09.870309 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:09.870206    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:09.872815 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:09.872782    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af8c5f9_8fbb_476d_8d6d_6b407287c753.slice/crio-42ab0a899fd86ae83f9c6431973525ccb7b5ea0188d487d0ec70dcd5401e4fab WatchSource:0}: Error finding container 42ab0a899fd86ae83f9c6431973525ccb7b5ea0188d487d0ec70dcd5401e4fab: Status 404 returned error can't find the container with id 42ab0a899fd86ae83f9c6431973525ccb7b5ea0188d487d0ec70dcd5401e4fab
Jul 24 17:49:10.251190 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.251155    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2lbg5"]
Jul 24 17:49:10.256569 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.256546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:10.260265 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.260240    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v7nv2\""
Jul 24 17:49:10.263302 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.263274    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2lbg5"]
Jul 24 17:49:10.342650 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.342616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttbnl\" (UniqueName: \"kubernetes.io/projected/ed627501-4212-4c5c-a605-6b999159a76a-kube-api-access-ttbnl\") pod \"authorino-58cd955675-2lbg5\" (UID: \"ed627501-4212-4c5c-a605-6b999159a76a\") " pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:10.411583 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.411529    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9k7vv"]
Jul 24 17:49:10.416097 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.416072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:10.427536 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.426880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9k7vv"]
Jul 24 17:49:10.445216 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.445189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttbnl\" (UniqueName: \"kubernetes.io/projected/ed627501-4212-4c5c-a605-6b999159a76a-kube-api-access-ttbnl\") pod \"authorino-58cd955675-2lbg5\" (UID: \"ed627501-4212-4c5c-a605-6b999159a76a\") " pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:10.446177 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.446152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s4jv\" (UniqueName: \"kubernetes.io/projected/0ccbc661-47ca-43ae-8aae-636f4139f2f5-kube-api-access-2s4jv\") pod \"authorino-75d556bd77-9k7vv\" (UID: \"0ccbc661-47ca-43ae-8aae-636f4139f2f5\") " pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:10.456546 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.456502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttbnl\" (UniqueName: \"kubernetes.io/projected/ed627501-4212-4c5c-a605-6b999159a76a-kube-api-access-ttbnl\") pod \"authorino-58cd955675-2lbg5\" (UID: \"ed627501-4212-4c5c-a605-6b999159a76a\") " pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:10.547790 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.547674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4jv\" (UniqueName: \"kubernetes.io/projected/0ccbc661-47ca-43ae-8aae-636f4139f2f5-kube-api-access-2s4jv\") pod \"authorino-75d556bd77-9k7vv\" (UID: \"0ccbc661-47ca-43ae-8aae-636f4139f2f5\") " pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:10.560635 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.560602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4jv\" (UniqueName: \"kubernetes.io/projected/0ccbc661-47ca-43ae-8aae-636f4139f2f5-kube-api-access-2s4jv\") pod \"authorino-75d556bd77-9k7vv\" (UID: \"0ccbc661-47ca-43ae-8aae-636f4139f2f5\") " pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:10.567307 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.567277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:10.693330 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.693253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b" event={"ID":"1af8c5f9-8fbb-476d-8d6d-6b407287c753","Type":"ContainerStarted","Data":"42ab0a899fd86ae83f9c6431973525ccb7b5ea0188d487d0ec70dcd5401e4fab"}
Jul 24 17:49:10.736842 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.736813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:10.756780 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.756751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2lbg5"]
Jul 24 17:49:10.758752 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:10.758718    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded627501_4212_4c5c_a605_6b999159a76a.slice/crio-77460343fc07ce2fad2d483839b10a804bb0aea307fc509694fd55eb29272f53 WatchSource:0}: Error finding container 77460343fc07ce2fad2d483839b10a804bb0aea307fc509694fd55eb29272f53: Status 404 returned error can't find the container with id 77460343fc07ce2fad2d483839b10a804bb0aea307fc509694fd55eb29272f53
Jul 24 17:49:10.894962 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:10.894934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9k7vv"]
Jul 24 17:49:10.895857 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:10.895827    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ccbc661_47ca_43ae_8aae_636f4139f2f5.slice/crio-0e035e716963418e854f447d64aaebb454eb7679ebbe73d3449cd9c91d8b9c43 WatchSource:0}: Error finding container 0e035e716963418e854f447d64aaebb454eb7679ebbe73d3449cd9c91d8b9c43: Status 404 returned error can't find the container with id 0e035e716963418e854f447d64aaebb454eb7679ebbe73d3449cd9c91d8b9c43
Jul 24 17:49:11.700609 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:11.700569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2lbg5" event={"ID":"ed627501-4212-4c5c-a605-6b999159a76a","Type":"ContainerStarted","Data":"77460343fc07ce2fad2d483839b10a804bb0aea307fc509694fd55eb29272f53"}
Jul 24 17:49:11.701822 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:11.701795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9k7vv" event={"ID":"0ccbc661-47ca-43ae-8aae-636f4139f2f5","Type":"ContainerStarted","Data":"0e035e716963418e854f447d64aaebb454eb7679ebbe73d3449cd9c91d8b9c43"}
Jul 24 17:49:13.721573 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:13.721525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b" event={"ID":"1af8c5f9-8fbb-476d-8d6d-6b407287c753","Type":"ContainerStarted","Data":"d5b47f8c88200fc1a9d12b5240cb5934a81186b9eef106799b08f1553666583e"}
Jul 24 17:49:13.722052 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:13.721794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:13.742662 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:13.742609    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b" podStartSLOduration=1.824708041 podStartE2EDuration="4.742592765s" totalImagesPullingTime="2.917884724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:13.739951632 +0000 UTC m=+752.772331991" watchObservedRunningTime="2026-07-24 17:49:13.742592765 +0000 UTC m=+752.774973123"
Jul 24 17:49:15.735573 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:15.735537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2lbg5" event={"ID":"ed627501-4212-4c5c-a605-6b999159a76a","Type":"ContainerStarted","Data":"be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de"}
Jul 24 17:49:15.737146 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:15.737119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9k7vv" event={"ID":"0ccbc661-47ca-43ae-8aae-636f4139f2f5","Type":"ContainerStarted","Data":"85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb"}
Jul 24 17:49:15.754138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:15.754087    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2lbg5" podStartSLOduration=1.530858574 podStartE2EDuration="5.754072133s" totalImagesPullingTime="4.223213559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:15.752445122 +0000 UTC m=+754.784825482" watchObservedRunningTime="2026-07-24 17:49:15.754072133 +0000 UTC m=+754.786452491"
Jul 24 17:49:15.774858 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:15.774796    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9k7vv" podStartSLOduration=1.671754647 podStartE2EDuration="5.774774429s" totalImagesPullingTime="4.103019782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:15.772660055 +0000 UTC m=+754.805040414" watchObservedRunningTime="2026-07-24 17:49:15.774774429 +0000 UTC m=+754.807154790"
Jul 24 17:49:15.801269 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:15.801229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2lbg5"]
Jul 24 17:49:17.748802 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:17.748749    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2lbg5" podUID="ed627501-4212-4c5c-a605-6b999159a76a" containerName="authorino" containerID="cri-o://be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de" gracePeriod=30
Jul 24 17:49:18.002848 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.002785    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:18.122942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.122909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttbnl\" (UniqueName: \"kubernetes.io/projected/ed627501-4212-4c5c-a605-6b999159a76a-kube-api-access-ttbnl\") pod \"ed627501-4212-4c5c-a605-6b999159a76a\" (UID: \"ed627501-4212-4c5c-a605-6b999159a76a\") "
Jul 24 17:49:18.125098 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.125066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed627501-4212-4c5c-a605-6b999159a76a-kube-api-access-ttbnl" (OuterVolumeSpecName: "kube-api-access-ttbnl") pod "ed627501-4212-4c5c-a605-6b999159a76a" (UID: "ed627501-4212-4c5c-a605-6b999159a76a"). InnerVolumeSpecName "kube-api-access-ttbnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:49:18.223894 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.223846    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttbnl\" (UniqueName: \"kubernetes.io/projected/ed627501-4212-4c5c-a605-6b999159a76a-kube-api-access-ttbnl\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:49:18.756567 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.756528    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed627501-4212-4c5c-a605-6b999159a76a" containerID="be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de" exitCode=0
Jul 24 17:49:18.756567 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.756573    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2lbg5"
Jul 24 17:49:18.757096 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.756623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2lbg5" event={"ID":"ed627501-4212-4c5c-a605-6b999159a76a","Type":"ContainerDied","Data":"be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de"}
Jul 24 17:49:18.757096 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.756678    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2lbg5" event={"ID":"ed627501-4212-4c5c-a605-6b999159a76a","Type":"ContainerDied","Data":"77460343fc07ce2fad2d483839b10a804bb0aea307fc509694fd55eb29272f53"}
Jul 24 17:49:18.757096 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.756704    2564 scope.go:117] "RemoveContainer" containerID="be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de"
Jul 24 17:49:18.765909 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.765889    2564 scope.go:117] "RemoveContainer" containerID="be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de"
Jul 24 17:49:18.766237 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:49:18.766218    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de\": container with ID starting with be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de not found: ID does not exist" containerID="be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de"
Jul 24 17:49:18.766295 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.766247    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de"} err="failed to get container status \"be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de\": rpc error: code = NotFound desc = could not find container \"be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de\": container with ID starting with be0451da458803260cc765263cbac92465b5a203f0763811eb7f58aae87506de not found: ID does not exist"
Jul 24 17:49:18.777643 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.777616    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2lbg5"]
Jul 24 17:49:18.780650 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:18.780629    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2lbg5"]
Jul 24 17:49:19.460154 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:19.460121    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed627501-4212-4c5c-a605-6b999159a76a" path="/var/lib/kubelet/pods/ed627501-4212-4c5c-a605-6b999159a76a/volumes"
Jul 24 17:49:24.315705 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.315656    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:24.316179 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.315901    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b" podUID="1af8c5f9-8fbb-476d-8d6d-6b407287c753" containerName="limitador" containerID="cri-o://d5b47f8c88200fc1a9d12b5240cb5934a81186b9eef106799b08f1553666583e" gracePeriod=30
Jul 24 17:49:24.316945 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.316921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:24.793124 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.792962    2564 generic.go:356] "Generic (PLEG): container finished" podID="1af8c5f9-8fbb-476d-8d6d-6b407287c753" containerID="d5b47f8c88200fc1a9d12b5240cb5934a81186b9eef106799b08f1553666583e" exitCode=0
Jul 24 17:49:24.793124 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.793082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b" event={"ID":"1af8c5f9-8fbb-476d-8d6d-6b407287c753","Type":"ContainerDied","Data":"d5b47f8c88200fc1a9d12b5240cb5934a81186b9eef106799b08f1553666583e"}
Jul 24 17:49:24.886588 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.886522    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:24.986798 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.986765    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpj47\" (UniqueName: \"kubernetes.io/projected/1af8c5f9-8fbb-476d-8d6d-6b407287c753-kube-api-access-lpj47\") pod \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") "
Jul 24 17:49:24.986985 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.986841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1af8c5f9-8fbb-476d-8d6d-6b407287c753-config-file\") pod \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\" (UID: \"1af8c5f9-8fbb-476d-8d6d-6b407287c753\") "
Jul 24 17:49:24.987201 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.987178    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af8c5f9-8fbb-476d-8d6d-6b407287c753-config-file" (OuterVolumeSpecName: "config-file") pod "1af8c5f9-8fbb-476d-8d6d-6b407287c753" (UID: "1af8c5f9-8fbb-476d-8d6d-6b407287c753"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:49:24.988941 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:24.988905    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af8c5f9-8fbb-476d-8d6d-6b407287c753-kube-api-access-lpj47" (OuterVolumeSpecName: "kube-api-access-lpj47") pod "1af8c5f9-8fbb-476d-8d6d-6b407287c753" (UID: "1af8c5f9-8fbb-476d-8d6d-6b407287c753"). InnerVolumeSpecName "kube-api-access-lpj47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:49:25.087478 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.087437    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpj47\" (UniqueName: \"kubernetes.io/projected/1af8c5f9-8fbb-476d-8d6d-6b407287c753-kube-api-access-lpj47\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:49:25.087478 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.087471    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1af8c5f9-8fbb-476d-8d6d-6b407287c753-config-file\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:49:25.800429 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.800342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b" event={"ID":"1af8c5f9-8fbb-476d-8d6d-6b407287c753","Type":"ContainerDied","Data":"42ab0a899fd86ae83f9c6431973525ccb7b5ea0188d487d0ec70dcd5401e4fab"}
Jul 24 17:49:25.800429 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.800363    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"
Jul 24 17:49:25.800429 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.800402    2564 scope.go:117] "RemoveContainer" containerID="d5b47f8c88200fc1a9d12b5240cb5934a81186b9eef106799b08f1553666583e"
Jul 24 17:49:25.818513 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.818475    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:25.822619 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:25.822591    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ctm2b"]
Jul 24 17:49:27.460116 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:27.460082    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1af8c5f9-8fbb-476d-8d6d-6b407287c753" path="/var/lib/kubelet/pods/1af8c5f9-8fbb-476d-8d6d-6b407287c753/volumes"
Jul 24 17:49:28.759520 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.759480    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"]
Jul 24 17:49:28.760101 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.760082    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed627501-4212-4c5c-a605-6b999159a76a" containerName="authorino"
Jul 24 17:49:28.760200 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.760102    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed627501-4212-4c5c-a605-6b999159a76a" containerName="authorino"
Jul 24 17:49:28.760200 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.760128    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af8c5f9-8fbb-476d-8d6d-6b407287c753" containerName="limitador"
Jul 24 17:49:28.760200 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.760136    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af8c5f9-8fbb-476d-8d6d-6b407287c753" containerName="limitador"
Jul 24 17:49:28.760348 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.760255    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed627501-4212-4c5c-a605-6b999159a76a" containerName="authorino"
Jul 24 17:49:28.760348 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.760269    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af8c5f9-8fbb-476d-8d6d-6b407287c753" containerName="limitador"
Jul 24 17:49:28.764507 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.764485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:28.769735 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.769707    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 17:49:28.769963 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.769938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:49:28.770097 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.770015    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5bkq7\""
Jul 24 17:49:28.770417 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.770404    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:49:28.779816 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.779787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"]
Jul 24 17:49:28.819697 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.819665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/628cb114-28c2-4978-a4df-e009a471ea0d-data\") pod \"postgres-69fb4594cf-dpwb2\" (UID: \"628cb114-28c2-4978-a4df-e009a471ea0d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:28.819697 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.819696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhp65\" (UniqueName: \"kubernetes.io/projected/628cb114-28c2-4978-a4df-e009a471ea0d-kube-api-access-hhp65\") pod \"postgres-69fb4594cf-dpwb2\" (UID: \"628cb114-28c2-4978-a4df-e009a471ea0d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:28.920518 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.920481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/628cb114-28c2-4978-a4df-e009a471ea0d-data\") pod \"postgres-69fb4594cf-dpwb2\" (UID: \"628cb114-28c2-4978-a4df-e009a471ea0d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:28.920518 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.920519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhp65\" (UniqueName: \"kubernetes.io/projected/628cb114-28c2-4978-a4df-e009a471ea0d-kube-api-access-hhp65\") pod \"postgres-69fb4594cf-dpwb2\" (UID: \"628cb114-28c2-4978-a4df-e009a471ea0d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:28.920940 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.920919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/628cb114-28c2-4978-a4df-e009a471ea0d-data\") pod \"postgres-69fb4594cf-dpwb2\" (UID: \"628cb114-28c2-4978-a4df-e009a471ea0d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:28.939382 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:28.939354    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhp65\" (UniqueName: \"kubernetes.io/projected/628cb114-28c2-4978-a4df-e009a471ea0d-kube-api-access-hhp65\") pod \"postgres-69fb4594cf-dpwb2\" (UID: \"628cb114-28c2-4978-a4df-e009a471ea0d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:29.074638 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:29.074555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:29.231294 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:29.231263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"]
Jul 24 17:49:29.232759 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:29.232717    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628cb114_28c2_4978_a4df_e009a471ea0d.slice/crio-75b58b858ade2d7fedc6d426fa41ef4160377da290fec780ee2df0c635712328 WatchSource:0}: Error finding container 75b58b858ade2d7fedc6d426fa41ef4160377da290fec780ee2df0c635712328: Status 404 returned error can't find the container with id 75b58b858ade2d7fedc6d426fa41ef4160377da290fec780ee2df0c635712328
Jul 24 17:49:29.830313 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:29.830272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2" event={"ID":"628cb114-28c2-4978-a4df-e009a471ea0d","Type":"ContainerStarted","Data":"75b58b858ade2d7fedc6d426fa41ef4160377da290fec780ee2df0c635712328"}
Jul 24 17:49:34.862980 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:34.862946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2" event={"ID":"628cb114-28c2-4978-a4df-e009a471ea0d","Type":"ContainerStarted","Data":"3a8bf8176fd1b670af0c8765545ee58f50488597020235cf7e15376f618d3be2"}
Jul 24 17:49:34.863366 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:34.863003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:34.884228 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:34.884180    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2" podStartSLOduration=2.135230385 podStartE2EDuration="6.884164267s" totalImagesPullingTime="4.748933882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:34.880399147 +0000 UTC m=+773.912779505" watchObservedRunningTime="2026-07-24 17:49:34.884164267 +0000 UTC m=+773.916544625"
Jul 24 17:49:40.897126 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:40.897093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dpwb2"
Jul 24 17:49:41.527712 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.527674    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqf2x"]
Jul 24 17:49:41.533503 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.533480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:41.540179 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.540154    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqf2x"]
Jul 24 17:49:41.642286 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.642250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tflxp\" (UniqueName: \"kubernetes.io/projected/f8d642f0-e72f-45c0-987c-91dcc11312d6-kube-api-access-tflxp\") pod \"authorino-5d4b67c446-cqf2x\" (UID: \"f8d642f0-e72f-45c0-987c-91dcc11312d6\") " pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:41.743761 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.743673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tflxp\" (UniqueName: \"kubernetes.io/projected/f8d642f0-e72f-45c0-987c-91dcc11312d6-kube-api-access-tflxp\") pod \"authorino-5d4b67c446-cqf2x\" (UID: \"f8d642f0-e72f-45c0-987c-91dcc11312d6\") " pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:41.764720 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.764687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tflxp\" (UniqueName: \"kubernetes.io/projected/f8d642f0-e72f-45c0-987c-91dcc11312d6-kube-api-access-tflxp\") pod \"authorino-5d4b67c446-cqf2x\" (UID: \"f8d642f0-e72f-45c0-987c-91dcc11312d6\") " pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:41.843539 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.843501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:41.853517 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.853488    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqf2x"]
Jul 24 17:49:41.907547 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.907514    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f57cdbc6-qj6hn"]
Jul 24 17:49:41.913476 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.913450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:41.917759 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.917738    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 17:49:41.927930 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.927881    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f57cdbc6-qj6hn"]
Jul 24 17:49:41.998807 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:41.998773    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqf2x"]
Jul 24 17:49:42.047154 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.047117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt5gb\" (UniqueName: \"kubernetes.io/projected/db9336cc-8024-4131-b254-1c10a411b35a-kube-api-access-nt5gb\") pod \"authorino-58f57cdbc6-qj6hn\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") " pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.047330 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.047208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db9336cc-8024-4131-b254-1c10a411b35a-tls-cert\") pod \"authorino-58f57cdbc6-qj6hn\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") " pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.148041 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.148003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db9336cc-8024-4131-b254-1c10a411b35a-tls-cert\") pod \"authorino-58f57cdbc6-qj6hn\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") " pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.148194 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.148080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt5gb\" (UniqueName: \"kubernetes.io/projected/db9336cc-8024-4131-b254-1c10a411b35a-kube-api-access-nt5gb\") pod \"authorino-58f57cdbc6-qj6hn\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") " pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.150271 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.150251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db9336cc-8024-4131-b254-1c10a411b35a-tls-cert\") pod \"authorino-58f57cdbc6-qj6hn\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") " pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.157868 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.157846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt5gb\" (UniqueName: \"kubernetes.io/projected/db9336cc-8024-4131-b254-1c10a411b35a-kube-api-access-nt5gb\") pod \"authorino-58f57cdbc6-qj6hn\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") " pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.224554 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.224515    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:49:42.396580 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.396552    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f57cdbc6-qj6hn"]
Jul 24 17:49:42.398518 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:42.398488    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb9336cc_8024_4131_b254_1c10a411b35a.slice/crio-54b22b5096958fb8b6057695754ef49364c92cf2cd24580293665ff0d6c13cf4 WatchSource:0}: Error finding container 54b22b5096958fb8b6057695754ef49364c92cf2cd24580293665ff0d6c13cf4: Status 404 returned error can't find the container with id 54b22b5096958fb8b6057695754ef49364c92cf2cd24580293665ff0d6c13cf4
Jul 24 17:49:42.916467 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.916427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn" event={"ID":"db9336cc-8024-4131-b254-1c10a411b35a","Type":"ContainerStarted","Data":"54b22b5096958fb8b6057695754ef49364c92cf2cd24580293665ff0d6c13cf4"}
Jul 24 17:49:42.918126 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.918099    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cqf2x" event={"ID":"f8d642f0-e72f-45c0-987c-91dcc11312d6","Type":"ContainerStarted","Data":"f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e"}
Jul 24 17:49:42.918257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.918138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cqf2x" event={"ID":"f8d642f0-e72f-45c0-987c-91dcc11312d6","Type":"ContainerStarted","Data":"dd09e3605c23e77e28e07c3c17bd1bb71a80bce1146c9d763f184d320e5dc090"}
Jul 24 17:49:42.918257 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.918210    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cqf2x" podUID="f8d642f0-e72f-45c0-987c-91dcc11312d6" containerName="authorino" containerID="cri-o://f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e" gracePeriod=30
Jul 24 17:49:42.950455 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:42.950410    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cqf2x" podStartSLOduration=1.42996808 podStartE2EDuration="1.950395189s" totalImagesPullingTime="520.427109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:42.948866014 +0000 UTC m=+781.981246371" watchObservedRunningTime="2026-07-24 17:49:42.950395189 +0000 UTC m=+781.982775546"
Jul 24 17:49:43.236686 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.236651    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:43.359101 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.359069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tflxp\" (UniqueName: \"kubernetes.io/projected/f8d642f0-e72f-45c0-987c-91dcc11312d6-kube-api-access-tflxp\") pod \"f8d642f0-e72f-45c0-987c-91dcc11312d6\" (UID: \"f8d642f0-e72f-45c0-987c-91dcc11312d6\") "
Jul 24 17:49:43.361156 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.361122    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d642f0-e72f-45c0-987c-91dcc11312d6-kube-api-access-tflxp" (OuterVolumeSpecName: "kube-api-access-tflxp") pod "f8d642f0-e72f-45c0-987c-91dcc11312d6" (UID: "f8d642f0-e72f-45c0-987c-91dcc11312d6"). InnerVolumeSpecName "kube-api-access-tflxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:49:43.459996 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.459921    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tflxp\" (UniqueName: \"kubernetes.io/projected/f8d642f0-e72f-45c0-987c-91dcc11312d6-kube-api-access-tflxp\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:49:43.925133 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.925096    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8d642f0-e72f-45c0-987c-91dcc11312d6" containerID="f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e" exitCode=0
Jul 24 17:49:43.925563 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.925142    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqf2x"
Jul 24 17:49:43.925563 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.925179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cqf2x" event={"ID":"f8d642f0-e72f-45c0-987c-91dcc11312d6","Type":"ContainerDied","Data":"f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e"}
Jul 24 17:49:43.925563 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.925219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cqf2x" event={"ID":"f8d642f0-e72f-45c0-987c-91dcc11312d6","Type":"ContainerDied","Data":"dd09e3605c23e77e28e07c3c17bd1bb71a80bce1146c9d763f184d320e5dc090"}
Jul 24 17:49:43.925563 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.925236    2564 scope.go:117] "RemoveContainer" containerID="f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e"
Jul 24 17:49:43.926803 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.926781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn" event={"ID":"db9336cc-8024-4131-b254-1c10a411b35a","Type":"ContainerStarted","Data":"29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f"}
Jul 24 17:49:43.934241 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.934218    2564 scope.go:117] "RemoveContainer" containerID="f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e"
Jul 24 17:49:43.934540 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:49:43.934518    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e\": container with ID starting with f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e not found: ID does not exist" containerID="f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e"
Jul 24 17:49:43.934619 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.934554    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e"} err="failed to get container status \"f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e\": rpc error: code = NotFound desc = could not find container \"f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e\": container with ID starting with f78af70c3eeedcf80cf4c6d1e0608140f88dcad7ae91e43f788a3b5687e7687e not found: ID does not exist"
Jul 24 17:49:43.942660 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.942632    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqf2x"]
Jul 24 17:49:43.945538 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.945518    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqf2x"]
Jul 24 17:49:43.967640 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:43.967592    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn" podStartSLOduration=2.420298083 podStartE2EDuration="2.967575185s" totalImagesPullingTime="547.277102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:43.96656714 +0000 UTC m=+782.998947500" watchObservedRunningTime="2026-07-24 17:49:43.967575185 +0000 UTC m=+782.999955542"
Jul 24 17:49:44.033774 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.033688    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9k7vv"]
Jul 24 17:49:44.033939 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.033914    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9k7vv" podUID="0ccbc661-47ca-43ae-8aae-636f4139f2f5" containerName="authorino" containerID="cri-o://85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb" gracePeriod=30
Jul 24 17:49:44.337740 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.337662    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:44.468069 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.468004    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s4jv\" (UniqueName: \"kubernetes.io/projected/0ccbc661-47ca-43ae-8aae-636f4139f2f5-kube-api-access-2s4jv\") pod \"0ccbc661-47ca-43ae-8aae-636f4139f2f5\" (UID: \"0ccbc661-47ca-43ae-8aae-636f4139f2f5\") "
Jul 24 17:49:44.470056 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.470012    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ccbc661-47ca-43ae-8aae-636f4139f2f5-kube-api-access-2s4jv" (OuterVolumeSpecName: "kube-api-access-2s4jv") pod "0ccbc661-47ca-43ae-8aae-636f4139f2f5" (UID: "0ccbc661-47ca-43ae-8aae-636f4139f2f5"). InnerVolumeSpecName "kube-api-access-2s4jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:49:44.569405 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.569364    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s4jv\" (UniqueName: \"kubernetes.io/projected/0ccbc661-47ca-43ae-8aae-636f4139f2f5-kube-api-access-2s4jv\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:49:44.934235 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.934205    2564 generic.go:356] "Generic (PLEG): container finished" podID="0ccbc661-47ca-43ae-8aae-636f4139f2f5" containerID="85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb" exitCode=0
Jul 24 17:49:44.934689 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.934247    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9k7vv"
Jul 24 17:49:44.934689 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.934293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9k7vv" event={"ID":"0ccbc661-47ca-43ae-8aae-636f4139f2f5","Type":"ContainerDied","Data":"85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb"}
Jul 24 17:49:44.934689 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.934333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9k7vv" event={"ID":"0ccbc661-47ca-43ae-8aae-636f4139f2f5","Type":"ContainerDied","Data":"0e035e716963418e854f447d64aaebb454eb7679ebbe73d3449cd9c91d8b9c43"}
Jul 24 17:49:44.934689 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.934353    2564 scope.go:117] "RemoveContainer" containerID="85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb"
Jul 24 17:49:44.943905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.943887    2564 scope.go:117] "RemoveContainer" containerID="85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb"
Jul 24 17:49:44.944228 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:49:44.944202    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb\": container with ID starting with 85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb not found: ID does not exist" containerID="85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb"
Jul 24 17:49:44.944344 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.944238    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb"} err="failed to get container status \"85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb\": rpc error: code = NotFound desc = could not find container \"85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb\": container with ID starting with 85f85b6639500c89f86f0a1e4a067eeb2bc0684da13b671d90b7776b08f561cb not found: ID does not exist"
Jul 24 17:49:44.961101 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.961058    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9k7vv"]
Jul 24 17:49:44.966906 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:44.966876    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9k7vv"]
Jul 24 17:49:45.459721 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:45.459690    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ccbc661-47ca-43ae-8aae-636f4139f2f5" path="/var/lib/kubelet/pods/0ccbc661-47ca-43ae-8aae-636f4139f2f5/volumes"
Jul 24 17:49:45.460035 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:45.460008    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d642f0-e72f-45c0-987c-91dcc11312d6" path="/var/lib/kubelet/pods/f8d642f0-e72f-45c0-987c-91dcc11312d6/volumes"
Jul 24 17:49:49.139601 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.139564    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df99fd7fc-j9cbz"]
Jul 24 17:49:49.139992 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.139976    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d642f0-e72f-45c0-987c-91dcc11312d6" containerName="authorino"
Jul 24 17:49:49.139992 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.139987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d642f0-e72f-45c0-987c-91dcc11312d6" containerName="authorino"
Jul 24 17:49:49.140088 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.140003    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccbc661-47ca-43ae-8aae-636f4139f2f5" containerName="authorino"
Jul 24 17:49:49.140088 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.140009    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccbc661-47ca-43ae-8aae-636f4139f2f5" containerName="authorino"
Jul 24 17:49:49.140172 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.140104    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d642f0-e72f-45c0-987c-91dcc11312d6" containerName="authorino"
Jul 24 17:49:49.140172 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.140113    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccbc661-47ca-43ae-8aae-636f4139f2f5" containerName="authorino"
Jul 24 17:49:49.146808 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.146785    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.149993 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.149971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-spv7j\""
Jul 24 17:49:49.150117 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.149971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 17:49:49.150117 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.149975    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:49:49.157141 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.157113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df99fd7fc-j9cbz"]
Jul 24 17:49:49.209261 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.209217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76533dfe-02e1-4ce3-8ceb-186b711c8260-webhook-cert\") pod \"maas-controller-5df99fd7fc-j9cbz\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") " pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.209442 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.209276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8cnz\" (UniqueName: \"kubernetes.io/projected/76533dfe-02e1-4ce3-8ceb-186b711c8260-kube-api-access-k8cnz\") pod \"maas-controller-5df99fd7fc-j9cbz\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") " pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.310485 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.310440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76533dfe-02e1-4ce3-8ceb-186b711c8260-webhook-cert\") pod \"maas-controller-5df99fd7fc-j9cbz\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") " pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.310485 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.310493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8cnz\" (UniqueName: \"kubernetes.io/projected/76533dfe-02e1-4ce3-8ceb-186b711c8260-kube-api-access-k8cnz\") pod \"maas-controller-5df99fd7fc-j9cbz\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") " pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.313119 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.313082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76533dfe-02e1-4ce3-8ceb-186b711c8260-webhook-cert\") pod \"maas-controller-5df99fd7fc-j9cbz\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") " pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.319701 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.319667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8cnz\" (UniqueName: \"kubernetes.io/projected/76533dfe-02e1-4ce3-8ceb-186b711c8260-kube-api-access-k8cnz\") pod \"maas-controller-5df99fd7fc-j9cbz\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") " pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.348888 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.348854    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4bb4965f-hhqd5"]
Jul 24 17:49:49.351329 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.351311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.363857 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.363828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4bb4965f-hhqd5"]
Jul 24 17:49:49.411020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.410936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v7hz\" (UniqueName: \"kubernetes.io/projected/14e7d830-f7af-428b-914f-089328e82115-kube-api-access-9v7hz\") pod \"maas-controller-d4bb4965f-hhqd5\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") " pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.411020 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.410981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e7d830-f7af-428b-914f-089328e82115-webhook-cert\") pod \"maas-controller-d4bb4965f-hhqd5\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") " pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.458097 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.458070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:49.511713 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.511677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v7hz\" (UniqueName: \"kubernetes.io/projected/14e7d830-f7af-428b-914f-089328e82115-kube-api-access-9v7hz\") pod \"maas-controller-d4bb4965f-hhqd5\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") " pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.511896 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.511764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e7d830-f7af-428b-914f-089328e82115-webhook-cert\") pod \"maas-controller-d4bb4965f-hhqd5\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") " pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.514947 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.514919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e7d830-f7af-428b-914f-089328e82115-webhook-cert\") pod \"maas-controller-d4bb4965f-hhqd5\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") " pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.522593 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.522537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v7hz\" (UniqueName: \"kubernetes.io/projected/14e7d830-f7af-428b-914f-089328e82115-kube-api-access-9v7hz\") pod \"maas-controller-d4bb4965f-hhqd5\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") " pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.598070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.598045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df99fd7fc-j9cbz"]
Jul 24 17:49:49.599881 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:49.599851    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76533dfe_02e1_4ce3_8ceb_186b711c8260.slice/crio-5abcf2ef9b3ce04f7cbfc3f5214c1812b1ec57c67ac188077fe25d8f8aee6f73 WatchSource:0}: Error finding container 5abcf2ef9b3ce04f7cbfc3f5214c1812b1ec57c67ac188077fe25d8f8aee6f73: Status 404 returned error can't find the container with id 5abcf2ef9b3ce04f7cbfc3f5214c1812b1ec57c67ac188077fe25d8f8aee6f73
Jul 24 17:49:49.663292 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.663204    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:49.806150 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.806122    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4bb4965f-hhqd5"]
Jul 24 17:49:49.807411 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:49:49.807383    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e7d830_f7af_428b_914f_089328e82115.slice/crio-3db48b5f4d927dc171660eeaeb0cac5a6eaac2942d7a9e60c4b96503fdb69c50 WatchSource:0}: Error finding container 3db48b5f4d927dc171660eeaeb0cac5a6eaac2942d7a9e60c4b96503fdb69c50: Status 404 returned error can't find the container with id 3db48b5f4d927dc171660eeaeb0cac5a6eaac2942d7a9e60c4b96503fdb69c50
Jul 24 17:49:49.971908 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.971809    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz" event={"ID":"76533dfe-02e1-4ce3-8ceb-186b711c8260","Type":"ContainerStarted","Data":"5abcf2ef9b3ce04f7cbfc3f5214c1812b1ec57c67ac188077fe25d8f8aee6f73"}
Jul 24 17:49:49.973068 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:49.973044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4bb4965f-hhqd5" event={"ID":"14e7d830-f7af-428b-914f-089328e82115","Type":"ContainerStarted","Data":"3db48b5f4d927dc171660eeaeb0cac5a6eaac2942d7a9e60c4b96503fdb69c50"}
Jul 24 17:49:52.993729 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:52.993687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4bb4965f-hhqd5" event={"ID":"14e7d830-f7af-428b-914f-089328e82115","Type":"ContainerStarted","Data":"c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8"}
Jul 24 17:49:52.994180 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:52.993758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:49:52.995234 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:52.995212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz" event={"ID":"76533dfe-02e1-4ce3-8ceb-186b711c8260","Type":"ContainerStarted","Data":"354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221"}
Jul 24 17:49:52.995331 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:52.995290    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:49:53.018243 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:53.018194    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4bb4965f-hhqd5" podStartSLOduration=1.840263589 podStartE2EDuration="4.018175953s" totalImagesPullingTime="2.177912364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:53.015698575 +0000 UTC m=+792.048078934" watchObservedRunningTime="2026-07-24 17:49:53.018175953 +0000 UTC m=+792.050556311"
Jul 24 17:49:53.044347 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:49:53.044300    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz" podStartSLOduration=1.66580985 podStartE2EDuration="4.044285753s" totalImagesPullingTime="2.378475903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:53.043715599 +0000 UTC m=+792.076095956" watchObservedRunningTime="2026-07-24 17:49:53.044285753 +0000 UTC m=+792.076666111"
Jul 24 17:50:04.003758 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.003635    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:50:04.004155 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.003980    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:50:04.068820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.068782    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df99fd7fc-j9cbz"]
Jul 24 17:50:04.069123 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.069067    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz" podUID="76533dfe-02e1-4ce3-8ceb-186b711c8260" containerName="manager" containerID="cri-o://354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221" gracePeriod=30
Jul 24 17:50:04.324766 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.324739    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:50:04.447799 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.447770    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76533dfe-02e1-4ce3-8ceb-186b711c8260-webhook-cert\") pod \"76533dfe-02e1-4ce3-8ceb-186b711c8260\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") "
Jul 24 17:50:04.447997 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.447904    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8cnz\" (UniqueName: \"kubernetes.io/projected/76533dfe-02e1-4ce3-8ceb-186b711c8260-kube-api-access-k8cnz\") pod \"76533dfe-02e1-4ce3-8ceb-186b711c8260\" (UID: \"76533dfe-02e1-4ce3-8ceb-186b711c8260\") "
Jul 24 17:50:04.450375 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.450337    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76533dfe-02e1-4ce3-8ceb-186b711c8260-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "76533dfe-02e1-4ce3-8ceb-186b711c8260" (UID: "76533dfe-02e1-4ce3-8ceb-186b711c8260"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:50:04.450500 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.450431    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76533dfe-02e1-4ce3-8ceb-186b711c8260-kube-api-access-k8cnz" (OuterVolumeSpecName: "kube-api-access-k8cnz") pod "76533dfe-02e1-4ce3-8ceb-186b711c8260" (UID: "76533dfe-02e1-4ce3-8ceb-186b711c8260"). InnerVolumeSpecName "kube-api-access-k8cnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:04.549303 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.549271    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8cnz\" (UniqueName: \"kubernetes.io/projected/76533dfe-02e1-4ce3-8ceb-186b711c8260-kube-api-access-k8cnz\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:50:04.549303 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:04.549300    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76533dfe-02e1-4ce3-8ceb-186b711c8260-webhook-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:50:05.066089 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.066055    2564 generic.go:356] "Generic (PLEG): container finished" podID="76533dfe-02e1-4ce3-8ceb-186b711c8260" containerID="354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221" exitCode=0
Jul 24 17:50:05.066535 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.066103    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz"
Jul 24 17:50:05.066535 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.066144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz" event={"ID":"76533dfe-02e1-4ce3-8ceb-186b711c8260","Type":"ContainerDied","Data":"354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221"}
Jul 24 17:50:05.066535 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.066204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df99fd7fc-j9cbz" event={"ID":"76533dfe-02e1-4ce3-8ceb-186b711c8260","Type":"ContainerDied","Data":"5abcf2ef9b3ce04f7cbfc3f5214c1812b1ec57c67ac188077fe25d8f8aee6f73"}
Jul 24 17:50:05.066535 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.066232    2564 scope.go:117] "RemoveContainer" containerID="354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221"
Jul 24 17:50:05.076143 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.075943    2564 scope.go:117] "RemoveContainer" containerID="354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221"
Jul 24 17:50:05.076356 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:50:05.076336    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221\": container with ID starting with 354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221 not found: ID does not exist" containerID="354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221"
Jul 24 17:50:05.076403 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.076367    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221"} err="failed to get container status \"354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221\": rpc error: code = NotFound desc = could not find container \"354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221\": container with ID starting with 354c4716810a97ebeebf090278613ee8794e7a03d0b8f84c10d19f55d5072221 not found: ID does not exist"
Jul 24 17:50:05.089726 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.089691    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df99fd7fc-j9cbz"]
Jul 24 17:50:05.093435 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.093407    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df99fd7fc-j9cbz"]
Jul 24 17:50:05.460740 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:05.460708    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76533dfe-02e1-4ce3-8ceb-186b711c8260" path="/var/lib/kubelet/pods/76533dfe-02e1-4ce3-8ceb-186b711c8260/volumes"
Jul 24 17:50:24.641097 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.641054    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"]
Jul 24 17:50:24.641670 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.641480    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76533dfe-02e1-4ce3-8ceb-186b711c8260" containerName="manager"
Jul 24 17:50:24.641670 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.641492    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76533dfe-02e1-4ce3-8ceb-186b711c8260" containerName="manager"
Jul 24 17:50:24.641670 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.641581    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76533dfe-02e1-4ce3-8ceb-186b711c8260" containerName="manager"
Jul 24 17:50:24.649757 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.649736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.652533 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.652509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 17:50:24.652652 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.652531    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fvm85\""
Jul 24 17:50:24.657629 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.657602    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"]
Jul 24 17:50:24.740328 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.740285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ae7bded-cba7-467a-873d-f5a7020479ec-maas-api-tls\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.740525 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.740392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae7bded-cba7-467a-873d-f5a7020479ec-openshift-service-ca\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.740525 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.740448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74qk\" (UniqueName: \"kubernetes.io/projected/0ae7bded-cba7-467a-873d-f5a7020479ec-kube-api-access-k74qk\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.841974 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.841929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k74qk\" (UniqueName: \"kubernetes.io/projected/0ae7bded-cba7-467a-873d-f5a7020479ec-kube-api-access-k74qk\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.842210 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.842040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ae7bded-cba7-467a-873d-f5a7020479ec-maas-api-tls\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.842210 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.842072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae7bded-cba7-467a-873d-f5a7020479ec-openshift-service-ca\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.842210 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:50:24.842176    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 24 17:50:24.842337 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:50:24.842248    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ae7bded-cba7-467a-873d-f5a7020479ec-maas-api-tls podName:0ae7bded-cba7-467a-873d-f5a7020479ec nodeName:}" failed. No retries permitted until 2026-07-24 17:50:25.342228945 +0000 UTC m=+824.374609299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ae7bded-cba7-467a-873d-f5a7020479ec-maas-api-tls") pod "maas-api-756b8948fc-mtnqr" (UID: "0ae7bded-cba7-467a-873d-f5a7020479ec") : secret "maas-api-serving-cert" not found
Jul 24 17:50:24.842764 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.842742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae7bded-cba7-467a-873d-f5a7020479ec-openshift-service-ca\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:24.851503 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:24.851471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74qk\" (UniqueName: \"kubernetes.io/projected/0ae7bded-cba7-467a-873d-f5a7020479ec-kube-api-access-k74qk\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:25.134073 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.133962    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"]
Jul 24 17:50:25.138322 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.138298    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.148416 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.148384    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 17:50:25.148669 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.148454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zfbcc\""
Jul 24 17:50:25.154230 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.154201    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"]
Jul 24 17:50:25.160747 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.160719    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-mnflf"]
Jul 24 17:50:25.165553 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.165527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.174181 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.174151    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-mnflf"]
Jul 24 17:50:25.249328 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.249285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7xrm\" (UniqueName: \"kubernetes.io/projected/5208b6f8-05dd-4972-8cf1-06ce5324b172-kube-api-access-j7xrm\") pod \"payload-pre-processing-687dbb6cf6-qk6zc\" (UID: \"5208b6f8-05dd-4972-8cf1-06ce5324b172\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.249328 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.249335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5208b6f8-05dd-4972-8cf1-06ce5324b172-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qk6zc\" (UID: \"5208b6f8-05dd-4972-8cf1-06ce5324b172\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.350684 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.350645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7xrm\" (UniqueName: \"kubernetes.io/projected/5208b6f8-05dd-4972-8cf1-06ce5324b172-kube-api-access-j7xrm\") pod \"payload-pre-processing-687dbb6cf6-qk6zc\" (UID: \"5208b6f8-05dd-4972-8cf1-06ce5324b172\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.350684 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.350684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64676a42-5be0-44c3-8939-b30c9095dcf0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-mnflf\" (UID: \"64676a42-5be0-44c3-8939-b30c9095dcf0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.350900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.350731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5208b6f8-05dd-4972-8cf1-06ce5324b172-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qk6zc\" (UID: \"5208b6f8-05dd-4972-8cf1-06ce5324b172\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.350900 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.350748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668p9\" (UniqueName: \"kubernetes.io/projected/64676a42-5be0-44c3-8939-b30c9095dcf0-kube-api-access-668p9\") pod \"payload-processing-5cc6cd444b-mnflf\" (UID: \"64676a42-5be0-44c3-8939-b30c9095dcf0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.350975 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.350895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ae7bded-cba7-467a-873d-f5a7020479ec-maas-api-tls\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:25.351597 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.351577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5208b6f8-05dd-4972-8cf1-06ce5324b172-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qk6zc\" (UID: \"5208b6f8-05dd-4972-8cf1-06ce5324b172\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.353887 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.353853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ae7bded-cba7-467a-873d-f5a7020479ec-maas-api-tls\") pod \"maas-api-756b8948fc-mtnqr\" (UID: \"0ae7bded-cba7-467a-873d-f5a7020479ec\") " pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:25.367803 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.367771    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7xrm\" (UniqueName: \"kubernetes.io/projected/5208b6f8-05dd-4972-8cf1-06ce5324b172-kube-api-access-j7xrm\") pod \"payload-pre-processing-687dbb6cf6-qk6zc\" (UID: \"5208b6f8-05dd-4972-8cf1-06ce5324b172\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.452034 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.451974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64676a42-5be0-44c3-8939-b30c9095dcf0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-mnflf\" (UID: \"64676a42-5be0-44c3-8939-b30c9095dcf0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.452201 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.452073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668p9\" (UniqueName: \"kubernetes.io/projected/64676a42-5be0-44c3-8939-b30c9095dcf0-kube-api-access-668p9\") pod \"payload-processing-5cc6cd444b-mnflf\" (UID: \"64676a42-5be0-44c3-8939-b30c9095dcf0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.452709 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.452685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64676a42-5be0-44c3-8939-b30c9095dcf0-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-mnflf\" (UID: \"64676a42-5be0-44c3-8939-b30c9095dcf0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.460247 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.460217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668p9\" (UniqueName: \"kubernetes.io/projected/64676a42-5be0-44c3-8939-b30c9095dcf0-kube-api-access-668p9\") pod \"payload-processing-5cc6cd444b-mnflf\" (UID: \"64676a42-5be0-44c3-8939-b30c9095dcf0\") " pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.461925 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.461907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:25.478811 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.478790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:25.563475 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.563443    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:25.628589 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.628466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"]
Jul 24 17:50:25.629151 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:50:25.629120    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5208b6f8_05dd_4972_8cf1_06ce5324b172.slice/crio-a0560faa7e2d76bc9e3378501d9a26f5a61bb792cb2e5905d2010bfe57585c94 WatchSource:0}: Error finding container a0560faa7e2d76bc9e3378501d9a26f5a61bb792cb2e5905d2010bfe57585c94: Status 404 returned error can't find the container with id a0560faa7e2d76bc9e3378501d9a26f5a61bb792cb2e5905d2010bfe57585c94
Jul 24 17:50:25.671502 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.671469    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-mnflf"]
Jul 24 17:50:25.672844 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:50:25.672807    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64676a42_5be0_44c3_8939_b30c9095dcf0.slice/crio-5a1e34929c5e62e742853ebed3e7ec680660a1a9435599999cbd61c854f31fdb WatchSource:0}: Error finding container 5a1e34929c5e62e742853ebed3e7ec680660a1a9435599999cbd61c854f31fdb: Status 404 returned error can't find the container with id 5a1e34929c5e62e742853ebed3e7ec680660a1a9435599999cbd61c854f31fdb
Jul 24 17:50:25.752039 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:25.750841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"]
Jul 24 17:50:25.759922 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:50:25.759881    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae7bded_cba7_467a_873d_f5a7020479ec.slice/crio-f85c23b32f84b3fde762ad1cef15bf3aeb6a57b6a843bd101040ce601e16c61d WatchSource:0}: Error finding container f85c23b32f84b3fde762ad1cef15bf3aeb6a57b6a843bd101040ce601e16c61d: Status 404 returned error can't find the container with id f85c23b32f84b3fde762ad1cef15bf3aeb6a57b6a843bd101040ce601e16c61d
Jul 24 17:50:26.216058 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:26.215430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf" event={"ID":"64676a42-5be0-44c3-8939-b30c9095dcf0","Type":"ContainerStarted","Data":"5a1e34929c5e62e742853ebed3e7ec680660a1a9435599999cbd61c854f31fdb"}
Jul 24 17:50:26.218662 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:26.218566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr" event={"ID":"0ae7bded-cba7-467a-873d-f5a7020479ec","Type":"ContainerStarted","Data":"f85c23b32f84b3fde762ad1cef15bf3aeb6a57b6a843bd101040ce601e16c61d"}
Jul 24 17:50:26.223239 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:26.223157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc" event={"ID":"5208b6f8-05dd-4972-8cf1-06ce5324b172","Type":"ContainerStarted","Data":"a0560faa7e2d76bc9e3378501d9a26f5a61bb792cb2e5905d2010bfe57585c94"}
Jul 24 17:50:29.251102 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.251065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf" event={"ID":"64676a42-5be0-44c3-8939-b30c9095dcf0","Type":"ContainerStarted","Data":"ba7488601ae8bf5e119fabf78d11523244b43910b5060baaa78d56e1228f79aa"}
Jul 24 17:50:29.251506 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.251226    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:29.252628 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.252602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr" event={"ID":"0ae7bded-cba7-467a-873d-f5a7020479ec","Type":"ContainerStarted","Data":"9561600e3811817f9ee136665f1d01b17cc5a1b3092f36ce9b18b8676311ba93"}
Jul 24 17:50:29.252745 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.252673    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:29.253950 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.253927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc" event={"ID":"5208b6f8-05dd-4972-8cf1-06ce5324b172","Type":"ContainerStarted","Data":"165768439f21c3b9639e21feef8f53cd5cb2371bd3b48d552f8d78feab0018d7"}
Jul 24 17:50:29.254070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.254046    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:29.267647 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.267602    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf" podStartSLOduration=1.55878458 podStartE2EDuration="4.267585773s" totalImagesPullingTime="2.708801193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:29.267452791 +0000 UTC m=+828.299833150" watchObservedRunningTime="2026-07-24 17:50:29.267585773 +0000 UTC m=+828.299966132"
Jul 24 17:50:29.285851 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:29.285799    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr" podStartSLOduration=2.669008651 podStartE2EDuration="5.285784511s" totalImagesPullingTime="2.61677586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:29.283221054 +0000 UTC m=+828.315601418" watchObservedRunningTime="2026-07-24 17:50:29.285784511 +0000 UTC m=+828.318164899"
Jul 24 17:50:33.287916 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.287880    2564 generic.go:356] "Generic (PLEG): container finished" podID="861bb1fa-7cd8-4006-9a87-0351a1806588" containerID="40e3fa47cccfd9fa9841d9b1a33ef633bba608751594dccbe1b8f2b17e7874f8" exitCode=0
Jul 24 17:50:33.288418 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.287953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" event={"ID":"861bb1fa-7cd8-4006-9a87-0351a1806588","Type":"ContainerDied","Data":"40e3fa47cccfd9fa9841d9b1a33ef633bba608751594dccbe1b8f2b17e7874f8"}
Jul 24 17:50:33.288418 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.288394    2564 scope.go:117] "RemoveContainer" containerID="40e3fa47cccfd9fa9841d9b1a33ef633bba608751594dccbe1b8f2b17e7874f8"
Jul 24 17:50:33.289388 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.289362    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:33.289509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.289446    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:33.289509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.289492    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:50:33.313306 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:33.313254    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc" podStartSLOduration=5.566913436 podStartE2EDuration="8.313239733s" totalImagesPullingTime="2.746326297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:29.303440237 +0000 UTC m=+828.335820603" watchObservedRunningTime="2026-07-24 17:50:33.313239733 +0000 UTC m=+832.345620091"
Jul 24 17:50:34.296791 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:34.296757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" event={"ID":"861bb1fa-7cd8-4006-9a87-0351a1806588","Type":"ContainerStarted","Data":"32453677a8e8cf5c639069a842e06ae09ee9f028fe60204caca460cd3344eff1"}
Jul 24 17:50:35.167942 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:35.167898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:50:35.168222 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:35.168200    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nc7ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:50:35.168274 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:35.168248    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" podUID="861bb1fa-7cd8-4006-9a87-0351a1806588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 17:50:35.274256 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:35.274227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-756b8948fc-mtnqr"
Jul 24 17:50:36.167979 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:36.167939    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nc7ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:50:36.168385 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:36.168002    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" podUID="861bb1fa-7cd8-4006-9a87-0351a1806588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 17:50:37.167133 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:37.167097    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nc7ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:50:37.167312 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:37.167156    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" podUID="861bb1fa-7cd8-4006-9a87-0351a1806588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 17:50:38.167352 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:38.167316    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nc7ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 17:50:38.167734 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:38.167374    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns" podUID="861bb1fa-7cd8-4006-9a87-0351a1806588" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 17:50:39.171077 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:39.171046    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:50:39.171550 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:39.171534    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:50:39.172190 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:39.172171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nc7ns"
Jul 24 17:50:40.270242 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:40.270211    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-mnflf"
Jul 24 17:50:40.270632 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:40.270610    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qk6zc"
Jul 24 17:50:54.964582 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.964542    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"]
Jul 24 17:50:54.969671 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.969651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:54.972305 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.972282    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:50:54.972424 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.972282    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:50:54.973385 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.973365    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 17:50:54.973474 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.973375    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bs9cs\""
Jul 24 17:50:54.977801 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:54.977779    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"]
Jul 24 17:50:55.036717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.036673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fa25e-acdc-424d-94ef-e17c8c7ffdad-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.036717 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.036716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.036920 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.036749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.036920 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.036889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2ll\" (UniqueName: \"kubernetes.io/projected/198fa25e-acdc-424d-94ef-e17c8c7ffdad-kube-api-access-fs2ll\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.037007 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.036985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.037071 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.037019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.137905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.137808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fa25e-acdc-424d-94ef-e17c8c7ffdad-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.137905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.137856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.137905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.137885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.138320 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.137937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2ll\" (UniqueName: \"kubernetes.io/projected/198fa25e-acdc-424d-94ef-e17c8c7ffdad-kube-api-access-fs2ll\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.138320 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.138004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.138320 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.138130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.138320 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.138264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.138533 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.138457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.138533 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.138456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.140212 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.140187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fa25e-acdc-424d-94ef-e17c8c7ffdad-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.140613 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.140593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fa25e-acdc-424d-94ef-e17c8c7ffdad-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.147162 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.147136    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2ll\" (UniqueName: \"kubernetes.io/projected/198fa25e-acdc-424d-94ef-e17c8c7ffdad-kube-api-access-fs2ll\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gwbtt\" (UID: \"198fa25e-acdc-424d-94ef-e17c8c7ffdad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.281418 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.281387    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:50:55.436530 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:55.436504    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"]
Jul 24 17:50:55.438677 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:50:55.438648    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198fa25e_acdc_424d_94ef_e17c8c7ffdad.slice/crio-bf801fd714a183cf0f0f17dea8f4aa94ad51045978cb4c68ecf701df43f284f1 WatchSource:0}: Error finding container bf801fd714a183cf0f0f17dea8f4aa94ad51045978cb4c68ecf701df43f284f1: Status 404 returned error can't find the container with id bf801fd714a183cf0f0f17dea8f4aa94ad51045978cb4c68ecf701df43f284f1
Jul 24 17:50:56.445138 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:56.445094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt" event={"ID":"198fa25e-acdc-424d-94ef-e17c8c7ffdad","Type":"ContainerStarted","Data":"bf801fd714a183cf0f0f17dea8f4aa94ad51045978cb4c68ecf701df43f284f1"}
Jul 24 17:50:57.460046 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:57.459998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt" event={"ID":"198fa25e-acdc-424d-94ef-e17c8c7ffdad","Type":"ContainerStarted","Data":"414311b7bbdd2285329c7526112e083c00edf2967546eb6df944510a2cf69c73"}
Jul 24 17:50:57.473297 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:50:57.473245    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt" podStartSLOduration=2.39508343 podStartE2EDuration="3.473228141s" totalImagesPullingTime="1.078144711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:57.472477441 +0000 UTC m=+856.504857800" watchObservedRunningTime="2026-07-24 17:50:57.473228141 +0000 UTC m=+856.505608499"
Jul 24 17:51:05.282378 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:05.282346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:51:05.282847 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:05.282419    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:51:05.295259 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:05.295228    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:51:05.509121 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:05.509086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gwbtt"
Jul 24 17:51:13.855943 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.855911    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"]
Jul 24 17:51:13.859411 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.859391    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:13.862144 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.862125    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 17:51:13.868643 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.868619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"]
Jul 24 17:51:13.926332 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.926303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:13.926490 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.926339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:13.926490 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.926383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2801175c-13c8-46b2-b3d4-cd0f17089d87-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:13.926490 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.926429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:13.926610 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.926547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:13.926610 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:13.926581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j2tg\" (UniqueName: \"kubernetes.io/projected/2801175c-13c8-46b2-b3d4-cd0f17089d87-kube-api-access-7j2tg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.027905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.027867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.027905 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.027912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j2tg\" (UniqueName: \"kubernetes.io/projected/2801175c-13c8-46b2-b3d4-cd0f17089d87-kube-api-access-7j2tg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.027960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.027982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.028047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2801175c-13c8-46b2-b3d4-cd0f17089d87-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028232 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.028071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028481 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.028375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028481 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.028437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.028556 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.028517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.030420 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.030395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2801175c-13c8-46b2-b3d4-cd0f17089d87-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.030573 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.030556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2801175c-13c8-46b2-b3d4-cd0f17089d87-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.036427 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.036408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j2tg\" (UniqueName: \"kubernetes.io/projected/2801175c-13c8-46b2-b3d4-cd0f17089d87-kube-api-access-7j2tg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb\" (UID: \"2801175c-13c8-46b2-b3d4-cd0f17089d87\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.171444 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.171407    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:14.309287 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.309258    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"]
Jul 24 17:51:14.311832 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:51:14.311807    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2801175c_13c8_46b2_b3d4_cd0f17089d87.slice/crio-afbf7b6114ed8fffc4921b4c7b67e09d32eee5577e15510993c929d3cfd4fd78 WatchSource:0}: Error finding container afbf7b6114ed8fffc4921b4c7b67e09d32eee5577e15510993c929d3cfd4fd78: Status 404 returned error can't find the container with id afbf7b6114ed8fffc4921b4c7b67e09d32eee5577e15510993c929d3cfd4fd78
Jul 24 17:51:14.553769 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:14.553700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb" event={"ID":"2801175c-13c8-46b2-b3d4-cd0f17089d87","Type":"ContainerStarted","Data":"afbf7b6114ed8fffc4921b4c7b67e09d32eee5577e15510993c929d3cfd4fd78"}
Jul 24 17:51:15.560963 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:15.560930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb" event={"ID":"2801175c-13c8-46b2-b3d4-cd0f17089d87","Type":"ContainerStarted","Data":"317743c1517f0bd4ff548912359fe4d164d8394cbc376222a2cd7580e7d51be3"}
Jul 24 17:51:15.580226 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:15.580172    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb" podStartSLOduration=2.416225006 podStartE2EDuration="2.580157803s" totalImagesPullingTime="163.932797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:51:15.576849198 +0000 UTC m=+874.609229556" watchObservedRunningTime="2026-07-24 17:51:15.580157803 +0000 UTC m=+874.612538161"
Jul 24 17:51:20.467465 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.467429    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"]
Jul 24 17:51:20.471443 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.471421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.474175 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.474140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 17:51:20.482981 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.482946    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"]
Jul 24 17:51:20.591374 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.591336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.591556 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.591402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.591556 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.591512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.591556 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.591550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75acfc55-b0fd-4c67-8a12-ada41a355e44-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.591665 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.591579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh49q\" (UniqueName: \"kubernetes.io/projected/75acfc55-b0fd-4c67-8a12-ada41a355e44-kube-api-access-zh49q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.591665 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.591643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692205 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75acfc55-b0fd-4c67-8a12-ada41a355e44-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692373 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh49q\" (UniqueName: \"kubernetes.io/projected/75acfc55-b0fd-4c67-8a12-ada41a355e44-kube-api-access-zh49q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692373 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692453 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692485 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692605 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.692820 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.693059 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.692913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.694547 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.694525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75acfc55-b0fd-4c67-8a12-ada41a355e44-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.694788 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.694772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75acfc55-b0fd-4c67-8a12-ada41a355e44-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.701395 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.701366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh49q\" (UniqueName: \"kubernetes.io/projected/75acfc55-b0fd-4c67-8a12-ada41a355e44-kube-api-access-zh49q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5xfd8\" (UID: \"75acfc55-b0fd-4c67-8a12-ada41a355e44\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.784791 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.784692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:20.965692 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:20.965662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"]
Jul 24 17:51:20.966589 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:51:20.966559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75acfc55_b0fd_4c67_8a12_ada41a355e44.slice/crio-612ed15eb61b23cfb06956bdef99c66d0c154e29bad0e0d091d85ee57f89df4d WatchSource:0}: Error finding container 612ed15eb61b23cfb06956bdef99c66d0c154e29bad0e0d091d85ee57f89df4d: Status 404 returned error can't find the container with id 612ed15eb61b23cfb06956bdef99c66d0c154e29bad0e0d091d85ee57f89df4d
Jul 24 17:51:21.595777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:21.595673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8" event={"ID":"75acfc55-b0fd-4c67-8a12-ada41a355e44","Type":"ContainerStarted","Data":"d30e3fd4b4af2e1e8b320f21f817ed349a7049d5501288dbb3c3268625aa9680"}
Jul 24 17:51:21.595777 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:21.595740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8" event={"ID":"75acfc55-b0fd-4c67-8a12-ada41a355e44","Type":"ContainerStarted","Data":"612ed15eb61b23cfb06956bdef99c66d0c154e29bad0e0d091d85ee57f89df4d"}
Jul 24 17:51:21.629070 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:21.629005    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8" podStartSLOduration=1.4349499159999999 podStartE2EDuration="1.628990347s" totalImagesPullingTime="194.040431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:51:21.627394842 +0000 UTC m=+880.659775200" watchObservedRunningTime="2026-07-24 17:51:21.628990347 +0000 UTC m=+880.661370704"
Jul 24 17:51:24.171864 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:24.171827    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:24.172334 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:24.171884    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:24.184358 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:24.184331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:24.629842 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:24.629765    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb"
Jul 24 17:51:30.785741 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:30.785701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:30.786193 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:30.785775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:30.799511 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:30.799478    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:51:31.681785 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:51:31.681754    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5xfd8"
Jul 24 17:52:20.919391 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:20.919354    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d5f7469c7-gvwhw"]
Jul 24 17:52:20.923005 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:20.922986    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:20.944077 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:20.944049    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5f7469c7-gvwhw"]
Jul 24 17:52:21.090809 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.090776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hp7m\" (UniqueName: \"kubernetes.io/projected/9abb7344-74f5-4a68-adfd-d636158a2652-kube-api-access-5hp7m\") pod \"authorino-6d5f7469c7-gvwhw\" (UID: \"9abb7344-74f5-4a68-adfd-d636158a2652\") " pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.090981 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.090836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9abb7344-74f5-4a68-adfd-d636158a2652-tls-cert\") pod \"authorino-6d5f7469c7-gvwhw\" (UID: \"9abb7344-74f5-4a68-adfd-d636158a2652\") " pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.192458 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.192366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hp7m\" (UniqueName: \"kubernetes.io/projected/9abb7344-74f5-4a68-adfd-d636158a2652-kube-api-access-5hp7m\") pod \"authorino-6d5f7469c7-gvwhw\" (UID: \"9abb7344-74f5-4a68-adfd-d636158a2652\") " pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.192458 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.192443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9abb7344-74f5-4a68-adfd-d636158a2652-tls-cert\") pod \"authorino-6d5f7469c7-gvwhw\" (UID: \"9abb7344-74f5-4a68-adfd-d636158a2652\") " pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.194789 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.194763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9abb7344-74f5-4a68-adfd-d636158a2652-tls-cert\") pod \"authorino-6d5f7469c7-gvwhw\" (UID: \"9abb7344-74f5-4a68-adfd-d636158a2652\") " pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.202335 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.202287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hp7m\" (UniqueName: \"kubernetes.io/projected/9abb7344-74f5-4a68-adfd-d636158a2652-kube-api-access-5hp7m\") pod \"authorino-6d5f7469c7-gvwhw\" (UID: \"9abb7344-74f5-4a68-adfd-d636158a2652\") " pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.231801 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.231763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5f7469c7-gvwhw"
Jul 24 17:52:21.383751 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.383724    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5f7469c7-gvwhw"]
Jul 24 17:52:21.386496 ip-10-0-139-114 kubenswrapper[2564]: W0724 17:52:21.386462    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9abb7344_74f5_4a68_adfd_d636158a2652.slice/crio-3e78e25b61c9cfda822eaeec117f5921cae2ac6d89b962dff4ec2755a43afbac WatchSource:0}: Error finding container 3e78e25b61c9cfda822eaeec117f5921cae2ac6d89b962dff4ec2755a43afbac: Status 404 returned error can't find the container with id 3e78e25b61c9cfda822eaeec117f5921cae2ac6d89b962dff4ec2755a43afbac
Jul 24 17:52:21.963389 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.963359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5f7469c7-gvwhw" event={"ID":"9abb7344-74f5-4a68-adfd-d636158a2652","Type":"ContainerStarted","Data":"32afd5182278490e8fe622131251c259a62ffeae4286b27b135ea4623e785630"}
Jul 24 17:52:21.963729 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:21.963404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5f7469c7-gvwhw" event={"ID":"9abb7344-74f5-4a68-adfd-d636158a2652","Type":"ContainerStarted","Data":"3e78e25b61c9cfda822eaeec117f5921cae2ac6d89b962dff4ec2755a43afbac"}
Jul 24 17:52:22.089825 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.089761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d5f7469c7-gvwhw" podStartSLOduration=1.5819365300000001 podStartE2EDuration="2.089738527s" totalImagesPullingTime="507.801997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:22.01154979 +0000 UTC m=+941.043930148" watchObservedRunningTime="2026-07-24 17:52:22.089738527 +0000 UTC m=+941.122118886"
Jul 24 17:52:22.093164 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.093131    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f57cdbc6-qj6hn"]
Jul 24 17:52:22.093381 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.093354    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn" podUID="db9336cc-8024-4131-b254-1c10a411b35a" containerName="authorino" containerID="cri-o://29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f" gracePeriod=30
Jul 24 17:52:22.364452 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.364425    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:52:22.507110 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.507002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt5gb\" (UniqueName: \"kubernetes.io/projected/db9336cc-8024-4131-b254-1c10a411b35a-kube-api-access-nt5gb\") pod \"db9336cc-8024-4131-b254-1c10a411b35a\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") "
Jul 24 17:52:22.507110 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.507075    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db9336cc-8024-4131-b254-1c10a411b35a-tls-cert\") pod \"db9336cc-8024-4131-b254-1c10a411b35a\" (UID: \"db9336cc-8024-4131-b254-1c10a411b35a\") "
Jul 24 17:52:22.509767 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.509735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9336cc-8024-4131-b254-1c10a411b35a-kube-api-access-nt5gb" (OuterVolumeSpecName: "kube-api-access-nt5gb") pod "db9336cc-8024-4131-b254-1c10a411b35a" (UID: "db9336cc-8024-4131-b254-1c10a411b35a"). InnerVolumeSpecName "kube-api-access-nt5gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:22.519769 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.519731    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9336cc-8024-4131-b254-1c10a411b35a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "db9336cc-8024-4131-b254-1c10a411b35a" (UID: "db9336cc-8024-4131-b254-1c10a411b35a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:52:22.608341 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.608300    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt5gb\" (UniqueName: \"kubernetes.io/projected/db9336cc-8024-4131-b254-1c10a411b35a-kube-api-access-nt5gb\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:52:22.608341 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.608330    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db9336cc-8024-4131-b254-1c10a411b35a-tls-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:52:22.975254 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.975214    2564 generic.go:356] "Generic (PLEG): container finished" podID="db9336cc-8024-4131-b254-1c10a411b35a" containerID="29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f" exitCode=0
Jul 24 17:52:22.975739 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.975386    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn"
Jul 24 17:52:22.975739 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.975437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn" event={"ID":"db9336cc-8024-4131-b254-1c10a411b35a","Type":"ContainerDied","Data":"29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f"}
Jul 24 17:52:22.975739 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.975474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f57cdbc6-qj6hn" event={"ID":"db9336cc-8024-4131-b254-1c10a411b35a","Type":"ContainerDied","Data":"54b22b5096958fb8b6057695754ef49364c92cf2cd24580293665ff0d6c13cf4"}
Jul 24 17:52:22.975739 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.975504    2564 scope.go:117] "RemoveContainer" containerID="29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f"
Jul 24 17:52:22.989190 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.989165    2564 scope.go:117] "RemoveContainer" containerID="29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f"
Jul 24 17:52:22.989478 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:52:22.989460    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f\": container with ID starting with 29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f not found: ID does not exist" containerID="29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f"
Jul 24 17:52:22.989553 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:22.989484    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f"} err="failed to get container status \"29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f\": rpc error: code = NotFound desc = could not find container \"29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f\": container with ID starting with 29e4220a837ded83c37bca6db5fc230419255b885456cbb7f93105c145436a7f not found: ID does not exist"
Jul 24 17:52:23.006052 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:23.005995    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f57cdbc6-qj6hn"]
Jul 24 17:52:23.008701 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:23.008676    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58f57cdbc6-qj6hn"]
Jul 24 17:52:23.461860 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:52:23.461819    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9336cc-8024-4131-b254-1c10a411b35a" path="/var/lib/kubelet/pods/db9336cc-8024-4131-b254-1c10a411b35a/volumes"
Jul 24 17:53:10.504414 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.504312    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4bb4965f-hhqd5"]
Jul 24 17:53:10.504924 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.504562    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d4bb4965f-hhqd5" podUID="14e7d830-f7af-428b-914f-089328e82115" containerName="manager" containerID="cri-o://c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8" gracePeriod=30
Jul 24 17:53:10.762254 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.762191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:53:10.876004 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.875967    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v7hz\" (UniqueName: \"kubernetes.io/projected/14e7d830-f7af-428b-914f-089328e82115-kube-api-access-9v7hz\") pod \"14e7d830-f7af-428b-914f-089328e82115\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") "
Jul 24 17:53:10.876208 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.876186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e7d830-f7af-428b-914f-089328e82115-webhook-cert\") pod \"14e7d830-f7af-428b-914f-089328e82115\" (UID: \"14e7d830-f7af-428b-914f-089328e82115\") "
Jul 24 17:53:10.878018 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.877982    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e7d830-f7af-428b-914f-089328e82115-kube-api-access-9v7hz" (OuterVolumeSpecName: "kube-api-access-9v7hz") pod "14e7d830-f7af-428b-914f-089328e82115" (UID: "14e7d830-f7af-428b-914f-089328e82115"). InnerVolumeSpecName "kube-api-access-9v7hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:53:10.878196 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.878175    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14e7d830-f7af-428b-914f-089328e82115-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "14e7d830-f7af-428b-914f-089328e82115" (UID: "14e7d830-f7af-428b-914f-089328e82115"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:53:10.977592 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.977548    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e7d830-f7af-428b-914f-089328e82115-webhook-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:53:10.977592 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:10.977581    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v7hz\" (UniqueName: \"kubernetes.io/projected/14e7d830-f7af-428b-914f-089328e82115-kube-api-access-9v7hz\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:53:11.288556 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.288522    2564 generic.go:356] "Generic (PLEG): container finished" podID="14e7d830-f7af-428b-914f-089328e82115" containerID="c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8" exitCode=0
Jul 24 17:53:11.288735 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.288581    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4bb4965f-hhqd5" event={"ID":"14e7d830-f7af-428b-914f-089328e82115","Type":"ContainerDied","Data":"c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8"}
Jul 24 17:53:11.288735 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.288640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4bb4965f-hhqd5" event={"ID":"14e7d830-f7af-428b-914f-089328e82115","Type":"ContainerDied","Data":"3db48b5f4d927dc171660eeaeb0cac5a6eaac2942d7a9e60c4b96503fdb69c50"}
Jul 24 17:53:11.288735 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.288666    2564 scope.go:117] "RemoveContainer" containerID="c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8"
Jul 24 17:53:11.288735 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.288588    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4bb4965f-hhqd5"
Jul 24 17:53:11.299153 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.299135    2564 scope.go:117] "RemoveContainer" containerID="c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8"
Jul 24 17:53:11.299464 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:53:11.299443    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8\": container with ID starting with c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8 not found: ID does not exist" containerID="c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8"
Jul 24 17:53:11.299517 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.299473    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8"} err="failed to get container status \"c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8\": rpc error: code = NotFound desc = could not find container \"c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8\": container with ID starting with c33a5572983569caf708d18fec99bbd2e92f297bf55dbd4e6304e049709688b8 not found: ID does not exist"
Jul 24 17:53:11.311984 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.311947    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4bb4965f-hhqd5"]
Jul 24 17:53:11.315500 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.315468    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d4bb4965f-hhqd5"]
Jul 24 17:53:11.461475 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:53:11.461443    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e7d830-f7af-428b-914f-089328e82115" path="/var/lib/kubelet/pods/14e7d830-f7af-428b-914f-089328e82115/volumes"
Jul 24 17:59:26.680508 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:26.680425    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"]
Jul 24 17:59:26.681085 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:26.680655    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f" podUID="e2ab6486-8552-4fe9-8e97-3b4491d68296" containerName="manager" containerID="cri-o://b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0" gracePeriod=10
Jul 24 17:59:29.543822 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.543797    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:59:29.549661 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.549637    2564 generic.go:356] "Generic (PLEG): container finished" podID="e2ab6486-8552-4fe9-8e97-3b4491d68296" containerID="b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0" exitCode=0
Jul 24 17:59:29.549826 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.549669    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"
Jul 24 17:59:29.549826 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.549689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f" event={"ID":"e2ab6486-8552-4fe9-8e97-3b4491d68296","Type":"ContainerDied","Data":"b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0"}
Jul 24 17:59:29.549826 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.549748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f" event={"ID":"e2ab6486-8552-4fe9-8e97-3b4491d68296","Type":"ContainerDied","Data":"d906305fe8506ac391b9b3c10c834b4cf23577175db53e90ca0455c051f21fc3"}
Jul 24 17:59:29.549826 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.549779    2564 scope.go:117] "RemoveContainer" containerID="b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0"
Jul 24 17:59:29.560281 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.560262    2564 scope.go:117] "RemoveContainer" containerID="b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0"
Jul 24 17:59:29.560542 ip-10-0-139-114 kubenswrapper[2564]: E0724 17:59:29.560525    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0\": container with ID starting with b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0 not found: ID does not exist" containerID="b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0"
Jul 24 17:59:29.560588 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.560550    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0"} err="failed to get container status \"b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0\": rpc error: code = NotFound desc = could not find container \"b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0\": container with ID starting with b2b708226e88e13e749fec669c887d3a749fcfa1a66168d4c9076d410cda5af0 not found: ID does not exist"
Jul 24 17:59:29.697492 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.697462    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxcqx\" (UniqueName: \"kubernetes.io/projected/e2ab6486-8552-4fe9-8e97-3b4491d68296-kube-api-access-jxcqx\") pod \"e2ab6486-8552-4fe9-8e97-3b4491d68296\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") "
Jul 24 17:59:29.697648 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.697541    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ab6486-8552-4fe9-8e97-3b4491d68296-extensions-socket-volume\") pod \"e2ab6486-8552-4fe9-8e97-3b4491d68296\" (UID: \"e2ab6486-8552-4fe9-8e97-3b4491d68296\") "
Jul 24 17:59:29.697896 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.697867    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ab6486-8552-4fe9-8e97-3b4491d68296-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e2ab6486-8552-4fe9-8e97-3b4491d68296" (UID: "e2ab6486-8552-4fe9-8e97-3b4491d68296"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:59:29.699453 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.699429    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ab6486-8552-4fe9-8e97-3b4491d68296-kube-api-access-jxcqx" (OuterVolumeSpecName: "kube-api-access-jxcqx") pod "e2ab6486-8552-4fe9-8e97-3b4491d68296" (UID: "e2ab6486-8552-4fe9-8e97-3b4491d68296"). InnerVolumeSpecName "kube-api-access-jxcqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:59:29.798509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.798470    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxcqx\" (UniqueName: \"kubernetes.io/projected/e2ab6486-8552-4fe9-8e97-3b4491d68296-kube-api-access-jxcqx\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:59:29.798509 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.798504    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ab6486-8552-4fe9-8e97-3b4491d68296-extensions-socket-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 17:59:29.873598 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.873568    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"]
Jul 24 17:59:29.877303 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:29.877274    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6m55f"]
Jul 24 17:59:31.461065 ip-10-0-139-114 kubenswrapper[2564]: I0724 17:59:31.461018    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ab6486-8552-4fe9-8e97-3b4491d68296" path="/var/lib/kubelet/pods/e2ab6486-8552-4fe9-8e97-3b4491d68296/volumes"
Jul 24 18:00:00.163203 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163164    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"]
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163604    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ab6486-8552-4fe9-8e97-3b4491d68296" containerName="manager"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163615    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ab6486-8552-4fe9-8e97-3b4491d68296" containerName="manager"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163625    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9336cc-8024-4131-b254-1c10a411b35a" containerName="authorino"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163630    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9336cc-8024-4131-b254-1c10a411b35a" containerName="authorino"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163650    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e7d830-f7af-428b-914f-089328e82115" containerName="manager"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163654    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e7d830-f7af-428b-914f-089328e82115" containerName="manager"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163716    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ab6486-8552-4fe9-8e97-3b4491d68296" containerName="manager"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163725    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9336cc-8024-4131-b254-1c10a411b35a" containerName="authorino"
Jul 24 18:00:00.163992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.163732    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e7d830-f7af-428b-914f-089328e82115" containerName="manager"
Jul 24 18:00:00.168142 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.168125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"
Jul 24 18:00:00.174004 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.173981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:00:00.178132 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.178106    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"]
Jul 24 18:00:00.179470 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.179450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"
Jul 24 18:00:00.527092 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.527067    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"]
Jul 24 18:00:00.528781 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:00:00.528754    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830bdcb7_8153_42d1_949f_c52919631d77.slice/crio-3208dd4b16407751a09269575794843b56b862e01b98503f8f15739cc7108b8e WatchSource:0}: Error finding container 3208dd4b16407751a09269575794843b56b862e01b98503f8f15739cc7108b8e: Status 404 returned error can't find the container with id 3208dd4b16407751a09269575794843b56b862e01b98503f8f15739cc7108b8e
Jul 24 18:00:00.530681 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.530661    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:00:00.727798 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:00.727763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq" event={"ID":"830bdcb7-8153-42d1-949f-c52919631d77","Type":"ContainerStarted","Data":"3208dd4b16407751a09269575794843b56b862e01b98503f8f15739cc7108b8e"}
Jul 24 18:00:03.748253 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:03.748220    2564 generic.go:356] "Generic (PLEG): container finished" podID="830bdcb7-8153-42d1-949f-c52919631d77" containerID="54d66629b87c10a90edd7a15b11bbe7ab27d4a70c24b01cdedba9215f7ecf197" exitCode=0
Jul 24 18:00:03.748612 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:03.748260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq" event={"ID":"830bdcb7-8153-42d1-949f-c52919631d77","Type":"ContainerDied","Data":"54d66629b87c10a90edd7a15b11bbe7ab27d4a70c24b01cdedba9215f7ecf197"}
Jul 24 18:00:04.889696 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:04.889671    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"
Jul 24 18:00:05.761388 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:05.761305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq"
Jul 24 18:00:05.761388 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:05.761313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748600-4bgnq" event={"ID":"830bdcb7-8153-42d1-949f-c52919631d77","Type":"ContainerDied","Data":"3208dd4b16407751a09269575794843b56b862e01b98503f8f15739cc7108b8e"}
Jul 24 18:00:05.761388 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:05.761390    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3208dd4b16407751a09269575794843b56b862e01b98503f8f15739cc7108b8e"
Jul 24 18:00:27.816079 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.816013    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"]
Jul 24 18:00:27.816535 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.816505    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="830bdcb7-8153-42d1-949f-c52919631d77" containerName="cleanup"
Jul 24 18:00:27.816535 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.816518    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="830bdcb7-8153-42d1-949f-c52919631d77" containerName="cleanup"
Jul 24 18:00:27.816609 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.816594    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="830bdcb7-8153-42d1-949f-c52919631d77" containerName="cleanup"
Jul 24 18:00:27.819573 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.819557    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:27.822442 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.822418    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hl7tc\""
Jul 24 18:00:27.829651 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.829627    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"]
Jul 24 18:00:27.848989 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.848942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd7fa903-f272-4d77-96ee-6088a62bdc3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n8cbw\" (UID: \"cd7fa903-f272-4d77-96ee-6088a62bdc3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:27.849183 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.849003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcmp2\" (UniqueName: \"kubernetes.io/projected/cd7fa903-f272-4d77-96ee-6088a62bdc3a-kube-api-access-zcmp2\") pod \"kuadrant-operator-controller-manager-86878c769f-n8cbw\" (UID: \"cd7fa903-f272-4d77-96ee-6088a62bdc3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:27.949841 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.949808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcmp2\" (UniqueName: \"kubernetes.io/projected/cd7fa903-f272-4d77-96ee-6088a62bdc3a-kube-api-access-zcmp2\") pod \"kuadrant-operator-controller-manager-86878c769f-n8cbw\" (UID: \"cd7fa903-f272-4d77-96ee-6088a62bdc3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:27.950009 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.949958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd7fa903-f272-4d77-96ee-6088a62bdc3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n8cbw\" (UID: \"cd7fa903-f272-4d77-96ee-6088a62bdc3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:27.950350 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.950331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd7fa903-f272-4d77-96ee-6088a62bdc3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n8cbw\" (UID: \"cd7fa903-f272-4d77-96ee-6088a62bdc3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:27.958658 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:27.958640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcmp2\" (UniqueName: \"kubernetes.io/projected/cd7fa903-f272-4d77-96ee-6088a62bdc3a-kube-api-access-zcmp2\") pod \"kuadrant-operator-controller-manager-86878c769f-n8cbw\" (UID: \"cd7fa903-f272-4d77-96ee-6088a62bdc3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:28.130230 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:28.130142    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:28.283866 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:28.283835    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"]
Jul 24 18:00:28.284627 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:00:28.284604    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7fa903_f272_4d77_96ee_6088a62bdc3a.slice/crio-b78ecf23b4dc27ba062ef2520c773f1b1c6f0cbf1894fb122e437f5d9d7247be WatchSource:0}: Error finding container b78ecf23b4dc27ba062ef2520c773f1b1c6f0cbf1894fb122e437f5d9d7247be: Status 404 returned error can't find the container with id b78ecf23b4dc27ba062ef2520c773f1b1c6f0cbf1894fb122e437f5d9d7247be
Jul 24 18:00:28.890575 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:28.890533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw" event={"ID":"cd7fa903-f272-4d77-96ee-6088a62bdc3a","Type":"ContainerStarted","Data":"7dd821c989075926c14a5deaed8bb542c90e98cbd036fc8e880a9f2bdccd15a3"}
Jul 24 18:00:28.890964 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:28.890694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:00:28.890964 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:28.890746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw" event={"ID":"cd7fa903-f272-4d77-96ee-6088a62bdc3a","Type":"ContainerStarted","Data":"b78ecf23b4dc27ba062ef2520c773f1b1c6f0cbf1894fb122e437f5d9d7247be"}
Jul 24 18:00:28.915262 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:28.915210    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw" podStartSLOduration=1.915193868 podStartE2EDuration="1.915193868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:00:28.913209912 +0000 UTC m=+1427.945590271" watchObservedRunningTime="2026-07-24 18:00:28.915193868 +0000 UTC m=+1427.947574295"
Jul 24 18:00:39.899121 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:00:39.899089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n8cbw"
Jul 24 18:07:39.255058 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.255009    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"]
Jul 24 18:07:39.258781 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.258746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.261579 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.261554    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d49fe598-dockercfg-qxq6d\""
Jul 24 18:07:39.261706 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.261629    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d49fe598\""
Jul 24 18:07:39.279843 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.279808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"]
Jul 24 18:07:39.398186 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.398150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spp4f\" (UniqueName: \"kubernetes.io/projected/019b1175-9749-4f6e-8177-365e08e95ad3-kube-api-access-spp4f\") pod \"payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") " pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.398453 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.398430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/019b1175-9749-4f6e-8177-365e08e95ad3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") " pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.499161 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.499128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp4f\" (UniqueName: \"kubernetes.io/projected/019b1175-9749-4f6e-8177-365e08e95ad3-kube-api-access-spp4f\") pod \"payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") " pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.499368 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.499172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/019b1175-9749-4f6e-8177-365e08e95ad3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") " pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.499953 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.499930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/019b1175-9749-4f6e-8177-365e08e95ad3-plugins-config-volume\") pod \"payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") " pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.509210 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.509142    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spp4f\" (UniqueName: \"kubernetes.io/projected/019b1175-9749-4f6e-8177-365e08e95ad3-kube-api-access-spp4f\") pod \"payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") " pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.571046 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.570998    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:39.714947 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:39.714926    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"]
Jul 24 18:07:39.717066 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:07:39.717037    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019b1175_9749_4f6e_8177_365e08e95ad3.slice/crio-eb60f33d11e1e7ff707df225fd02dc17755dca9926adfbec49e1fe0b61a1e0db WatchSource:0}: Error finding container eb60f33d11e1e7ff707df225fd02dc17755dca9926adfbec49e1fe0b61a1e0db: Status 404 returned error can't find the container with id eb60f33d11e1e7ff707df225fd02dc17755dca9926adfbec49e1fe0b61a1e0db
Jul 24 18:07:40.493107 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:40.493065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll" event={"ID":"019b1175-9749-4f6e-8177-365e08e95ad3","Type":"ContainerStarted","Data":"0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9"}
Jul 24 18:07:40.493575 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:40.493123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll" event={"ID":"019b1175-9749-4f6e-8177-365e08e95ad3","Type":"ContainerStarted","Data":"eb60f33d11e1e7ff707df225fd02dc17755dca9926adfbec49e1fe0b61a1e0db"}
Jul 24 18:07:40.493575 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:40.493144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:07:40.513228 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:40.513169    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll" podStartSLOduration=1.513148954 podStartE2EDuration="1.513148954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:07:40.512046242 +0000 UTC m=+1859.544426599" watchObservedRunningTime="2026-07-24 18:07:40.513148954 +0000 UTC m=+1859.545529314"
Jul 24 18:07:51.501852 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:07:51.501823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:08:03.999005 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:03.998918    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"]
Jul 24 18:08:04.003103 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.003080    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:04.005812 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.005789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:08:04.010482 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.010453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"]
Jul 24 18:08:04.141887 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.141849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d74f6a69-0d4f-4717-baed-de1fb8b91002-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq\" (UID: \"d74f6a69-0d4f-4717-baed-de1fb8b91002\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:04.242627 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.242581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d74f6a69-0d4f-4717-baed-de1fb8b91002-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq\" (UID: \"d74f6a69-0d4f-4717-baed-de1fb8b91002\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:04.243315 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.243290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d74f6a69-0d4f-4717-baed-de1fb8b91002-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq\" (UID: \"d74f6a69-0d4f-4717-baed-de1fb8b91002\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:04.316654 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.316567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:04.462479 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.462448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"]
Jul 24 18:08:04.463557 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:08:04.463533    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74f6a69_0d4f_4717_baed_de1fb8b91002.slice/crio-66669bf0a680063e26099003f03aae2efdc44927d674ad8ffb9e38372acfb295 WatchSource:0}: Error finding container 66669bf0a680063e26099003f03aae2efdc44927d674ad8ffb9e38372acfb295: Status 404 returned error can't find the container with id 66669bf0a680063e26099003f03aae2efdc44927d674ad8ffb9e38372acfb295
Jul 24 18:08:04.634582 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:04.634491    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq" event={"ID":"d74f6a69-0d4f-4717-baed-de1fb8b91002","Type":"ContainerStarted","Data":"66669bf0a680063e26099003f03aae2efdc44927d674ad8ffb9e38372acfb295"}
Jul 24 18:08:05.642225 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:05.642190    2564 generic.go:356] "Generic (PLEG): container finished" podID="d74f6a69-0d4f-4717-baed-de1fb8b91002" containerID="7ddc2cf628947de59530042560aec0168417f586714b8eb9cc335e7f68394e99" exitCode=0
Jul 24 18:08:05.642622 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:05.642272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq" event={"ID":"d74f6a69-0d4f-4717-baed-de1fb8b91002","Type":"ContainerDied","Data":"7ddc2cf628947de59530042560aec0168417f586714b8eb9cc335e7f68394e99"}
Jul 24 18:08:06.790929 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:06.790901    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:06.867736 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:06.867692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d74f6a69-0d4f-4717-baed-de1fb8b91002-maas-api-service-ca\") pod \"d74f6a69-0d4f-4717-baed-de1fb8b91002\" (UID: \"d74f6a69-0d4f-4717-baed-de1fb8b91002\") "
Jul 24 18:08:06.868104 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:06.868082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74f6a69-0d4f-4717-baed-de1fb8b91002-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d74f6a69-0d4f-4717-baed-de1fb8b91002" (UID: "d74f6a69-0d4f-4717-baed-de1fb8b91002"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:08:06.969059 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:06.968946    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d74f6a69-0d4f-4717-baed-de1fb8b91002-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:08:07.655249 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:07.655222    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"
Jul 24 18:08:07.655427 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:07.655261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq" event={"ID":"d74f6a69-0d4f-4717-baed-de1fb8b91002","Type":"ContainerDied","Data":"66669bf0a680063e26099003f03aae2efdc44927d674ad8ffb9e38372acfb295"}
Jul 24 18:08:07.655427 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:07.655305    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66669bf0a680063e26099003f03aae2efdc44927d674ad8ffb9e38372acfb295"
Jul 24 18:08:14.653698 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:14.653662    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"]
Jul 24 18:08:14.654263 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:14.653936    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll" podUID="019b1175-9749-4f6e-8177-365e08e95ad3" containerName="payload-processing" containerID="cri-o://0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9" gracePeriod=30
Jul 24 18:08:14.914171 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:14.914111    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:08:15.049969 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.049935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/019b1175-9749-4f6e-8177-365e08e95ad3-plugins-config-volume\") pod \"019b1175-9749-4f6e-8177-365e08e95ad3\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") "
Jul 24 18:08:15.049969 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.049974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spp4f\" (UniqueName: \"kubernetes.io/projected/019b1175-9749-4f6e-8177-365e08e95ad3-kube-api-access-spp4f\") pod \"019b1175-9749-4f6e-8177-365e08e95ad3\" (UID: \"019b1175-9749-4f6e-8177-365e08e95ad3\") "
Jul 24 18:08:15.050335 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.050313    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/019b1175-9749-4f6e-8177-365e08e95ad3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "019b1175-9749-4f6e-8177-365e08e95ad3" (UID: "019b1175-9749-4f6e-8177-365e08e95ad3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:08:15.052141 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.052105    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019b1175-9749-4f6e-8177-365e08e95ad3-kube-api-access-spp4f" (OuterVolumeSpecName: "kube-api-access-spp4f") pod "019b1175-9749-4f6e-8177-365e08e95ad3" (UID: "019b1175-9749-4f6e-8177-365e08e95ad3"). InnerVolumeSpecName "kube-api-access-spp4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:08:15.150982 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.150947    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/019b1175-9749-4f6e-8177-365e08e95ad3-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:08:15.150982 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.150975    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spp4f\" (UniqueName: \"kubernetes.io/projected/019b1175-9749-4f6e-8177-365e08e95ad3-kube-api-access-spp4f\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:08:15.714655 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.714612    2564 generic.go:356] "Generic (PLEG): container finished" podID="019b1175-9749-4f6e-8177-365e08e95ad3" containerID="0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9" exitCode=0
Jul 24 18:08:15.715072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.714685    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"
Jul 24 18:08:15.715072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.714702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll" event={"ID":"019b1175-9749-4f6e-8177-365e08e95ad3","Type":"ContainerDied","Data":"0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9"}
Jul 24 18:08:15.715072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.714779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll" event={"ID":"019b1175-9749-4f6e-8177-365e08e95ad3","Type":"ContainerDied","Data":"eb60f33d11e1e7ff707df225fd02dc17755dca9926adfbec49e1fe0b61a1e0db"}
Jul 24 18:08:15.715072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.714803    2564 scope.go:117] "RemoveContainer" containerID="0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9"
Jul 24 18:08:15.724417 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.724395    2564 scope.go:117] "RemoveContainer" containerID="0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9"
Jul 24 18:08:15.724672 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:08:15.724655    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9\": container with ID starting with 0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9 not found: ID does not exist" containerID="0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9"
Jul 24 18:08:15.724725 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.724678    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9"} err="failed to get container status \"0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9\": rpc error: code = NotFound desc = could not find container \"0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9\": container with ID starting with 0926de59f05fafa3dbf6970e5e7afa459ba2dd4bbd13fb8e9b2ce8ceb96330f9 not found: ID does not exist"
Jul 24 18:08:15.735227 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.735202    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"]
Jul 24 18:08:15.741658 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:15.741636    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d49fe598-78dc566888-ch2ll"]
Jul 24 18:08:17.461082 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:17.461049    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="019b1175-9749-4f6e-8177-365e08e95ad3" path="/var/lib/kubelet/pods/019b1175-9749-4f6e-8177-365e08e95ad3/volumes"
Jul 24 18:08:19.081807 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:19.081769    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"]
Jul 24 18:08:19.084428 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:19.084402    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d49fe598-9rtqq"]
Jul 24 18:08:19.461005 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:19.460972    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74f6a69-0d4f-4717-baed-de1fb8b91002" path="/var/lib/kubelet/pods/d74f6a69-0d4f-4717-baed-de1fb8b91002/volumes"
Jul 24 18:08:23.502603 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.502561    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"]
Jul 24 18:08:23.503300 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.503282    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74f6a69-0d4f-4717-baed-de1fb8b91002" containerName="revoke-keys"
Jul 24 18:08:23.503363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.503303    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74f6a69-0d4f-4717-baed-de1fb8b91002" containerName="revoke-keys"
Jul 24 18:08:23.503363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.503332    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019b1175-9749-4f6e-8177-365e08e95ad3" containerName="payload-processing"
Jul 24 18:08:23.503363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.503342    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="019b1175-9749-4f6e-8177-365e08e95ad3" containerName="payload-processing"
Jul 24 18:08:23.503464 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.503454    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="019b1175-9749-4f6e-8177-365e08e95ad3" containerName="payload-processing"
Jul 24 18:08:23.503499 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.503470    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74f6a69-0d4f-4717-baed-de1fb8b91002" containerName="revoke-keys"
Jul 24 18:08:23.507961 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.507941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.511201 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.511176    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-23b920dc\""
Jul 24 18:08:23.511331 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.511281    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-23b920dc-dockercfg-rb2vz\""
Jul 24 18:08:23.513912 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.513890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"]
Jul 24 18:08:23.526225 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.526199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85afe086-0d99-4690-855b-b167308728e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.526410 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.526387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccc4r\" (UniqueName: \"kubernetes.io/projected/85afe086-0d99-4690-855b-b167308728e2-kube-api-access-ccc4r\") pod \"payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.627567 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.627526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85afe086-0d99-4690-855b-b167308728e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.627782 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.627634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccc4r\" (UniqueName: \"kubernetes.io/projected/85afe086-0d99-4690-855b-b167308728e2-kube-api-access-ccc4r\") pod \"payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.628362 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.628335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85afe086-0d99-4690-855b-b167308728e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.635663 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.635640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccc4r\" (UniqueName: \"kubernetes.io/projected/85afe086-0d99-4690-855b-b167308728e2-kube-api-access-ccc4r\") pod \"payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.820004 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.819925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:23.962001 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:23.961973    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"]
Jul 24 18:08:23.963688 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:08:23.963665    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85afe086_0d99_4690_855b_b167308728e2.slice/crio-3201b4a46fab6d0c643f2cb72254e7da08c54f6d643b704f22ccff97e906c8d2 WatchSource:0}: Error finding container 3201b4a46fab6d0c643f2cb72254e7da08c54f6d643b704f22ccff97e906c8d2: Status 404 returned error can't find the container with id 3201b4a46fab6d0c643f2cb72254e7da08c54f6d643b704f22ccff97e906c8d2
Jul 24 18:08:24.772352 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:24.772304    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj" event={"ID":"85afe086-0d99-4690-855b-b167308728e2","Type":"ContainerStarted","Data":"51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5"}
Jul 24 18:08:24.772797 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:24.772451    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:24.772797 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:24.772502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj" event={"ID":"85afe086-0d99-4690-855b-b167308728e2","Type":"ContainerStarted","Data":"3201b4a46fab6d0c643f2cb72254e7da08c54f6d643b704f22ccff97e906c8d2"}
Jul 24 18:08:24.793902 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:24.793851    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj" podStartSLOduration=1.793836113 podStartE2EDuration="1.793836113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:08:24.790904664 +0000 UTC m=+1903.823285059" watchObservedRunningTime="2026-07-24 18:08:24.793836113 +0000 UTC m=+1903.826216473"
Jul 24 18:08:35.779751 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:35.779714    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:58.423620 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.423584    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"]
Jul 24 18:08:58.424317 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.423854    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj" podUID="85afe086-0d99-4690-855b-b167308728e2" containerName="payload-processing" containerID="cri-o://51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5" gracePeriod=30
Jul 24 18:08:58.690150 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.690075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:58.784386 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.784353    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccc4r\" (UniqueName: \"kubernetes.io/projected/85afe086-0d99-4690-855b-b167308728e2-kube-api-access-ccc4r\") pod \"85afe086-0d99-4690-855b-b167308728e2\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") "
Jul 24 18:08:58.784557 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.784436    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85afe086-0d99-4690-855b-b167308728e2-plugins-config-volume\") pod \"85afe086-0d99-4690-855b-b167308728e2\" (UID: \"85afe086-0d99-4690-855b-b167308728e2\") "
Jul 24 18:08:58.784854 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.784822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85afe086-0d99-4690-855b-b167308728e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85afe086-0d99-4690-855b-b167308728e2" (UID: "85afe086-0d99-4690-855b-b167308728e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:08:58.786425 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.786391    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85afe086-0d99-4690-855b-b167308728e2-kube-api-access-ccc4r" (OuterVolumeSpecName: "kube-api-access-ccc4r") pod "85afe086-0d99-4690-855b-b167308728e2" (UID: "85afe086-0d99-4690-855b-b167308728e2"). InnerVolumeSpecName "kube-api-access-ccc4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:08:58.885565 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.885530    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccc4r\" (UniqueName: \"kubernetes.io/projected/85afe086-0d99-4690-855b-b167308728e2-kube-api-access-ccc4r\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:08:58.885565 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.885558    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85afe086-0d99-4690-855b-b167308728e2-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:08:58.975895 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.975803    2564 generic.go:356] "Generic (PLEG): container finished" podID="85afe086-0d99-4690-855b-b167308728e2" containerID="51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5" exitCode=0
Jul 24 18:08:58.975895 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.975855    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"
Jul 24 18:08:58.975895 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.975877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj" event={"ID":"85afe086-0d99-4690-855b-b167308728e2","Type":"ContainerDied","Data":"51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5"}
Jul 24 18:08:58.976200 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.975921    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj" event={"ID":"85afe086-0d99-4690-855b-b167308728e2","Type":"ContainerDied","Data":"3201b4a46fab6d0c643f2cb72254e7da08c54f6d643b704f22ccff97e906c8d2"}
Jul 24 18:08:58.976200 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.975943    2564 scope.go:117] "RemoveContainer" containerID="51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5"
Jul 24 18:08:58.986000 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.985983    2564 scope.go:117] "RemoveContainer" containerID="51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5"
Jul 24 18:08:58.986344 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:08:58.986315    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5\": container with ID starting with 51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5 not found: ID does not exist" containerID="51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5"
Jul 24 18:08:58.986408 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:58.986355    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5"} err="failed to get container status \"51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5\": rpc error: code = NotFound desc = could not find container \"51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5\": container with ID starting with 51332b6e7cb5a512eb6a19ae00daff0644c6ac853afaf301d88dce6cd36eacf5 not found: ID does not exist"
Jul 24 18:08:59.001563 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:59.001520    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"]
Jul 24 18:08:59.004923 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:59.004885    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-23b920dc-69765b4757-nsbvj"]
Jul 24 18:08:59.468002 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:08:59.467973    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85afe086-0d99-4690-855b-b167308728e2" path="/var/lib/kubelet/pods/85afe086-0d99-4690-855b-b167308728e2/volumes"
Jul 24 18:09:06.915136 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.915099    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"]
Jul 24 18:09:06.915558 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.915545    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85afe086-0d99-4690-855b-b167308728e2" containerName="payload-processing"
Jul 24 18:09:06.915558 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.915558    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="85afe086-0d99-4690-855b-b167308728e2" containerName="payload-processing"
Jul 24 18:09:06.915635 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.915627    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="85afe086-0d99-4690-855b-b167308728e2" containerName="payload-processing"
Jul 24 18:09:06.919958 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.919939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:06.922479 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.922458    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b716847d\""
Jul 24 18:09:06.922479 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.922468    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b716847d-dockercfg-lknql\""
Jul 24 18:09:06.931063 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.931019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"]
Jul 24 18:09:06.967853 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.967825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5g7\" (UniqueName: \"kubernetes.io/projected/a6242ad3-74c0-4e73-a44c-1659e3c772d7-kube-api-access-tm5g7\") pod \"payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:06.968008 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:06.967879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6242ad3-74c0-4e73-a44c-1659e3c772d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:07.068436 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:07.068403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5g7\" (UniqueName: \"kubernetes.io/projected/a6242ad3-74c0-4e73-a44c-1659e3c772d7-kube-api-access-tm5g7\") pod \"payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:07.068611 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:07.068452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6242ad3-74c0-4e73-a44c-1659e3c772d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:07.069190 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:07.069172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6242ad3-74c0-4e73-a44c-1659e3c772d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:07.078812 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:07.078792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5g7\" (UniqueName: \"kubernetes.io/projected/a6242ad3-74c0-4e73-a44c-1659e3c772d7-kube-api-access-tm5g7\") pod \"payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:07.232315 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:07.232222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:07.370765 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:07.370736    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"]
Jul 24 18:09:07.372742 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:09:07.372715    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6242ad3_74c0_4e73_a44c_1659e3c772d7.slice/crio-c9089313e343cc52b50fcdc3bcf910809bab5bf949b3450efab3849ea8a05f1f WatchSource:0}: Error finding container c9089313e343cc52b50fcdc3bcf910809bab5bf949b3450efab3849ea8a05f1f: Status 404 returned error can't find the container with id c9089313e343cc52b50fcdc3bcf910809bab5bf949b3450efab3849ea8a05f1f
Jul 24 18:09:08.034102 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:08.034063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6" event={"ID":"a6242ad3-74c0-4e73-a44c-1659e3c772d7","Type":"ContainerStarted","Data":"9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6"}
Jul 24 18:09:08.034499 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:08.034121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6" event={"ID":"a6242ad3-74c0-4e73-a44c-1659e3c772d7","Type":"ContainerStarted","Data":"c9089313e343cc52b50fcdc3bcf910809bab5bf949b3450efab3849ea8a05f1f"}
Jul 24 18:09:08.034499 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:08.034148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:08.051609 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:08.051546    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6" podStartSLOduration=2.05153072 podStartE2EDuration="2.05153072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:09:08.050325815 +0000 UTC m=+1947.082706174" watchObservedRunningTime="2026-07-24 18:09:08.05153072 +0000 UTC m=+1947.083911083"
Jul 24 18:09:19.042940 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:19.042911    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:31.732212 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.732172    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"]
Jul 24 18:09:31.735965 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.735947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:31.738758 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.738736    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:09:31.748178 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.748155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"]
Jul 24 18:09:31.817482 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.817444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b937ea6e-b173-4246-b492-9fdb940280d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b716847d-6wmxd\" (UID: \"b937ea6e-b173-4246-b492-9fdb940280d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:31.918258 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.918217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b937ea6e-b173-4246-b492-9fdb940280d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b716847d-6wmxd\" (UID: \"b937ea6e-b173-4246-b492-9fdb940280d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:31.918826 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:31.918807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b937ea6e-b173-4246-b492-9fdb940280d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b716847d-6wmxd\" (UID: \"b937ea6e-b173-4246-b492-9fdb940280d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:32.048661 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:32.048574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:32.410322 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:32.410289    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"]
Jul 24 18:09:32.416627 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:09:32.416594    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb937ea6e_b173_4246_b492_9fdb940280d4.slice/crio-729f2c6d4ece7206e0aa5ff40c51b4411eef0a19f2043220dd107c32b2830640 WatchSource:0}: Error finding container 729f2c6d4ece7206e0aa5ff40c51b4411eef0a19f2043220dd107c32b2830640: Status 404 returned error can't find the container with id 729f2c6d4ece7206e0aa5ff40c51b4411eef0a19f2043220dd107c32b2830640
Jul 24 18:09:33.186491 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:33.186452    2564 generic.go:356] "Generic (PLEG): container finished" podID="b937ea6e-b173-4246-b492-9fdb940280d4" containerID="d5c24ff6be2ac7aaba14d0cb5dacd4257e70eabdf88c28fb3dfdb88137de1cc7" exitCode=0
Jul 24 18:09:33.186867 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:33.186488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd" event={"ID":"b937ea6e-b173-4246-b492-9fdb940280d4","Type":"ContainerDied","Data":"d5c24ff6be2ac7aaba14d0cb5dacd4257e70eabdf88c28fb3dfdb88137de1cc7"}
Jul 24 18:09:33.186867 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:33.186542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd" event={"ID":"b937ea6e-b173-4246-b492-9fdb940280d4","Type":"ContainerStarted","Data":"729f2c6d4ece7206e0aa5ff40c51b4411eef0a19f2043220dd107c32b2830640"}
Jul 24 18:09:34.337274 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:34.337248    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:34.444796 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:34.444710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b937ea6e-b173-4246-b492-9fdb940280d4-maas-api-service-ca\") pod \"b937ea6e-b173-4246-b492-9fdb940280d4\" (UID: \"b937ea6e-b173-4246-b492-9fdb940280d4\") "
Jul 24 18:09:34.445055 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:34.445020    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b937ea6e-b173-4246-b492-9fdb940280d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b937ea6e-b173-4246-b492-9fdb940280d4" (UID: "b937ea6e-b173-4246-b492-9fdb940280d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:09:34.546236 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:34.546200    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b937ea6e-b173-4246-b492-9fdb940280d4-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:09:35.199798 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:35.199771    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"
Jul 24 18:09:35.199976 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:35.199801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd" event={"ID":"b937ea6e-b173-4246-b492-9fdb940280d4","Type":"ContainerDied","Data":"729f2c6d4ece7206e0aa5ff40c51b4411eef0a19f2043220dd107c32b2830640"}
Jul 24 18:09:35.199976 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:35.199845    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="729f2c6d4ece7206e0aa5ff40c51b4411eef0a19f2043220dd107c32b2830640"
Jul 24 18:09:42.248178 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.248142    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"]
Jul 24 18:09:42.248664 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.248391    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6" podUID="a6242ad3-74c0-4e73-a44c-1659e3c772d7" containerName="payload-pre-processing" containerID="cri-o://9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6" gracePeriod=30
Jul 24 18:09:42.517761 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.517734    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:42.626217 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.626186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm5g7\" (UniqueName: \"kubernetes.io/projected/a6242ad3-74c0-4e73-a44c-1659e3c772d7-kube-api-access-tm5g7\") pod \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") "
Jul 24 18:09:42.626386 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.626254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6242ad3-74c0-4e73-a44c-1659e3c772d7-plugins-config-volume\") pod \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\" (UID: \"a6242ad3-74c0-4e73-a44c-1659e3c772d7\") "
Jul 24 18:09:42.626646 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.626623    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6242ad3-74c0-4e73-a44c-1659e3c772d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6242ad3-74c0-4e73-a44c-1659e3c772d7" (UID: "a6242ad3-74c0-4e73-a44c-1659e3c772d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:09:42.628368 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.628344    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6242ad3-74c0-4e73-a44c-1659e3c772d7-kube-api-access-tm5g7" (OuterVolumeSpecName: "kube-api-access-tm5g7") pod "a6242ad3-74c0-4e73-a44c-1659e3c772d7" (UID: "a6242ad3-74c0-4e73-a44c-1659e3c772d7"). InnerVolumeSpecName "kube-api-access-tm5g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:09:42.727624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.727580    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm5g7\" (UniqueName: \"kubernetes.io/projected/a6242ad3-74c0-4e73-a44c-1659e3c772d7-kube-api-access-tm5g7\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.727624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:42.727621    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6242ad3-74c0-4e73-a44c-1659e3c772d7-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:09:43.252083 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.252018    2564 generic.go:356] "Generic (PLEG): container finished" podID="a6242ad3-74c0-4e73-a44c-1659e3c772d7" containerID="9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6" exitCode=0
Jul 24 18:09:43.252083 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.252083    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"
Jul 24 18:09:43.252537 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.252131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6" event={"ID":"a6242ad3-74c0-4e73-a44c-1659e3c772d7","Type":"ContainerDied","Data":"9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6"}
Jul 24 18:09:43.252537 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.252184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6" event={"ID":"a6242ad3-74c0-4e73-a44c-1659e3c772d7","Type":"ContainerDied","Data":"c9089313e343cc52b50fcdc3bcf910809bab5bf949b3450efab3849ea8a05f1f"}
Jul 24 18:09:43.252537 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.252209    2564 scope.go:117] "RemoveContainer" containerID="9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6"
Jul 24 18:09:43.261775 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.261759    2564 scope.go:117] "RemoveContainer" containerID="9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6"
Jul 24 18:09:43.262050 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:09:43.262015    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6\": container with ID starting with 9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6 not found: ID does not exist" containerID="9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6"
Jul 24 18:09:43.262105 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.262059    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6"} err="failed to get container status \"9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6\": rpc error: code = NotFound desc = could not find container \"9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6\": container with ID starting with 9f17558a658ef8817ec3d6644fa4c95917bde3bb8dc2883e3d5440f8b3e5e6e6 not found: ID does not exist"
Jul 24 18:09:43.275011 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.274984    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"]
Jul 24 18:09:43.278365 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.278341    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b716847d-748cdc69d8-pfss6"]
Jul 24 18:09:43.467563 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:43.461094    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6242ad3-74c0-4e73-a44c-1659e3c772d7" path="/var/lib/kubelet/pods/a6242ad3-74c0-4e73-a44c-1659e3c772d7/volumes"
Jul 24 18:09:46.808538 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:46.808503    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"]
Jul 24 18:09:46.811005 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:46.810981    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b716847d-6wmxd"]
Jul 24 18:09:47.461046 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:47.461004    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b937ea6e-b173-4246-b492-9fdb940280d4" path="/var/lib/kubelet/pods/b937ea6e-b173-4246-b492-9fdb940280d4/volumes"
Jul 24 18:09:51.865017 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.864975    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"]
Jul 24 18:09:51.865513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.865429    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b937ea6e-b173-4246-b492-9fdb940280d4" containerName="revoke-keys"
Jul 24 18:09:51.865513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.865442    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b937ea6e-b173-4246-b492-9fdb940280d4" containerName="revoke-keys"
Jul 24 18:09:51.865513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.865463    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6242ad3-74c0-4e73-a44c-1659e3c772d7" containerName="payload-pre-processing"
Jul 24 18:09:51.865513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.865468    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6242ad3-74c0-4e73-a44c-1659e3c772d7" containerName="payload-pre-processing"
Jul 24 18:09:51.865750 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.865533    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b937ea6e-b173-4246-b492-9fdb940280d4" containerName="revoke-keys"
Jul 24 18:09:51.865750 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.865541    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6242ad3-74c0-4e73-a44c-1659e3c772d7" containerName="payload-pre-processing"
Jul 24 18:09:51.868630 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.868606    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:51.871456 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.871434    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-7a6fbc6b-dockercfg-8bk9b\""
Jul 24 18:09:51.871456 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.871446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-7a6fbc6b\""
Jul 24 18:09:51.878134 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:51.878112    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"]
Jul 24 18:09:52.034096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.034054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjv8h\" (UniqueName: \"kubernetes.io/projected/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-kube-api-access-zjv8h\") pod \"payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") " pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.034286 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.034137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-plugins-config-volume\") pod \"payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") " pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.134874 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.134794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjv8h\" (UniqueName: \"kubernetes.io/projected/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-kube-api-access-zjv8h\") pod \"payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") " pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.134874 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.134846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-plugins-config-volume\") pod \"payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") " pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.135555 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.135535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-plugins-config-volume\") pod \"payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") " pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.143258 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.143232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjv8h\" (UniqueName: \"kubernetes.io/projected/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-kube-api-access-zjv8h\") pod \"payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") " pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.181303 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.181270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:52.323211 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:52.323179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"]
Jul 24 18:09:52.323722 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:09:52.323699    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad8dff2_14ca_4a05_8846_6eb9a3a80e98.slice/crio-fbdab31af7326fc90a44d5eec679d05356096ff4f5f8772ee92ad5b226d8e610 WatchSource:0}: Error finding container fbdab31af7326fc90a44d5eec679d05356096ff4f5f8772ee92ad5b226d8e610: Status 404 returned error can't find the container with id fbdab31af7326fc90a44d5eec679d05356096ff4f5f8772ee92ad5b226d8e610
Jul 24 18:09:53.320876 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:53.320841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224" event={"ID":"cad8dff2-14ca-4a05-8846-6eb9a3a80e98","Type":"ContainerStarted","Data":"45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63"}
Jul 24 18:09:53.321362 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:53.320901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224" event={"ID":"cad8dff2-14ca-4a05-8846-6eb9a3a80e98","Type":"ContainerStarted","Data":"fbdab31af7326fc90a44d5eec679d05356096ff4f5f8772ee92ad5b226d8e610"}
Jul 24 18:09:53.321362 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:53.320935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:09:53.338828 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:09:53.338766    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224" podStartSLOduration=2.33874391 podStartE2EDuration="2.33874391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:09:53.335951433 +0000 UTC m=+1992.368331791" watchObservedRunningTime="2026-07-24 18:09:53.33874391 +0000 UTC m=+1992.371124270"
Jul 24 18:10:04.330497 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:04.330464    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:10:26.457363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.457314    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"]
Jul 24 18:10:26.458280 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.458225    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224" podUID="cad8dff2-14ca-4a05-8846-6eb9a3a80e98" containerName="payload-processing" containerID="cri-o://45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63" gracePeriod=30
Jul 24 18:10:26.725777 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.725750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:10:26.859252 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.859219    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjv8h\" (UniqueName: \"kubernetes.io/projected/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-kube-api-access-zjv8h\") pod \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") "
Jul 24 18:10:26.859431 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.859329    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-plugins-config-volume\") pod \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\" (UID: \"cad8dff2-14ca-4a05-8846-6eb9a3a80e98\") "
Jul 24 18:10:26.859749 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.859715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cad8dff2-14ca-4a05-8846-6eb9a3a80e98" (UID: "cad8dff2-14ca-4a05-8846-6eb9a3a80e98"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:10:26.861434 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.861408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-kube-api-access-zjv8h" (OuterVolumeSpecName: "kube-api-access-zjv8h") pod "cad8dff2-14ca-4a05-8846-6eb9a3a80e98" (UID: "cad8dff2-14ca-4a05-8846-6eb9a3a80e98"). InnerVolumeSpecName "kube-api-access-zjv8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:10:26.960370 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.960289    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:10:26.960370 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:26.960318    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjv8h\" (UniqueName: \"kubernetes.io/projected/cad8dff2-14ca-4a05-8846-6eb9a3a80e98-kube-api-access-zjv8h\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:10:27.528629 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.528597    2564 generic.go:356] "Generic (PLEG): container finished" podID="cad8dff2-14ca-4a05-8846-6eb9a3a80e98" containerID="45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63" exitCode=0
Jul 24 18:10:27.529096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.528663    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"
Jul 24 18:10:27.529096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.528685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224" event={"ID":"cad8dff2-14ca-4a05-8846-6eb9a3a80e98","Type":"ContainerDied","Data":"45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63"}
Jul 24 18:10:27.529096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.528749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224" event={"ID":"cad8dff2-14ca-4a05-8846-6eb9a3a80e98","Type":"ContainerDied","Data":"fbdab31af7326fc90a44d5eec679d05356096ff4f5f8772ee92ad5b226d8e610"}
Jul 24 18:10:27.529096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.528778    2564 scope.go:117] "RemoveContainer" containerID="45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63"
Jul 24 18:10:27.538604 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.538585    2564 scope.go:117] "RemoveContainer" containerID="45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63"
Jul 24 18:10:27.538840 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:10:27.538821    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63\": container with ID starting with 45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63 not found: ID does not exist" containerID="45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63"
Jul 24 18:10:27.538913 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.538846    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63"} err="failed to get container status \"45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63\": rpc error: code = NotFound desc = could not find container \"45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63\": container with ID starting with 45fd2a57678e6ad2ac0ca13bbd4eacbf99cf81b4865f897c22a1c8cbe357ea63 not found: ID does not exist"
Jul 24 18:10:27.547688 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.547664    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"]
Jul 24 18:10:27.551547 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:27.551523    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7a6fbc6b-5868fcc5cd-pb224"]
Jul 24 18:10:29.461674 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:10:29.461645    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad8dff2-14ca-4a05-8846-6eb9a3a80e98" path="/var/lib/kubelet/pods/cad8dff2-14ca-4a05-8846-6eb9a3a80e98/volumes"
Jul 24 18:12:28.287821 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.287786    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"]
Jul 24 18:12:28.288294 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.288279    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad8dff2-14ca-4a05-8846-6eb9a3a80e98" containerName="payload-processing"
Jul 24 18:12:28.288340 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.288296    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad8dff2-14ca-4a05-8846-6eb9a3a80e98" containerName="payload-processing"
Jul 24 18:12:28.288375 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.288368    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad8dff2-14ca-4a05-8846-6eb9a3a80e98" containerName="payload-processing"
Jul 24 18:12:28.291731 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.291714    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:28.294313 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.294296    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:12:28.300565 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.300541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"]
Jul 24 18:12:28.369120 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.369076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55054301-8731-4809-8803-2fa3558bfe71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7\" (UID: \"55054301-8731-4809-8803-2fa3558bfe71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:28.470219 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.470184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55054301-8731-4809-8803-2fa3558bfe71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7\" (UID: \"55054301-8731-4809-8803-2fa3558bfe71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:28.470898 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.470875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55054301-8731-4809-8803-2fa3558bfe71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7\" (UID: \"55054301-8731-4809-8803-2fa3558bfe71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:28.606528 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.606447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:28.951989 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:28.951964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"]
Jul 24 18:12:28.953699 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:12:28.953675    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55054301_8731_4809_8803_2fa3558bfe71.slice/crio-a926ed6867115e68b2946827793abb5bce9120870e77207c6c8b04c9866ff092 WatchSource:0}: Error finding container a926ed6867115e68b2946827793abb5bce9120870e77207c6c8b04c9866ff092: Status 404 returned error can't find the container with id a926ed6867115e68b2946827793abb5bce9120870e77207c6c8b04c9866ff092
Jul 24 18:12:29.274368 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:29.274340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7" event={"ID":"55054301-8731-4809-8803-2fa3558bfe71","Type":"ContainerStarted","Data":"22a71c30ce6aa2d1bcd052e6d867edf44df8fca15e17a58ffd086b10a557ce6a"}
Jul 24 18:12:29.274528 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:29.274388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7" event={"ID":"55054301-8731-4809-8803-2fa3558bfe71","Type":"ContainerStarted","Data":"a926ed6867115e68b2946827793abb5bce9120870e77207c6c8b04c9866ff092"}
Jul 24 18:12:29.293202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:29.293157    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7" podStartSLOduration=1.293144121 podStartE2EDuration="1.293144121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:12:29.290502918 +0000 UTC m=+2148.322883280" watchObservedRunningTime="2026-07-24 18:12:29.293144121 +0000 UTC m=+2148.325524480"
Jul 24 18:12:30.282222 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:30.282188    2564 generic.go:356] "Generic (PLEG): container finished" podID="55054301-8731-4809-8803-2fa3558bfe71" containerID="22a71c30ce6aa2d1bcd052e6d867edf44df8fca15e17a58ffd086b10a557ce6a" exitCode=0
Jul 24 18:12:30.282391 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:30.282274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7" event={"ID":"55054301-8731-4809-8803-2fa3558bfe71","Type":"ContainerDied","Data":"22a71c30ce6aa2d1bcd052e6d867edf44df8fca15e17a58ffd086b10a557ce6a"}
Jul 24 18:12:31.437643 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:31.437619    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:31.601604 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:31.601514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55054301-8731-4809-8803-2fa3558bfe71-maas-api-service-ca\") pod \"55054301-8731-4809-8803-2fa3558bfe71\" (UID: \"55054301-8731-4809-8803-2fa3558bfe71\") "
Jul 24 18:12:31.601910 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:31.601886    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55054301-8731-4809-8803-2fa3558bfe71-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "55054301-8731-4809-8803-2fa3558bfe71" (UID: "55054301-8731-4809-8803-2fa3558bfe71"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:12:31.703138 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:31.703107    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55054301-8731-4809-8803-2fa3558bfe71-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:12:32.295363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:32.295325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7" event={"ID":"55054301-8731-4809-8803-2fa3558bfe71","Type":"ContainerDied","Data":"a926ed6867115e68b2946827793abb5bce9120870e77207c6c8b04c9866ff092"}
Jul 24 18:12:32.295363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:32.295355    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"
Jul 24 18:12:32.295627 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:32.295375    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a926ed6867115e68b2946827793abb5bce9120870e77207c6c8b04c9866ff092"
Jul 24 18:12:43.406644 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:43.406560    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"]
Jul 24 18:12:43.409254 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:43.409231    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ba2e7e10-jq4d7"]
Jul 24 18:12:43.461396 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:12:43.461365    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55054301-8731-4809-8803-2fa3558bfe71" path="/var/lib/kubelet/pods/55054301-8731-4809-8803-2fa3558bfe71/volumes"
Jul 24 18:14:41.712683 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:14:41.712654    2564 scope.go:117] "RemoveContainer" containerID="7ddc2cf628947de59530042560aec0168417f586714b8eb9cc335e7f68394e99"
Jul 24 18:15:41.736275 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:15:41.736203    2564 scope.go:117] "RemoveContainer" containerID="d5c24ff6be2ac7aaba14d0cb5dacd4257e70eabdf88c28fb3dfdb88137de1cc7"
Jul 24 18:16:09.642466 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.642430    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"]
Jul 24 18:16:09.643132 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.642901    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55054301-8731-4809-8803-2fa3558bfe71" containerName="revoke-keys"
Jul 24 18:16:09.643132 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.642913    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="55054301-8731-4809-8803-2fa3558bfe71" containerName="revoke-keys"
Jul 24 18:16:09.643132 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.643013    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="55054301-8731-4809-8803-2fa3558bfe71" containerName="revoke-keys"
Jul 24 18:16:09.646669 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.646645    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.649351 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.649328    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-12361c-serving-cert\""
Jul 24 18:16:09.666331 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.666303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"]
Jul 24 18:16:09.744484 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.744448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.744649 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.744546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.744649 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.744573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbpq\" (UniqueName: \"kubernetes.io/projected/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-kube-api-access-wfbpq\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.845477 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.845443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.845656 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.845519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.845656 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.845553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbpq\" (UniqueName: \"kubernetes.io/projected/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-kube-api-access-wfbpq\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.845732 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:16:09.845666    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-serving-cert: secret "maas-api-e2e-inf-b-12361c-serving-cert" not found
Jul 24 18:16:09.845767 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:16:09.845731    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls podName:e85ea6ca-8714-42b0-9576-e9bc1b2b6c23 nodeName:}" failed. No retries permitted until 2026-07-24 18:16:10.345715368 +0000 UTC m=+2369.378095715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls") pod "maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" (UID: "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23") : secret "maas-api-e2e-inf-b-12361c-serving-cert" not found
Jul 24 18:16:09.846199 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.846182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:09.858435 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:09.858402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbpq\" (UniqueName: \"kubernetes.io/projected/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-kube-api-access-wfbpq\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:10.350548 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:10.350515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:10.353001 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:10.352974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls\") pod \"maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:10.561611 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:10.561568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:10.722740 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:10.722711    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"]
Jul 24 18:16:10.726348 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:16:10.726310    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85ea6ca_8714_42b0_9576_e9bc1b2b6c23.slice/crio-1a0d36906ce506c543604cfedf5e23d2fc69813e2db8e8a626faa1a9e70ffb2e WatchSource:0}: Error finding container 1a0d36906ce506c543604cfedf5e23d2fc69813e2db8e8a626faa1a9e70ffb2e: Status 404 returned error can't find the container with id 1a0d36906ce506c543604cfedf5e23d2fc69813e2db8e8a626faa1a9e70ffb2e
Jul 24 18:16:10.727950 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:10.727932    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:16:11.627099 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:11.627067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" event={"ID":"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23","Type":"ContainerStarted","Data":"39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647"}
Jul 24 18:16:11.627288 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:11.627127    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" event={"ID":"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23","Type":"ContainerStarted","Data":"1a0d36906ce506c543604cfedf5e23d2fc69813e2db8e8a626faa1a9e70ffb2e"}
Jul 24 18:16:11.627288 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:11.627158    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:16:11.666616 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:11.666567    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" podStartSLOduration=2.33279063 podStartE2EDuration="2.666551301s" totalImagesPullingTime="333.760671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:16:11.663072921 +0000 UTC m=+2370.695453292" watchObservedRunningTime="2026-07-24 18:16:11.666551301 +0000 UTC m=+2370.698931659"
Jul 24 18:16:17.638984 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:16:17.638955    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:17:34.833261 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.833225    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"]
Jul 24 18:17:34.837067 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.837011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:34.839750 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.839724    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:17:34.844980 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.844955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"]
Jul 24 18:17:34.886523 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.886496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b1c743-b4b5-4183-8071-059fd80ff020-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr\" (UID: \"b3b1c743-b4b5-4183-8071-059fd80ff020\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:34.987524 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.987492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b1c743-b4b5-4183-8071-059fd80ff020-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr\" (UID: \"b3b1c743-b4b5-4183-8071-059fd80ff020\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:34.988208 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:34.988186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b1c743-b4b5-4183-8071-059fd80ff020-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr\" (UID: \"b3b1c743-b4b5-4183-8071-059fd80ff020\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:35.149558 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:35.149535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:35.302060 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:35.299988    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"]
Jul 24 18:17:35.307141 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:17:35.307101    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b1c743_b4b5_4183_8071_059fd80ff020.slice/crio-a01490d96554d07db90f8bf42c1c27338b981ec0e9fdabcc0ad3bafede76d284 WatchSource:0}: Error finding container a01490d96554d07db90f8bf42c1c27338b981ec0e9fdabcc0ad3bafede76d284: Status 404 returned error can't find the container with id a01490d96554d07db90f8bf42c1c27338b981ec0e9fdabcc0ad3bafede76d284
Jul 24 18:17:36.132731 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:36.132696    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3b1c743-b4b5-4183-8071-059fd80ff020" containerID="75a91b3c8b6cd96da5805b38b3c80fc4392e4265f9221e34c4c32464b0186c70" exitCode=0
Jul 24 18:17:36.133134 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:36.132790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr" event={"ID":"b3b1c743-b4b5-4183-8071-059fd80ff020","Type":"ContainerDied","Data":"75a91b3c8b6cd96da5805b38b3c80fc4392e4265f9221e34c4c32464b0186c70"}
Jul 24 18:17:36.133134 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:36.132843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr" event={"ID":"b3b1c743-b4b5-4183-8071-059fd80ff020","Type":"ContainerStarted","Data":"a01490d96554d07db90f8bf42c1c27338b981ec0e9fdabcc0ad3bafede76d284"}
Jul 24 18:17:37.274827 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:37.274804    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:37.311131 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:37.311104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b1c743-b4b5-4183-8071-059fd80ff020-maas-api-service-ca\") pod \"b3b1c743-b4b5-4183-8071-059fd80ff020\" (UID: \"b3b1c743-b4b5-4183-8071-059fd80ff020\") "
Jul 24 18:17:37.311441 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:37.311420    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b1c743-b4b5-4183-8071-059fd80ff020-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3b1c743-b4b5-4183-8071-059fd80ff020" (UID: "b3b1c743-b4b5-4183-8071-059fd80ff020"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:17:37.412450 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:37.412414    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b1c743-b4b5-4183-8071-059fd80ff020-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:17:38.145624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:38.145596    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"
Jul 24 18:17:38.145823 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:38.145595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr" event={"ID":"b3b1c743-b4b5-4183-8071-059fd80ff020","Type":"ContainerDied","Data":"a01490d96554d07db90f8bf42c1c27338b981ec0e9fdabcc0ad3bafede76d284"}
Jul 24 18:17:38.145823 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:38.145734    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a01490d96554d07db90f8bf42c1c27338b981ec0e9fdabcc0ad3bafede76d284"
Jul 24 18:17:49.925426 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:49.925383    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"]
Jul 24 18:17:49.929691 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:49.929668    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b3ffbc-28jsr"]
Jul 24 18:17:51.461947 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:51.461910    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b1c743-b4b5-4183-8071-059fd80ff020" path="/var/lib/kubelet/pods/b3b1c743-b4b5-4183-8071-059fd80ff020/volumes"
Jul 24 18:17:56.958482 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.958444    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"]
Jul 24 18:17:56.958966 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.958954    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b1c743-b4b5-4183-8071-059fd80ff020" containerName="revoke-keys"
Jul 24 18:17:56.959010 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.958970    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b1c743-b4b5-4183-8071-059fd80ff020" containerName="revoke-keys"
Jul 24 18:17:56.959090 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.959078    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b1c743-b4b5-4183-8071-059fd80ff020" containerName="revoke-keys"
Jul 24 18:17:56.963832 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.963799    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:17:56.967333 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.967309    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:17:56.971746 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:56.971699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"]
Jul 24 18:17:57.102073 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:57.102002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d206bed2-725e-4575-8194-43efadc622d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4\" (UID: \"d206bed2-725e-4575-8194-43efadc622d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:17:57.203639 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:57.203596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d206bed2-725e-4575-8194-43efadc622d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4\" (UID: \"d206bed2-725e-4575-8194-43efadc622d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:17:57.204361 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:57.204340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d206bed2-725e-4575-8194-43efadc622d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4\" (UID: \"d206bed2-725e-4575-8194-43efadc622d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:17:57.277279 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:57.277185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:17:57.420869 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:57.420844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"]
Jul 24 18:17:57.422440 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:17:57.422415    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd206bed2_725e_4575_8194_43efadc622d5.slice/crio-0f72bbab73912dd88f8d768b4220d282ae71b733d65dfbe1a324029778df0954 WatchSource:0}: Error finding container 0f72bbab73912dd88f8d768b4220d282ae71b733d65dfbe1a324029778df0954: Status 404 returned error can't find the container with id 0f72bbab73912dd88f8d768b4220d282ae71b733d65dfbe1a324029778df0954
Jul 24 18:17:58.267691 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:58.267655    2564 generic.go:356] "Generic (PLEG): container finished" podID="d206bed2-725e-4575-8194-43efadc622d5" containerID="6c53009d3db63f724694bf8353e17cdbb87acae4b4257b5597e151f0e8e9135e" exitCode=0
Jul 24 18:17:58.268085 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:58.267740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4" event={"ID":"d206bed2-725e-4575-8194-43efadc622d5","Type":"ContainerDied","Data":"6c53009d3db63f724694bf8353e17cdbb87acae4b4257b5597e151f0e8e9135e"}
Jul 24 18:17:58.268085 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:58.267804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4" event={"ID":"d206bed2-725e-4575-8194-43efadc622d5","Type":"ContainerStarted","Data":"0f72bbab73912dd88f8d768b4220d282ae71b733d65dfbe1a324029778df0954"}
Jul 24 18:17:59.414731 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:59.414707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:17:59.526693 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:59.526613    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d206bed2-725e-4575-8194-43efadc622d5-maas-api-service-ca\") pod \"d206bed2-725e-4575-8194-43efadc622d5\" (UID: \"d206bed2-725e-4575-8194-43efadc622d5\") "
Jul 24 18:17:59.526998 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:59.526976    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d206bed2-725e-4575-8194-43efadc622d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d206bed2-725e-4575-8194-43efadc622d5" (UID: "d206bed2-725e-4575-8194-43efadc622d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:17:59.628527 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:17:59.628489    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d206bed2-725e-4575-8194-43efadc622d5-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:00.281879 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:00.281849    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"
Jul 24 18:18:00.282072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:00.281880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4" event={"ID":"d206bed2-725e-4575-8194-43efadc622d5","Type":"ContainerDied","Data":"0f72bbab73912dd88f8d768b4220d282ae71b733d65dfbe1a324029778df0954"}
Jul 24 18:18:00.282072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:00.281927    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f72bbab73912dd88f8d768b4220d282ae71b733d65dfbe1a324029778df0954"
Jul 24 18:18:07.495861 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.495825    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"]
Jul 24 18:18:07.496346 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.496082    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" podUID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" containerName="maas-api" containerID="cri-o://39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647" gracePeriod=30
Jul 24 18:18:07.634110 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.634068    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" podUID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.78:8443/health\": dial tcp 10.133.0.78:8443: connect: connection refused"
Jul 24 18:18:07.759110 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.759014    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:18:07.808410 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.808374    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-openshift-service-ca\") pod \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") "
Jul 24 18:18:07.808410 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.808413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls\") pod \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") "
Jul 24 18:18:07.808672 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.808483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfbpq\" (UniqueName: \"kubernetes.io/projected/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-kube-api-access-wfbpq\") pod \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\" (UID: \"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23\") "
Jul 24 18:18:07.808765 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.808743    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" (UID: "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:18:07.808867 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.808839    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-openshift-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:07.810668 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.810638    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" (UID: "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:18:07.810753 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.810695    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-kube-api-access-wfbpq" (OuterVolumeSpecName: "kube-api-access-wfbpq") pod "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" (UID: "e85ea6ca-8714-42b0-9576-e9bc1b2b6c23"). InnerVolumeSpecName "kube-api-access-wfbpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:18:07.910229 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.910198    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfbpq\" (UniqueName: \"kubernetes.io/projected/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-kube-api-access-wfbpq\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:07.910229 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:07.910229    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23-maas-api-tls\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:08.331117 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.331072    2564 generic.go:356] "Generic (PLEG): container finished" podID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" containerID="39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647" exitCode=0
Jul 24 18:18:08.331117 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.331122    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"
Jul 24 18:18:08.331363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.331157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" event={"ID":"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23","Type":"ContainerDied","Data":"39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647"}
Jul 24 18:18:08.331363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.331211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g" event={"ID":"e85ea6ca-8714-42b0-9576-e9bc1b2b6c23","Type":"ContainerDied","Data":"1a0d36906ce506c543604cfedf5e23d2fc69813e2db8e8a626faa1a9e70ffb2e"}
Jul 24 18:18:08.331363 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.331237    2564 scope.go:117] "RemoveContainer" containerID="39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647"
Jul 24 18:18:08.349756 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.349738    2564 scope.go:117] "RemoveContainer" containerID="39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647"
Jul 24 18:18:08.350056 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:18:08.350017    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647\": container with ID starting with 39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647 not found: ID does not exist" containerID="39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647"
Jul 24 18:18:08.350132 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.350065    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647"} err="failed to get container status \"39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647\": rpc error: code = NotFound desc = could not find container \"39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647\": container with ID starting with 39a53d8abbace1681cd203b21dc995b977c725a8e819bf80839953d8c2098647 not found: ID does not exist"
Jul 24 18:18:08.358521 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.358497    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"]
Jul 24 18:18:08.362708 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:08.362687    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12361c-6f78957ffd-f7k6g"]
Jul 24 18:18:09.461835 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:09.461802    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" path="/var/lib/kubelet/pods/e85ea6ca-8714-42b0-9576-e9bc1b2b6c23/volumes"
Jul 24 18:18:12.034614 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:12.034574    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"]
Jul 24 18:18:12.037725 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:12.037700    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12361c-xf8g4"]
Jul 24 18:18:13.460421 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:13.460390    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d206bed2-725e-4575-8194-43efadc622d5" path="/var/lib/kubelet/pods/d206bed2-725e-4575-8194-43efadc622d5/volumes"
Jul 24 18:18:22.881517 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.881477    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"]
Jul 24 18:18:22.881932 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.881919    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d206bed2-725e-4575-8194-43efadc622d5" containerName="revoke-keys"
Jul 24 18:18:22.881986 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.881933    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d206bed2-725e-4575-8194-43efadc622d5" containerName="revoke-keys"
Jul 24 18:18:22.881986 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.881949    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" containerName="maas-api"
Jul 24 18:18:22.881986 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.881955    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" containerName="maas-api"
Jul 24 18:18:22.882126 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.882017    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d206bed2-725e-4575-8194-43efadc622d5" containerName="revoke-keys"
Jul 24 18:18:22.882126 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.882040    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e85ea6ca-8714-42b0-9576-e9bc1b2b6c23" containerName="maas-api"
Jul 24 18:18:22.885072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.885057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:22.887594 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.887573    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-dcf34d\""
Jul 24 18:18:22.887693 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.887631    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-dcf34d-dockercfg-knnnk\""
Jul 24 18:18:22.894995 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.894972    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"]
Jul 24 18:18:22.965153 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.965122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cab0a83d-837b-48fd-83ce-06ab794f8483-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:22.965153 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:22.965165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlpwv\" (UniqueName: \"kubernetes.io/projected/cab0a83d-837b-48fd-83ce-06ab794f8483-kube-api-access-hlpwv\") pod \"payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.066160 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.066127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cab0a83d-837b-48fd-83ce-06ab794f8483-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.066355 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.066176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlpwv\" (UniqueName: \"kubernetes.io/projected/cab0a83d-837b-48fd-83ce-06ab794f8483-kube-api-access-hlpwv\") pod \"payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.066832 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.066813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cab0a83d-837b-48fd-83ce-06ab794f8483-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.074956 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.074932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlpwv\" (UniqueName: \"kubernetes.io/projected/cab0a83d-837b-48fd-83ce-06ab794f8483-kube-api-access-hlpwv\") pod \"payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.197149 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.197110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.345739 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.345715    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"]
Jul 24 18:18:23.347474 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:18:23.347443    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab0a83d_837b_48fd_83ce_06ab794f8483.slice/crio-0dbee21b08c89fbd6bb0f542036452f10ac131de64970579633e9c435a6d6c87 WatchSource:0}: Error finding container 0dbee21b08c89fbd6bb0f542036452f10ac131de64970579633e9c435a6d6c87: Status 404 returned error can't find the container with id 0dbee21b08c89fbd6bb0f542036452f10ac131de64970579633e9c435a6d6c87
Jul 24 18:18:23.424697 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.424662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2" event={"ID":"cab0a83d-837b-48fd-83ce-06ab794f8483","Type":"ContainerStarted","Data":"c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861"}
Jul 24 18:18:23.424836 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.424724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2" event={"ID":"cab0a83d-837b-48fd-83ce-06ab794f8483","Type":"ContainerStarted","Data":"0dbee21b08c89fbd6bb0f542036452f10ac131de64970579633e9c435a6d6c87"}
Jul 24 18:18:23.424894 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.424832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:23.443340 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:23.443296    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2" podStartSLOduration=1.443281506 podStartE2EDuration="1.443281506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:18:23.440463868 +0000 UTC m=+2502.472844220" watchObservedRunningTime="2026-07-24 18:18:23.443281506 +0000 UTC m=+2502.475661864"
Jul 24 18:18:31.046904 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.046868    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"]
Jul 24 18:18:31.051248 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.051225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.054035 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.054004    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4a14d5-dockercfg-9xkrq\""
Jul 24 18:18:31.054416 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.054392    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4a14d5\""
Jul 24 18:18:31.067648 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.061596    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"]
Jul 24 18:18:31.149012 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.148972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6zv4\" (UniqueName: \"kubernetes.io/projected/777aac2d-f7a7-417f-8d30-009d9b581baa-kube-api-access-j6zv4\") pod \"payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") " pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.149012 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.149011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/777aac2d-f7a7-417f-8d30-009d9b581baa-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") " pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.249649 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.249612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6zv4\" (UniqueName: \"kubernetes.io/projected/777aac2d-f7a7-417f-8d30-009d9b581baa-kube-api-access-j6zv4\") pod \"payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") " pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.249859 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.249665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/777aac2d-f7a7-417f-8d30-009d9b581baa-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") " pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.250447 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.250427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/777aac2d-f7a7-417f-8d30-009d9b581baa-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") " pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.259508 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.259483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6zv4\" (UniqueName: \"kubernetes.io/projected/777aac2d-f7a7-417f-8d30-009d9b581baa-kube-api-access-j6zv4\") pod \"payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") " pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.372669 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.372587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:31.526455 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:31.526424    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"]
Jul 24 18:18:32.485870 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:32.485832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng" event={"ID":"777aac2d-f7a7-417f-8d30-009d9b581baa","Type":"ContainerStarted","Data":"3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c"}
Jul 24 18:18:32.486315 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:32.485891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:32.486315 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:32.485912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng" event={"ID":"777aac2d-f7a7-417f-8d30-009d9b581baa","Type":"ContainerStarted","Data":"427fb020d530cb7419543b7f66a6203f31daf0c192c1e76d21cb8ad6fea3ba84"}
Jul 24 18:18:32.505012 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:32.504959    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng" podStartSLOduration=1.504944045 podStartE2EDuration="1.504944045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:18:32.502071446 +0000 UTC m=+2511.534451802" watchObservedRunningTime="2026-07-24 18:18:32.504944045 +0000 UTC m=+2511.537324432"
Jul 24 18:18:34.432211 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:34.432130    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:41.779374 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:41.779339    2564 scope.go:117] "RemoveContainer" containerID="22a71c30ce6aa2d1bcd052e6d867edf44df8fca15e17a58ffd086b10a557ce6a"
Jul 24 18:18:42.731933 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.731896    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"]
Jul 24 18:18:42.737183 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.737161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:42.739859 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.739839    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:18:42.745430 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.745403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"]
Jul 24 18:18:42.758240 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.758193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5\" (UID: \"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:42.859051 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.858980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5\" (UID: \"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:42.859617 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:42.859598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5\" (UID: \"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:43.049611 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:43.049517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:43.200319 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:43.200293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"]
Jul 24 18:18:43.202645 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:18:43.202613    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff7c5aa_bf31_4a71_91a2_d76ab8eed6be.slice/crio-128b76706d546fb20685e201567c26426a32c9b988c1fdd9df11e3c6c0a5cdbd WatchSource:0}: Error finding container 128b76706d546fb20685e201567c26426a32c9b988c1fdd9df11e3c6c0a5cdbd: Status 404 returned error can't find the container with id 128b76706d546fb20685e201567c26426a32c9b988c1fdd9df11e3c6c0a5cdbd
Jul 24 18:18:43.494195 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:43.494169    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:18:43.554714 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:43.554668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5" event={"ID":"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be","Type":"ContainerStarted","Data":"97f545c36ebc530dcb6a4d316329e4e86a3d13e320360185d4f2b6ac142bceff"}
Jul 24 18:18:43.554872 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:43.554744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5" event={"ID":"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be","Type":"ContainerStarted","Data":"128b76706d546fb20685e201567c26426a32c9b988c1fdd9df11e3c6c0a5cdbd"}
Jul 24 18:18:44.562332 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:44.562298    2564 generic.go:356] "Generic (PLEG): container finished" podID="7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be" containerID="97f545c36ebc530dcb6a4d316329e4e86a3d13e320360185d4f2b6ac142bceff" exitCode=0
Jul 24 18:18:44.562700 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:44.562385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5" event={"ID":"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be","Type":"ContainerDied","Data":"97f545c36ebc530dcb6a4d316329e4e86a3d13e320360185d4f2b6ac142bceff"}
Jul 24 18:18:45.714459 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:45.714431    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:45.786544 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:45.786512    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be-maas-api-service-ca\") pod \"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be\" (UID: \"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be\") "
Jul 24 18:18:45.786887 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:45.786867    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be" (UID: "7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:18:45.887544 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:45.887464    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:46.576688 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:46.576661    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"
Jul 24 18:18:46.576875 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:46.576699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5" event={"ID":"7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be","Type":"ContainerDied","Data":"128b76706d546fb20685e201567c26426a32c9b988c1fdd9df11e3c6c0a5cdbd"}
Jul 24 18:18:46.576875 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:46.576750    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="128b76706d546fb20685e201567c26426a32c9b988c1fdd9df11e3c6c0a5cdbd"
Jul 24 18:18:58.306141 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.306104    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"]
Jul 24 18:18:58.306927 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.306859    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2" podUID="cab0a83d-837b-48fd-83ce-06ab794f8483" containerName="payload-pre-processing" containerID="cri-o://c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861" gracePeriod=30
Jul 24 18:18:58.575955 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.575926    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:58.652123 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.652089    2564 generic.go:356] "Generic (PLEG): container finished" podID="cab0a83d-837b-48fd-83ce-06ab794f8483" containerID="c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861" exitCode=0
Jul 24 18:18:58.652292 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.652137    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"
Jul 24 18:18:58.652292 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.652179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2" event={"ID":"cab0a83d-837b-48fd-83ce-06ab794f8483","Type":"ContainerDied","Data":"c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861"}
Jul 24 18:18:58.652292 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.652234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2" event={"ID":"cab0a83d-837b-48fd-83ce-06ab794f8483","Type":"ContainerDied","Data":"0dbee21b08c89fbd6bb0f542036452f10ac131de64970579633e9c435a6d6c87"}
Jul 24 18:18:58.652292 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.652258    2564 scope.go:117] "RemoveContainer" containerID="c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861"
Jul 24 18:18:58.661713 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.661695    2564 scope.go:117] "RemoveContainer" containerID="c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861"
Jul 24 18:18:58.661982 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:18:58.661964    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861\": container with ID starting with c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861 not found: ID does not exist" containerID="c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861"
Jul 24 18:18:58.662062 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.661993    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861"} err="failed to get container status \"c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861\": rpc error: code = NotFound desc = could not find container \"c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861\": container with ID starting with c0cd23aca6941d314faa7401d885d0caf16e4beb384d60e97e0ff0e521ebf861 not found: ID does not exist"
Jul 24 18:18:58.709239 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.709213    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cab0a83d-837b-48fd-83ce-06ab794f8483-plugins-config-volume\") pod \"cab0a83d-837b-48fd-83ce-06ab794f8483\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") "
Jul 24 18:18:58.709391 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.709311    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlpwv\" (UniqueName: \"kubernetes.io/projected/cab0a83d-837b-48fd-83ce-06ab794f8483-kube-api-access-hlpwv\") pod \"cab0a83d-837b-48fd-83ce-06ab794f8483\" (UID: \"cab0a83d-837b-48fd-83ce-06ab794f8483\") "
Jul 24 18:18:58.709600 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.709577    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cab0a83d-837b-48fd-83ce-06ab794f8483-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cab0a83d-837b-48fd-83ce-06ab794f8483" (UID: "cab0a83d-837b-48fd-83ce-06ab794f8483"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:18:58.709709 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.709689    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cab0a83d-837b-48fd-83ce-06ab794f8483-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:58.711167 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.711148    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab0a83d-837b-48fd-83ce-06ab794f8483-kube-api-access-hlpwv" (OuterVolumeSpecName: "kube-api-access-hlpwv") pod "cab0a83d-837b-48fd-83ce-06ab794f8483" (UID: "cab0a83d-837b-48fd-83ce-06ab794f8483"). InnerVolumeSpecName "kube-api-access-hlpwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:18:58.811341 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.811258    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlpwv\" (UniqueName: \"kubernetes.io/projected/cab0a83d-837b-48fd-83ce-06ab794f8483-kube-api-access-hlpwv\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:18:58.975105 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.975071    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"]
Jul 24 18:18:58.978841 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:58.978817    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dcf34d-55d855b6c6-qpmw2"]
Jul 24 18:18:59.460779 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:18:59.460750    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab0a83d-837b-48fd-83ce-06ab794f8483" path="/var/lib/kubelet/pods/cab0a83d-837b-48fd-83ce-06ab794f8483/volumes"
Jul 24 18:19:02.812761 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:02.812722    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"]
Jul 24 18:19:02.815428 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:02.815404    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dcf34d-dcms5"]
Jul 24 18:19:03.461234 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:03.461201    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be" path="/var/lib/kubelet/pods/7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be/volumes"
Jul 24 18:19:09.811210 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.811175    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"]
Jul 24 18:19:09.811909 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.811887    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be" containerName="revoke-keys"
Jul 24 18:19:09.811909 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.811910    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be" containerName="revoke-keys"
Jul 24 18:19:09.812113 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.811925    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab0a83d-837b-48fd-83ce-06ab794f8483" containerName="payload-pre-processing"
Jul 24 18:19:09.812113 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.811935    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab0a83d-837b-48fd-83ce-06ab794f8483" containerName="payload-pre-processing"
Jul 24 18:19:09.812113 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.812051    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff7c5aa-bf31-4a71-91a2-d76ab8eed6be" containerName="revoke-keys"
Jul 24 18:19:09.812113 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.812074    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab0a83d-837b-48fd-83ce-06ab794f8483" containerName="payload-pre-processing"
Jul 24 18:19:09.816558 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.816537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:09.820786 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.820761    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:19:09.822837 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.822814    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"]
Jul 24 18:19:09.921219 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:09.921181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be60da3f-2331-440b-8aaa-56396ca7bac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z\" (UID: \"be60da3f-2331-440b-8aaa-56396ca7bac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:10.022801 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:10.022766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be60da3f-2331-440b-8aaa-56396ca7bac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z\" (UID: \"be60da3f-2331-440b-8aaa-56396ca7bac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:10.023449 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:10.023422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be60da3f-2331-440b-8aaa-56396ca7bac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z\" (UID: \"be60da3f-2331-440b-8aaa-56396ca7bac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:10.130153 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:10.130077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:10.474541 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:10.474511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"]
Jul 24 18:19:10.475256 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:19:10.475229    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe60da3f_2331_440b_8aaa_56396ca7bac1.slice/crio-6036dbd794db0a627f17926c740cf589404e0349a745f230edcfc43d7605a627 WatchSource:0}: Error finding container 6036dbd794db0a627f17926c740cf589404e0349a745f230edcfc43d7605a627: Status 404 returned error can't find the container with id 6036dbd794db0a627f17926c740cf589404e0349a745f230edcfc43d7605a627
Jul 24 18:19:10.729877 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:10.729849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z" event={"ID":"be60da3f-2331-440b-8aaa-56396ca7bac1","Type":"ContainerStarted","Data":"6036dbd794db0a627f17926c740cf589404e0349a745f230edcfc43d7605a627"}
Jul 24 18:19:11.737856 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:11.737822    2564 generic.go:356] "Generic (PLEG): container finished" podID="be60da3f-2331-440b-8aaa-56396ca7bac1" containerID="c5611be6d274fbb29bac9e85a1641f7515f172f8569da1b9aadac79a69d22886" exitCode=0
Jul 24 18:19:11.738269 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:11.737908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z" event={"ID":"be60da3f-2331-440b-8aaa-56396ca7bac1","Type":"ContainerDied","Data":"c5611be6d274fbb29bac9e85a1641f7515f172f8569da1b9aadac79a69d22886"}
Jul 24 18:19:12.878512 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:12.878484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:13.051165 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:13.051085    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be60da3f-2331-440b-8aaa-56396ca7bac1-maas-api-service-ca\") pod \"be60da3f-2331-440b-8aaa-56396ca7bac1\" (UID: \"be60da3f-2331-440b-8aaa-56396ca7bac1\") "
Jul 24 18:19:13.051444 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:13.051420    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be60da3f-2331-440b-8aaa-56396ca7bac1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be60da3f-2331-440b-8aaa-56396ca7bac1" (UID: "be60da3f-2331-440b-8aaa-56396ca7bac1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:19:13.152219 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:13.152185    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be60da3f-2331-440b-8aaa-56396ca7bac1-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:19:13.750879 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:13.750801    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"
Jul 24 18:19:13.750879 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:13.750821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z" event={"ID":"be60da3f-2331-440b-8aaa-56396ca7bac1","Type":"ContainerDied","Data":"6036dbd794db0a627f17926c740cf589404e0349a745f230edcfc43d7605a627"}
Jul 24 18:19:13.750879 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:13.750867    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6036dbd794db0a627f17926c740cf589404e0349a745f230edcfc43d7605a627"
Jul 24 18:19:25.358169 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.358134    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"]
Jul 24 18:19:25.358626 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.358372    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng" podUID="777aac2d-f7a7-417f-8d30-009d9b581baa" containerName="payload-processing" containerID="cri-o://3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c" gracePeriod=30
Jul 24 18:19:25.625267 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.625238    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:19:25.667341 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.667304    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/777aac2d-f7a7-417f-8d30-009d9b581baa-plugins-config-volume\") pod \"777aac2d-f7a7-417f-8d30-009d9b581baa\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") "
Jul 24 18:19:25.667523 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.667366    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6zv4\" (UniqueName: \"kubernetes.io/projected/777aac2d-f7a7-417f-8d30-009d9b581baa-kube-api-access-j6zv4\") pod \"777aac2d-f7a7-417f-8d30-009d9b581baa\" (UID: \"777aac2d-f7a7-417f-8d30-009d9b581baa\") "
Jul 24 18:19:25.667683 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.667653    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777aac2d-f7a7-417f-8d30-009d9b581baa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "777aac2d-f7a7-417f-8d30-009d9b581baa" (UID: "777aac2d-f7a7-417f-8d30-009d9b581baa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:19:25.669401 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.669381    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777aac2d-f7a7-417f-8d30-009d9b581baa-kube-api-access-j6zv4" (OuterVolumeSpecName: "kube-api-access-j6zv4") pod "777aac2d-f7a7-417f-8d30-009d9b581baa" (UID: "777aac2d-f7a7-417f-8d30-009d9b581baa"). InnerVolumeSpecName "kube-api-access-j6zv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:19:25.769012 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.768978    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/777aac2d-f7a7-417f-8d30-009d9b581baa-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:19:25.769012 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.769004    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6zv4\" (UniqueName: \"kubernetes.io/projected/777aac2d-f7a7-417f-8d30-009d9b581baa-kube-api-access-j6zv4\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:19:25.828460 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.828430    2564 generic.go:356] "Generic (PLEG): container finished" podID="777aac2d-f7a7-417f-8d30-009d9b581baa" containerID="3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c" exitCode=0
Jul 24 18:19:25.828624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.828484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"
Jul 24 18:19:25.828624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.828518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng" event={"ID":"777aac2d-f7a7-417f-8d30-009d9b581baa","Type":"ContainerDied","Data":"3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c"}
Jul 24 18:19:25.828624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.828576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng" event={"ID":"777aac2d-f7a7-417f-8d30-009d9b581baa","Type":"ContainerDied","Data":"427fb020d530cb7419543b7f66a6203f31daf0c192c1e76d21cb8ad6fea3ba84"}
Jul 24 18:19:25.828624 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.828598    2564 scope.go:117] "RemoveContainer" containerID="3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c"
Jul 24 18:19:25.838160 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.838143    2564 scope.go:117] "RemoveContainer" containerID="3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c"
Jul 24 18:19:25.838399 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:19:25.838377    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c\": container with ID starting with 3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c not found: ID does not exist" containerID="3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c"
Jul 24 18:19:25.838462 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.838412    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c"} err="failed to get container status \"3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c\": rpc error: code = NotFound desc = could not find container \"3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c\": container with ID starting with 3604b8ea78244e4104a41ddc05e57bd696e8086848d0fc78d4874fef2c89de8c not found: ID does not exist"
Jul 24 18:19:25.851446 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.851416    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"]
Jul 24 18:19:25.855316 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:25.855294    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4a14d5-6486ccc496-mtbng"]
Jul 24 18:19:27.460954 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:27.460921    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777aac2d-f7a7-417f-8d30-009d9b581baa" path="/var/lib/kubelet/pods/777aac2d-f7a7-417f-8d30-009d9b581baa/volumes"
Jul 24 18:19:29.891127 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:29.891099    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"]
Jul 24 18:19:29.893839 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:29.893826    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a14d5-zbm7z"]
Jul 24 18:19:31.460247 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:31.460216    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be60da3f-2331-440b-8aaa-56396ca7bac1" path="/var/lib/kubelet/pods/be60da3f-2331-440b-8aaa-56396ca7bac1/volumes"
Jul 24 18:19:49.505985 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.505947    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"]
Jul 24 18:19:49.506445 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.506430    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777aac2d-f7a7-417f-8d30-009d9b581baa" containerName="payload-processing"
Jul 24 18:19:49.506491 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.506445    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="777aac2d-f7a7-417f-8d30-009d9b581baa" containerName="payload-processing"
Jul 24 18:19:49.506491 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.506471    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be60da3f-2331-440b-8aaa-56396ca7bac1" containerName="revoke-keys"
Jul 24 18:19:49.506491 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.506478    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be60da3f-2331-440b-8aaa-56396ca7bac1" containerName="revoke-keys"
Jul 24 18:19:49.506586 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.506547    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="777aac2d-f7a7-417f-8d30-009d9b581baa" containerName="payload-processing"
Jul 24 18:19:49.506586 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.506556    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be60da3f-2331-440b-8aaa-56396ca7bac1" containerName="revoke-keys"
Jul 24 18:19:49.509721 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.509704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.512466 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.512443    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-c4d732\""
Jul 24 18:19:49.512585 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.512560    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-c4d732-dockercfg-ls64d\""
Jul 24 18:19:49.520543 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.520514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"]
Jul 24 18:19:49.603040 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.602989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4bt9\" (UniqueName: \"kubernetes.io/projected/6e77e3f4-5784-4869-9f7f-5d2d285d9add-kube-api-access-d4bt9\") pod \"payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.603247 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.603165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e77e3f4-5784-4869-9f7f-5d2d285d9add-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.704694 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.704638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e77e3f4-5784-4869-9f7f-5d2d285d9add-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.704889 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.704805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4bt9\" (UniqueName: \"kubernetes.io/projected/6e77e3f4-5784-4869-9f7f-5d2d285d9add-kube-api-access-d4bt9\") pod \"payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.705437 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.705413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e77e3f4-5784-4869-9f7f-5d2d285d9add-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.714361 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.714333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4bt9\" (UniqueName: \"kubernetes.io/projected/6e77e3f4-5784-4869-9f7f-5d2d285d9add-kube-api-access-d4bt9\") pod \"payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.821741 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.821658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:49.968396 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.968363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"]
Jul 24 18:19:49.969113 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:19:49.969089    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e77e3f4_5784_4869_9f7f_5d2d285d9add.slice/crio-c7ae77a21b841edcaaf0e8bd4c61bf858915e7deef6d62d5dcbe660e1af5d4e3 WatchSource:0}: Error finding container c7ae77a21b841edcaaf0e8bd4c61bf858915e7deef6d62d5dcbe660e1af5d4e3: Status 404 returned error can't find the container with id c7ae77a21b841edcaaf0e8bd4c61bf858915e7deef6d62d5dcbe660e1af5d4e3
Jul 24 18:19:49.981082 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:49.981053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl" event={"ID":"6e77e3f4-5784-4869-9f7f-5d2d285d9add","Type":"ContainerStarted","Data":"c7ae77a21b841edcaaf0e8bd4c61bf858915e7deef6d62d5dcbe660e1af5d4e3"}
Jul 24 18:19:50.989280 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:50.989243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl" event={"ID":"6e77e3f4-5784-4869-9f7f-5d2d285d9add","Type":"ContainerStarted","Data":"47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827"}
Jul 24 18:19:50.989772 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:50.989473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:19:51.008796 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:19:51.008737    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl" podStartSLOduration=2.008722178 podStartE2EDuration="2.008722178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:19:51.008210693 +0000 UTC m=+2590.040591075" watchObservedRunningTime="2026-07-24 18:19:51.008722178 +0000 UTC m=+2590.041102536"
Jul 24 18:20:01.997443 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:20:01.997413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:23:41.855457 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:23:41.855425    2564 scope.go:117] "RemoveContainer" containerID="75a91b3c8b6cd96da5805b38b3c80fc4392e4265f9221e34c4c32464b0186c70"
Jul 24 18:24:41.882081 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:24:41.881995    2564 scope.go:117] "RemoveContainer" containerID="6c53009d3db63f724694bf8353e17cdbb87acae4b4257b5597e151f0e8e9135e"
Jul 24 18:25:41.905227 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:25:41.905194    2564 scope.go:117] "RemoveContainer" containerID="97f545c36ebc530dcb6a4d316329e4e86a3d13e320360185d4f2b6ac142bceff"
Jul 24 18:25:41.914129 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:25:41.914108    2564 scope.go:117] "RemoveContainer" containerID="c5611be6d274fbb29bac9e85a1641f7515f172f8569da1b9aadac79a69d22886"
Jul 24 18:26:12.474350 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.474270    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-139897408241328"]
Jul 24 18:26:12.477933 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.477917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:12.480516 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.480496    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2q6hx\""
Jul 24 18:26:12.486121 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.486091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897408241328"]
Jul 24 18:26:12.572344 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.572306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzkjh\" (UniqueName: \"kubernetes.io/projected/acb35cd0-bafb-4b09-856b-95652640b012-kube-api-access-bzkjh\") pod \"test-curl-7586-139897408241328\" (UID: \"acb35cd0-bafb-4b09-856b-95652640b012\") " pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:12.672794 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.672754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkjh\" (UniqueName: \"kubernetes.io/projected/acb35cd0-bafb-4b09-856b-95652640b012-kube-api-access-bzkjh\") pod \"test-curl-7586-139897408241328\" (UID: \"acb35cd0-bafb-4b09-856b-95652640b012\") " pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:12.682329 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.682302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzkjh\" (UniqueName: \"kubernetes.io/projected/acb35cd0-bafb-4b09-856b-95652640b012-kube-api-access-bzkjh\") pod \"test-curl-7586-139897408241328\" (UID: \"acb35cd0-bafb-4b09-856b-95652640b012\") " pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:12.789180 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.789092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:12.937791 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.937761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897408241328"]
Jul 24 18:26:12.942670 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:12.942643    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:26:13.318110 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:13.318064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897408241328" event={"ID":"acb35cd0-bafb-4b09-856b-95652640b012","Type":"ContainerStarted","Data":"d6b981b380c7f6c40eb8be19d90669f4bca953c067bedbde68032dba60cb7260"}
Jul 24 18:26:14.325881 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:14.325848    2564 generic.go:356] "Generic (PLEG): container finished" podID="acb35cd0-bafb-4b09-856b-95652640b012" containerID="626b8141a9056baf0b8de1c69485ce816f07130d8744a45996a6b0cf5afb4080" exitCode=0
Jul 24 18:26:14.326316 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:14.325941    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897408241328" event={"ID":"acb35cd0-bafb-4b09-856b-95652640b012","Type":"ContainerDied","Data":"626b8141a9056baf0b8de1c69485ce816f07130d8744a45996a6b0cf5afb4080"}
Jul 24 18:26:15.474690 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.474661    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:15.498615 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.498580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzkjh\" (UniqueName: \"kubernetes.io/projected/acb35cd0-bafb-4b09-856b-95652640b012-kube-api-access-bzkjh\") pod \"acb35cd0-bafb-4b09-856b-95652640b012\" (UID: \"acb35cd0-bafb-4b09-856b-95652640b012\") "
Jul 24 18:26:15.500912 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.500875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb35cd0-bafb-4b09-856b-95652640b012-kube-api-access-bzkjh" (OuterVolumeSpecName: "kube-api-access-bzkjh") pod "acb35cd0-bafb-4b09-856b-95652640b012" (UID: "acb35cd0-bafb-4b09-856b-95652640b012"). InnerVolumeSpecName "kube-api-access-bzkjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:26:15.521387 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.521355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7586-139897408241328_acb35cd0-bafb-4b09-856b-95652640b012/test-curl-7586-139897408241328/0.log"
Jul 24 18:26:15.549039 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.548990    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-139897408241328"]
Jul 24 18:26:15.552864 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.552836    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-139897408241328"]
Jul 24 18:26:15.599545 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.599461    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzkjh\" (UniqueName: \"kubernetes.io/projected/acb35cd0-bafb-4b09-856b-95652640b012-kube-api-access-bzkjh\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:26:15.675249 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.675216    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-139897408239152"]
Jul 24 18:26:15.675686 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.675672    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb35cd0-bafb-4b09-856b-95652640b012" containerName="test-curl-7586-139897408241328"
Jul 24 18:26:15.675738 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.675687    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb35cd0-bafb-4b09-856b-95652640b012" containerName="test-curl-7586-139897408241328"
Jul 24 18:26:15.675775 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.675765    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb35cd0-bafb-4b09-856b-95652640b012" containerName="test-curl-7586-139897408241328"
Jul 24 18:26:15.678477 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.678461    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:15.683842 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.683812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897408239152"]
Jul 24 18:26:15.700090 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.700063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9rmw\" (UniqueName: \"kubernetes.io/projected/1aae4772-6a16-403a-a9a4-2a9fa2a80147-kube-api-access-b9rmw\") pod \"test-curl-7586-139897408239152\" (UID: \"1aae4772-6a16-403a-a9a4-2a9fa2a80147\") " pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:15.800625 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.800586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rmw\" (UniqueName: \"kubernetes.io/projected/1aae4772-6a16-403a-a9a4-2a9fa2a80147-kube-api-access-b9rmw\") pod \"test-curl-7586-139897408239152\" (UID: \"1aae4772-6a16-403a-a9a4-2a9fa2a80147\") " pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:15.810001 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.809959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rmw\" (UniqueName: \"kubernetes.io/projected/1aae4772-6a16-403a-a9a4-2a9fa2a80147-kube-api-access-b9rmw\") pod \"test-curl-7586-139897408239152\" (UID: \"1aae4772-6a16-403a-a9a4-2a9fa2a80147\") " pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:15.989327 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:15.989282    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:16.129465 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:16.129434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897408239152"]
Jul 24 18:26:16.130898 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:26:16.130874    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1aae4772_6a16_403a_a9a4_2a9fa2a80147.slice/crio-40c2f867aecf46bc619b4866282c3e486575f59a2cda426b05ecec19d5b3d4d4 WatchSource:0}: Error finding container 40c2f867aecf46bc619b4866282c3e486575f59a2cda426b05ecec19d5b3d4d4: Status 404 returned error can't find the container with id 40c2f867aecf46bc619b4866282c3e486575f59a2cda426b05ecec19d5b3d4d4
Jul 24 18:26:16.339435 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:16.339325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897408239152" event={"ID":"1aae4772-6a16-403a-a9a4-2a9fa2a80147","Type":"ContainerStarted","Data":"40c2f867aecf46bc619b4866282c3e486575f59a2cda426b05ecec19d5b3d4d4"}
Jul 24 18:26:16.340699 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:16.340676    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:16.340802 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:16.340676    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6b981b380c7f6c40eb8be19d90669f4bca953c067bedbde68032dba60cb7260"
Jul 24 18:26:16.352544 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:26:16.352510    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7586-139897408241328\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="acb35cd0-bafb-4b09-856b-95652640b012" pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:17.347995 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:17.347959    2564 generic.go:356] "Generic (PLEG): container finished" podID="1aae4772-6a16-403a-a9a4-2a9fa2a80147" containerID="c46b653534b5a8d8b40e11d2bcc7eec7d021b93972047d7daee78277b51e84f9" exitCode=0
Jul 24 18:26:17.348433 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:17.348054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897408239152" event={"ID":"1aae4772-6a16-403a-a9a4-2a9fa2a80147","Type":"ContainerDied","Data":"c46b653534b5a8d8b40e11d2bcc7eec7d021b93972047d7daee78277b51e84f9"}
Jul 24 18:26:17.364990 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:26:17.364955    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7586-139897408241328\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="acb35cd0-bafb-4b09-856b-95652640b012" pod="opendatahub/test-curl-7586-139897408241328"
Jul 24 18:26:17.460544 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:17.460510    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acb35cd0-bafb-4b09-856b-95652640b012" path="/var/lib/kubelet/pods/acb35cd0-bafb-4b09-856b-95652640b012/volumes"
Jul 24 18:26:18.492643 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.492615    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:18.513352 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.513265    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7586-139897408239152_1aae4772-6a16-403a-a9a4-2a9fa2a80147/test-curl-7586-139897408239152/0.log"
Jul 24 18:26:18.528579 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.528554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9rmw\" (UniqueName: \"kubernetes.io/projected/1aae4772-6a16-403a-a9a4-2a9fa2a80147-kube-api-access-b9rmw\") pod \"1aae4772-6a16-403a-a9a4-2a9fa2a80147\" (UID: \"1aae4772-6a16-403a-a9a4-2a9fa2a80147\") "
Jul 24 18:26:18.530663 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.530635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aae4772-6a16-403a-a9a4-2a9fa2a80147-kube-api-access-b9rmw" (OuterVolumeSpecName: "kube-api-access-b9rmw") pod "1aae4772-6a16-403a-a9a4-2a9fa2a80147" (UID: "1aae4772-6a16-403a-a9a4-2a9fa2a80147"). InnerVolumeSpecName "kube-api-access-b9rmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:26:18.539336 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.539313    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-139897408239152"]
Jul 24 18:26:18.542379 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.542357    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-139897408239152"]
Jul 24 18:26:18.629567 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.629484    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9rmw\" (UniqueName: \"kubernetes.io/projected/1aae4772-6a16-403a-a9a4-2a9fa2a80147-kube-api-access-b9rmw\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:26:18.713403 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.713370    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:18.713818 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.713806    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aae4772-6a16-403a-a9a4-2a9fa2a80147" containerName="test-curl-7586-139897408239152"
Jul 24 18:26:18.713863 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.713820    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aae4772-6a16-403a-a9a4-2a9fa2a80147" containerName="test-curl-7586-139897408239152"
Jul 24 18:26:18.713911 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.713902    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aae4772-6a16-403a-a9a4-2a9fa2a80147" containerName="test-curl-7586-139897408239152"
Jul 24 18:26:18.716920 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.716904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:18.724134 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.724101    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:18.831777 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.831745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4srw\" (UniqueName: \"kubernetes.io/projected/696f3bb4-ab7c-48d5-81b5-6e5c52039833-kube-api-access-z4srw\") pod \"test-curl-7586-139897401755376\" (UID: \"696f3bb4-ab7c-48d5-81b5-6e5c52039833\") " pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:18.932702 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.932661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4srw\" (UniqueName: \"kubernetes.io/projected/696f3bb4-ab7c-48d5-81b5-6e5c52039833-kube-api-access-z4srw\") pod \"test-curl-7586-139897401755376\" (UID: \"696f3bb4-ab7c-48d5-81b5-6e5c52039833\") " pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:18.941510 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:18.941479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4srw\" (UniqueName: \"kubernetes.io/projected/696f3bb4-ab7c-48d5-81b5-6e5c52039833-kube-api-access-z4srw\") pod \"test-curl-7586-139897401755376\" (UID: \"696f3bb4-ab7c-48d5-81b5-6e5c52039833\") " pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:19.028198 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:19.028152    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:19.164970 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:26:19.164941    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod696f3bb4_ab7c_48d5_81b5_6e5c52039833.slice/crio-3d6a8e0453c5c128d15237da4b6d8eec1bdfa5fd54ae0b03dd748000a8d2ff5d WatchSource:0}: Error finding container 3d6a8e0453c5c128d15237da4b6d8eec1bdfa5fd54ae0b03dd748000a8d2ff5d: Status 404 returned error can't find the container with id 3d6a8e0453c5c128d15237da4b6d8eec1bdfa5fd54ae0b03dd748000a8d2ff5d
Jul 24 18:26:19.165511 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:19.165480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:19.369256 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:19.369208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897401755376" event={"ID":"696f3bb4-ab7c-48d5-81b5-6e5c52039833","Type":"ContainerStarted","Data":"3d6a8e0453c5c128d15237da4b6d8eec1bdfa5fd54ae0b03dd748000a8d2ff5d"}
Jul 24 18:26:19.370364 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:19.370342    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40c2f867aecf46bc619b4866282c3e486575f59a2cda426b05ecec19d5b3d4d4"
Jul 24 18:26:19.370519 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:19.370384    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:19.380974 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:26:19.380946    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7586-139897408239152\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="1aae4772-6a16-403a-a9a4-2a9fa2a80147" pod="opendatahub/test-curl-7586-139897408239152"
Jul 24 18:26:19.460958 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:19.460877    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aae4772-6a16-403a-a9a4-2a9fa2a80147" path="/var/lib/kubelet/pods/1aae4772-6a16-403a-a9a4-2a9fa2a80147/volumes"
Jul 24 18:26:20.378710 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:20.378669    2564 generic.go:356] "Generic (PLEG): container finished" podID="696f3bb4-ab7c-48d5-81b5-6e5c52039833" containerID="baf4b88072cae07e11ad8dc135a9292e6a87f1883559ed57d28c8770a868d277" exitCode=0
Jul 24 18:26:20.379163 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:20.378759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897401755376" event={"ID":"696f3bb4-ab7c-48d5-81b5-6e5c52039833","Type":"ContainerDied","Data":"baf4b88072cae07e11ad8dc135a9292e6a87f1883559ed57d28c8770a868d277"}
Jul 24 18:26:21.536981 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.536956    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:21.559238 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.559209    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7586-139897401755376_696f3bb4-ab7c-48d5-81b5-6e5c52039833/test-curl-7586-139897401755376/0.log"
Jul 24 18:26:21.586039 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.586007    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:21.588630 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.588609    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:21.657409 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.657371    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4srw\" (UniqueName: \"kubernetes.io/projected/696f3bb4-ab7c-48d5-81b5-6e5c52039833-kube-api-access-z4srw\") pod \"696f3bb4-ab7c-48d5-81b5-6e5c52039833\" (UID: \"696f3bb4-ab7c-48d5-81b5-6e5c52039833\") "
Jul 24 18:26:21.659434 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.659408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696f3bb4-ab7c-48d5-81b5-6e5c52039833-kube-api-access-z4srw" (OuterVolumeSpecName: "kube-api-access-z4srw") pod "696f3bb4-ab7c-48d5-81b5-6e5c52039833" (UID: "696f3bb4-ab7c-48d5-81b5-6e5c52039833"). InnerVolumeSpecName "kube-api-access-z4srw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:26:21.712074 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.712041    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:21.712488 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.712475    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696f3bb4-ab7c-48d5-81b5-6e5c52039833" containerName="test-curl-7586-139897401755376"
Jul 24 18:26:21.712554 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.712489    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="696f3bb4-ab7c-48d5-81b5-6e5c52039833" containerName="test-curl-7586-139897401755376"
Jul 24 18:26:21.712596 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.712572    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="696f3bb4-ab7c-48d5-81b5-6e5c52039833" containerName="test-curl-7586-139897401755376"
Jul 24 18:26:21.715877 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.715857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:21.725269 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.725247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:21.758492 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.758454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87cj\" (UniqueName: \"kubernetes.io/projected/5905381b-d4a8-47b1-bdfe-fcb4ec95603c-kube-api-access-b87cj\") pod \"test-curl-7586-139897401755376\" (UID: \"5905381b-d4a8-47b1-bdfe-fcb4ec95603c\") " pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:21.758663 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.758583    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4srw\" (UniqueName: \"kubernetes.io/projected/696f3bb4-ab7c-48d5-81b5-6e5c52039833-kube-api-access-z4srw\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:26:21.859989 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.859945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87cj\" (UniqueName: \"kubernetes.io/projected/5905381b-d4a8-47b1-bdfe-fcb4ec95603c-kube-api-access-b87cj\") pod \"test-curl-7586-139897401755376\" (UID: \"5905381b-d4a8-47b1-bdfe-fcb4ec95603c\") " pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:21.868761 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:21.868736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87cj\" (UniqueName: \"kubernetes.io/projected/5905381b-d4a8-47b1-bdfe-fcb4ec95603c-kube-api-access-b87cj\") pod \"test-curl-7586-139897401755376\" (UID: \"5905381b-d4a8-47b1-bdfe-fcb4ec95603c\") " pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:22.026723 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:22.026637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:22.167321 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:22.167297    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:22.168900 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:26:22.168871    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5905381b_d4a8_47b1_bdfe_fcb4ec95603c.slice/crio-311029f3cb027a54b3a565fa6d3f16d9a9fd854763dc1c417272c4452cefa9c2 WatchSource:0}: Error finding container 311029f3cb027a54b3a565fa6d3f16d9a9fd854763dc1c417272c4452cefa9c2: Status 404 returned error can't find the container with id 311029f3cb027a54b3a565fa6d3f16d9a9fd854763dc1c417272c4452cefa9c2
Jul 24 18:26:22.391802 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:22.391779    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:22.391980 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:22.391804    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d6a8e0453c5c128d15237da4b6d8eec1bdfa5fd54ae0b03dd748000a8d2ff5d"
Jul 24 18:26:22.393259 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:22.393232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897401755376" event={"ID":"5905381b-d4a8-47b1-bdfe-fcb4ec95603c","Type":"ContainerStarted","Data":"311029f3cb027a54b3a565fa6d3f16d9a9fd854763dc1c417272c4452cefa9c2"}
Jul 24 18:26:22.403751 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:22.403718    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7586-139897401755376" oldPodUID="696f3bb4-ab7c-48d5-81b5-6e5c52039833" podUID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c"
Jul 24 18:26:23.401395 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:23.401353    2564 generic.go:356] "Generic (PLEG): container finished" podID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c" containerID="8ff57c9ddbaa7dd3f55115cbcb9daf54d5df94d8eec9cfb1e6af8aca0a340208" exitCode=0
Jul 24 18:26:23.401843 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:23.401432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897401755376" event={"ID":"5905381b-d4a8-47b1-bdfe-fcb4ec95603c","Type":"ContainerDied","Data":"8ff57c9ddbaa7dd3f55115cbcb9daf54d5df94d8eec9cfb1e6af8aca0a340208"}
Jul 24 18:26:23.460554 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:23.460523    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="696f3bb4-ab7c-48d5-81b5-6e5c52039833" path="/var/lib/kubelet/pods/696f3bb4-ab7c-48d5-81b5-6e5c52039833/volumes"
Jul 24 18:26:24.552475 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.552449    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:24.577007 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.576969    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7586-139897401755376_5905381b-d4a8-47b1-bdfe-fcb4ec95603c/test-curl-7586-139897401755376/0.log"
Jul 24 18:26:24.585871 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.585733    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b87cj\" (UniqueName: \"kubernetes.io/projected/5905381b-d4a8-47b1-bdfe-fcb4ec95603c-kube-api-access-b87cj\") pod \"5905381b-d4a8-47b1-bdfe-fcb4ec95603c\" (UID: \"5905381b-d4a8-47b1-bdfe-fcb4ec95603c\") "
Jul 24 18:26:24.588357 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.588326    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5905381b-d4a8-47b1-bdfe-fcb4ec95603c-kube-api-access-b87cj" (OuterVolumeSpecName: "kube-api-access-b87cj") pod "5905381b-d4a8-47b1-bdfe-fcb4ec95603c" (UID: "5905381b-d4a8-47b1-bdfe-fcb4ec95603c"). InnerVolumeSpecName "kube-api-access-b87cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:26:24.607274 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.606862    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:24.610092 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.610062    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-139897401755376"]
Jul 24 18:26:24.686893 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.686801    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b87cj\" (UniqueName: \"kubernetes.io/projected/5905381b-d4a8-47b1-bdfe-fcb4ec95603c-kube-api-access-b87cj\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:26:24.725732 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.725697    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-139897408095696"]
Jul 24 18:26:24.726167 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.726154    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c" containerName="test-curl-7586-139897401755376"
Jul 24 18:26:24.726231 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.726169    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c" containerName="test-curl-7586-139897401755376"
Jul 24 18:26:24.726264 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.726253    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c" containerName="test-curl-7586-139897401755376"
Jul 24 18:26:24.729557 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.729536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:24.735784 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.735759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897408095696"]
Jul 24 18:26:24.787815 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.787778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79w9d\" (UniqueName: \"kubernetes.io/projected/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9-kube-api-access-79w9d\") pod \"test-curl-7586-139897408095696\" (UID: \"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9\") " pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:24.888439 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.888405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79w9d\" (UniqueName: \"kubernetes.io/projected/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9-kube-api-access-79w9d\") pod \"test-curl-7586-139897408095696\" (UID: \"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9\") " pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:24.898105 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:24.898074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79w9d\" (UniqueName: \"kubernetes.io/projected/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9-kube-api-access-79w9d\") pod \"test-curl-7586-139897408095696\" (UID: \"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9\") " pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:25.040944 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:25.040843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:25.183296 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:25.183271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-139897408095696"]
Jul 24 18:26:25.184569 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:26:25.184536    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ab4b7ba_24e8_45c1_b4f1_602fb6bf54a9.slice/crio-c753633fb0d40e93ade9d4572a229a831b33748b629f98bc8641dbdbc9eaf45e WatchSource:0}: Error finding container c753633fb0d40e93ade9d4572a229a831b33748b629f98bc8641dbdbc9eaf45e: Status 404 returned error can't find the container with id c753633fb0d40e93ade9d4572a229a831b33748b629f98bc8641dbdbc9eaf45e
Jul 24 18:26:25.416795 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:25.416760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897408095696" event={"ID":"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9","Type":"ContainerStarted","Data":"c753633fb0d40e93ade9d4572a229a831b33748b629f98bc8641dbdbc9eaf45e"}
Jul 24 18:26:25.418004 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:25.417982    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="311029f3cb027a54b3a565fa6d3f16d9a9fd854763dc1c417272c4452cefa9c2"
Jul 24 18:26:25.418004 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:25.417984    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:25.429712 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:26:25.429685    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7586-139897401755376\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c" pod="opendatahub/test-curl-7586-139897401755376"
Jul 24 18:26:25.461010 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:25.460988    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5905381b-d4a8-47b1-bdfe-fcb4ec95603c" path="/var/lib/kubelet/pods/5905381b-d4a8-47b1-bdfe-fcb4ec95603c/volumes"
Jul 24 18:26:26.427174 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:26.427142    2564 generic.go:356] "Generic (PLEG): container finished" podID="2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" containerID="cb75e13f125fd2b11c94fe2b6b51ba52a8fb65eecd0daf9b481111a8747867cc" exitCode=0
Jul 24 18:26:26.427563 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:26.427232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-139897408095696" event={"ID":"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9","Type":"ContainerDied","Data":"cb75e13f125fd2b11c94fe2b6b51ba52a8fb65eecd0daf9b481111a8747867cc"}
Jul 24 18:26:27.575097 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.575072    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:27.596360 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.596331    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7586-139897408095696_2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9/test-curl-7586-139897408095696/0.log"
Jul 24 18:26:27.614538 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.614508    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79w9d\" (UniqueName: \"kubernetes.io/projected/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9-kube-api-access-79w9d\") pod \"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9\" (UID: \"2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9\") "
Jul 24 18:26:27.616576 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.616544    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9-kube-api-access-79w9d" (OuterVolumeSpecName: "kube-api-access-79w9d") pod "2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" (UID: "2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9"). InnerVolumeSpecName "kube-api-access-79w9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:26:27.626623 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.626600    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-139897408095696"]
Jul 24 18:26:27.630122 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.630103    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-139897408095696"]
Jul 24 18:26:27.716118 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:27.716014    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79w9d\" (UniqueName: \"kubernetes.io/projected/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9-kube-api-access-79w9d\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:26:28.440682 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:28.440652    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:28.440839 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:28.440663    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c753633fb0d40e93ade9d4572a229a831b33748b629f98bc8641dbdbc9eaf45e"
Jul 24 18:26:28.450924 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:26:28.450895    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7586-139897408095696\" is forbidden: User \"system:node:ip-10-0-139-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-114.ec2.internal' and this object" podUID="2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" pod="opendatahub/test-curl-7586-139897408095696"
Jul 24 18:26:29.460779 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:26:29.460741    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" path="/var/lib/kubelet/pods/2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9/volumes"
Jul 24 18:27:00.419086 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.419049    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"]
Jul 24 18:27:00.419554 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.419499    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" containerName="test-curl-7586-139897408095696"
Jul 24 18:27:00.419554 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.419511    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" containerName="test-curl-7586-139897408095696"
Jul 24 18:27:00.419628 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.419610    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab4b7ba-24e8-45c1-b4f1-602fb6bf54a9" containerName="test-curl-7586-139897408095696"
Jul 24 18:27:00.422778 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.422761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.425458 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.425438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-7ee2e6-serving-cert\""
Jul 24 18:27:00.433743 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.433722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"]
Jul 24 18:27:00.544250 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.544214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1ca16c-466e-4d66-8a59-5fac2868398b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.544456 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.544323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.544456 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.544405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jts\" (UniqueName: \"kubernetes.io/projected/8a1ca16c-466e-4d66-8a59-5fac2868398b-kube-api-access-p2jts\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.645389 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.645355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.645569 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.645408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jts\" (UniqueName: \"kubernetes.io/projected/8a1ca16c-466e-4d66-8a59-5fac2868398b-kube-api-access-p2jts\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.645569 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.645467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1ca16c-466e-4d66-8a59-5fac2868398b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.645569 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:27:00.645511    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-serving-cert: secret "maas-api-e2e-ipp-a-7ee2e6-serving-cert" not found
Jul 24 18:27:00.645863 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:27:00.645598    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls podName:8a1ca16c-466e-4d66-8a59-5fac2868398b nodeName:}" failed. No retries permitted until 2026-07-24 18:27:01.145578443 +0000 UTC m=+3020.177958786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls") pod "maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" (UID: "8a1ca16c-466e-4d66-8a59-5fac2868398b") : secret "maas-api-e2e-ipp-a-7ee2e6-serving-cert" not found
Jul 24 18:27:00.646270 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.646246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1ca16c-466e-4d66-8a59-5fac2868398b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:00.660512 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:00.660484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jts\" (UniqueName: \"kubernetes.io/projected/8a1ca16c-466e-4d66-8a59-5fac2868398b-kube-api-access-p2jts\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:01.150068 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:01.150009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:01.152421 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:01.152393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:01.334633 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:01.334585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:01.702975 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:01.702931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"]
Jul 24 18:27:01.704280 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:27:01.704255    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1ca16c_466e_4d66_8a59_5fac2868398b.slice/crio-51596aa8ceeafc6c61d007b33a319b214bf131a0ccc2d44e4885a9d99453d6be WatchSource:0}: Error finding container 51596aa8ceeafc6c61d007b33a319b214bf131a0ccc2d44e4885a9d99453d6be: Status 404 returned error can't find the container with id 51596aa8ceeafc6c61d007b33a319b214bf131a0ccc2d44e4885a9d99453d6be
Jul 24 18:27:02.653571 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:02.653528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" event={"ID":"8a1ca16c-466e-4d66-8a59-5fac2868398b","Type":"ContainerStarted","Data":"9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907"}
Jul 24 18:27:02.653758 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:02.653592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" event={"ID":"8a1ca16c-466e-4d66-8a59-5fac2868398b","Type":"ContainerStarted","Data":"51596aa8ceeafc6c61d007b33a319b214bf131a0ccc2d44e4885a9d99453d6be"}
Jul 24 18:27:02.653809 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:02.653766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:02.813154 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:02.813093    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" podStartSLOduration=2.305532847 podStartE2EDuration="2.813072178s" totalImagesPullingTime="507.539331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:27:02.808730625 +0000 UTC m=+3021.841110983" watchObservedRunningTime="2026-07-24 18:27:02.813072178 +0000 UTC m=+3021.845452536"
Jul 24 18:27:08.665191 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:08.665161    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:27:16.088525 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.088491    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"]
Jul 24 18:27:16.092680 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.092658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.095588 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.095565    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-e18e67-openshift-default-dockercfg-pttch\""
Jul 24 18:27:16.107800 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.107775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"]
Jul 24 18:27:16.203419 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-certs\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203612 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-socket\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203612 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ddfee28-df5c-44d6-a800-106f3f73d00d-istiod-ca-cert\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203612 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-token\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203612 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpqk\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-kube-api-access-xrpqk\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203859 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-envoy\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203859 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-data\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.203859 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-credential-socket\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.204000 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.203854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-podinfo\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.304986 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.304951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-socket\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.304986 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.304993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ddfee28-df5c-44d6-a800-106f3f73d00d-istiod-ca-cert\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305234 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-token\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305234 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpqk\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-kube-api-access-xrpqk\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305234 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-envoy\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305234 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-data\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305234 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-credential-socket\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305490 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-podinfo\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305490 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-certs\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305490 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-socket\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305740 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-certs\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.305981 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.305942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ddfee28-df5c-44d6-a800-106f3f73d00d-istiod-ca-cert\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.306124 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.306062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-credential-socket\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.306124 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.306086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-data\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.307851 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.307826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-envoy\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.307953 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.307880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-podinfo\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.313529 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.313510    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpqk\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-kube-api-access-xrpqk\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.313634 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.313613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-token\") pod \"e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") " pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.407083 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.407047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:16.551928 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.551885    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"]
Jul 24 18:27:16.557262 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.557228    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 18:27:16.557368 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.557292    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 18:27:16.557368 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.557319    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 18:27:16.747806 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.747690    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" event={"ID":"0ddfee28-df5c-44d6-a800-106f3f73d00d","Type":"ContainerStarted","Data":"b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"}
Jul 24 18:27:16.747806 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.747762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" event={"ID":"0ddfee28-df5c-44d6-a800-106f3f73d00d","Type":"ContainerStarted","Data":"0a57159ec24fc04fca1234b0cf01abedca2b2b2a739c5e0bdb73c3415864bb02"}
Jul 24 18:27:16.774556 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:16.774494    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podStartSLOduration=0.774475712 podStartE2EDuration="774.475712ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:27:16.771757185 +0000 UTC m=+3035.804137543" watchObservedRunningTime="2026-07-24 18:27:16.774475712 +0000 UTC m=+3035.806856069"
Jul 24 18:27:17.407990 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:17.407951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:17.413159 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:17.413133    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:17.753732 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:17.753651    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:17.754576 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:17.754554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:33.166496 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.165619    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": read tcp 10.133.0.2:41810->10.133.0.92:15021: read: connection reset by peer" start-of-body=
Jul 24 18:27:33.166496 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.165683    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": read tcp 10.133.0.2:41810->10.133.0.92:15021: read: connection reset by peer"
Jul 24 18:27:33.870128 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.870095    2564 generic.go:356] "Generic (PLEG): container finished" podID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerID="b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46" exitCode=0
Jul 24 18:27:33.870298 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.870177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" event={"ID":"0ddfee28-df5c-44d6-a800-106f3f73d00d","Type":"ContainerDied","Data":"b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"}
Jul 24 18:27:33.870616 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.870604    2564 scope.go:117] "RemoveContainer" containerID="b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"
Jul 24 18:27:33.871839 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.871779    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 18:27:33.871938 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.871883    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 18:27:33.871938 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:33.871911    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 18:27:34.885740 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:34.885692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" event={"ID":"0ddfee28-df5c-44d6-a800-106f3f73d00d","Type":"ContainerStarted","Data":"11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6"}
Jul 24 18:27:35.407472 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:35.407429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:35.407917 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:35.407886    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 24 18:27:35.408062 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:35.407959    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 24 18:27:36.408193 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:36.408152    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 24 18:27:36.409257 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:36.408808    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 24 18:27:37.408501 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:37.408454    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 24 18:27:37.409037 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:37.408535    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 24 18:27:38.408096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:38.408052    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 24 18:27:38.408328 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:38.408119    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 24 18:27:39.410909 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:39.410871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:39.411353 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:39.411287    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:39.411918 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:39.411900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:27:45.873736 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:27:45.873689    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mnflf_64676a42-5be0-44c3-8939-b30c9095dcf0/payload-processing/0.log"
Jul 24 18:28:22.747938 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:22.747902    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mnflf_64676a42-5be0-44c3-8939-b30c9095dcf0/payload-processing/0.log"
Jul 24 18:28:42.039273 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.039230    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"]
Jul 24 18:28:42.042950 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.042933    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:42.045424 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.045405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:28:42.050877 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.050675    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"]
Jul 24 18:28:42.178308 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.178271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99ccb8-d144-4c04-9f09-f902001ba955-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k\" (UID: \"db99ccb8-d144-4c04-9f09-f902001ba955\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:42.279284 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.279248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99ccb8-d144-4c04-9f09-f902001ba955-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k\" (UID: \"db99ccb8-d144-4c04-9f09-f902001ba955\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:42.279935 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.279908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99ccb8-d144-4c04-9f09-f902001ba955-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k\" (UID: \"db99ccb8-d144-4c04-9f09-f902001ba955\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:42.355088 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.354963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:42.504608 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:28:42.504576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb99ccb8_d144_4c04_9f09_f902001ba955.slice/crio-1192fdf3c643b0fa16860aded58013826c1ad4e95d2a144840ed2be8310a5dcf WatchSource:0}: Error finding container 1192fdf3c643b0fa16860aded58013826c1ad4e95d2a144840ed2be8310a5dcf: Status 404 returned error can't find the container with id 1192fdf3c643b0fa16860aded58013826c1ad4e95d2a144840ed2be8310a5dcf
Jul 24 18:28:42.508504 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:42.508474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"]
Jul 24 18:28:43.328699 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:43.328664    2564 generic.go:356] "Generic (PLEG): container finished" podID="db99ccb8-d144-4c04-9f09-f902001ba955" containerID="ac8d9210164c0c8269f856cc1b6748184f05f2b81c8bbb92dd1dfa46df7d058d" exitCode=0
Jul 24 18:28:43.329089 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:43.328750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k" event={"ID":"db99ccb8-d144-4c04-9f09-f902001ba955","Type":"ContainerDied","Data":"ac8d9210164c0c8269f856cc1b6748184f05f2b81c8bbb92dd1dfa46df7d058d"}
Jul 24 18:28:43.329089 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:43.328809    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k" event={"ID":"db99ccb8-d144-4c04-9f09-f902001ba955","Type":"ContainerStarted","Data":"1192fdf3c643b0fa16860aded58013826c1ad4e95d2a144840ed2be8310a5dcf"}
Jul 24 18:28:44.465130 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:44.465098    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:44.603984 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:44.603867    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99ccb8-d144-4c04-9f09-f902001ba955-maas-api-service-ca\") pod \"db99ccb8-d144-4c04-9f09-f902001ba955\" (UID: \"db99ccb8-d144-4c04-9f09-f902001ba955\") "
Jul 24 18:28:44.604289 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:44.604266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db99ccb8-d144-4c04-9f09-f902001ba955-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "db99ccb8-d144-4c04-9f09-f902001ba955" (UID: "db99ccb8-d144-4c04-9f09-f902001ba955"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:28:44.705422 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:44.705385    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99ccb8-d144-4c04-9f09-f902001ba955-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:28:45.343212 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:45.343180    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k" event={"ID":"db99ccb8-d144-4c04-9f09-f902001ba955","Type":"ContainerDied","Data":"1192fdf3c643b0fa16860aded58013826c1ad4e95d2a144840ed2be8310a5dcf"}
Jul 24 18:28:45.343389 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:45.343235    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1192fdf3c643b0fa16860aded58013826c1ad4e95d2a144840ed2be8310a5dcf"
Jul 24 18:28:45.343389 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:45.343189    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"
Jul 24 18:28:57.126319 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:57.126281    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"]
Jul 24 18:28:57.131472 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:57.131445    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-a2a4d8-2km4k"]
Jul 24 18:28:57.461133 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:28:57.461099    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db99ccb8-d144-4c04-9f09-f902001ba955" path="/var/lib/kubelet/pods/db99ccb8-d144-4c04-9f09-f902001ba955/volumes"
Jul 24 18:29:07.385130 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.385049    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"]
Jul 24 18:29:07.385558 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.385543    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db99ccb8-d144-4c04-9f09-f902001ba955" containerName="revoke-keys"
Jul 24 18:29:07.385603 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.385559    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db99ccb8-d144-4c04-9f09-f902001ba955" containerName="revoke-keys"
Jul 24 18:29:07.385648 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.385638    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db99ccb8-d144-4c04-9f09-f902001ba955" containerName="revoke-keys"
Jul 24 18:29:07.388863 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.388846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:07.391501 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.391482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:29:07.397214 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.397158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"]
Jul 24 18:29:07.519803 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.519762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea15cdcd-1b67-40fd-8c30-390d9b5edc05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9\" (UID: \"ea15cdcd-1b67-40fd-8c30-390d9b5edc05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:07.621322 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.621289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea15cdcd-1b67-40fd-8c30-390d9b5edc05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9\" (UID: \"ea15cdcd-1b67-40fd-8c30-390d9b5edc05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:07.621883 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.621863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea15cdcd-1b67-40fd-8c30-390d9b5edc05-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9\" (UID: \"ea15cdcd-1b67-40fd-8c30-390d9b5edc05\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:07.702300 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.702268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:07.848447 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:29:07.848408    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea15cdcd_1b67_40fd_8c30_390d9b5edc05.slice/crio-81014b362e6652ef8748d9ebde6d69e836ef9de4891fd0ee3b49a98ffab71153 WatchSource:0}: Error finding container 81014b362e6652ef8748d9ebde6d69e836ef9de4891fd0ee3b49a98ffab71153: Status 404 returned error can't find the container with id 81014b362e6652ef8748d9ebde6d69e836ef9de4891fd0ee3b49a98ffab71153
Jul 24 18:29:07.848915 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:07.848888    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"]
Jul 24 18:29:08.492966 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:08.492928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9" event={"ID":"ea15cdcd-1b67-40fd-8c30-390d9b5edc05","Type":"ContainerStarted","Data":"cc396365c1a01265a1888f9a71b99fa3e365bb3e3e0f20b4df0c72e2386d8a81"}
Jul 24 18:29:08.493414 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:08.492985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9" event={"ID":"ea15cdcd-1b67-40fd-8c30-390d9b5edc05","Type":"ContainerStarted","Data":"81014b362e6652ef8748d9ebde6d69e836ef9de4891fd0ee3b49a98ffab71153"}
Jul 24 18:29:08.508893 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:08.508803    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9" podStartSLOduration=1.508781629 podStartE2EDuration="1.508781629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:29:08.508482329 +0000 UTC m=+3147.540862689" watchObservedRunningTime="2026-07-24 18:29:08.508781629 +0000 UTC m=+3147.541161986"
Jul 24 18:29:09.500711 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:09.500675    2564 generic.go:356] "Generic (PLEG): container finished" podID="ea15cdcd-1b67-40fd-8c30-390d9b5edc05" containerID="cc396365c1a01265a1888f9a71b99fa3e365bb3e3e0f20b4df0c72e2386d8a81" exitCode=0
Jul 24 18:29:09.501089 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:09.500765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9" event={"ID":"ea15cdcd-1b67-40fd-8c30-390d9b5edc05","Type":"ContainerDied","Data":"cc396365c1a01265a1888f9a71b99fa3e365bb3e3e0f20b4df0c72e2386d8a81"}
Jul 24 18:29:10.654689 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:10.654665    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:10.754957 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:10.754924    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea15cdcd-1b67-40fd-8c30-390d9b5edc05-maas-api-service-ca\") pod \"ea15cdcd-1b67-40fd-8c30-390d9b5edc05\" (UID: \"ea15cdcd-1b67-40fd-8c30-390d9b5edc05\") "
Jul 24 18:29:10.755345 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:10.755320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea15cdcd-1b67-40fd-8c30-390d9b5edc05-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea15cdcd-1b67-40fd-8c30-390d9b5edc05" (UID: "ea15cdcd-1b67-40fd-8c30-390d9b5edc05"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:29:10.856594 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:10.856505    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea15cdcd-1b67-40fd-8c30-390d9b5edc05-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:29:11.523167 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:11.523128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9" event={"ID":"ea15cdcd-1b67-40fd-8c30-390d9b5edc05","Type":"ContainerDied","Data":"81014b362e6652ef8748d9ebde6d69e836ef9de4891fd0ee3b49a98ffab71153"}
Jul 24 18:29:11.523167 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:11.523155    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"
Jul 24 18:29:11.523373 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:11.523202    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81014b362e6652ef8748d9ebde6d69e836ef9de4891fd0ee3b49a98ffab71153"
Jul 24 18:29:22.873992 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:22.873959    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"]
Jul 24 18:29:22.874477 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:22.874241    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" podUID="8a1ca16c-466e-4d66-8a59-5fac2868398b" containerName="maas-api" containerID="cri-o://9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907" gracePeriod=30
Jul 24 18:29:23.151712 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.151685    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:29:23.281194 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.281162    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls\") pod \"8a1ca16c-466e-4d66-8a59-5fac2868398b\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") "
Jul 24 18:29:23.281351 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.281221    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1ca16c-466e-4d66-8a59-5fac2868398b-openshift-service-ca\") pod \"8a1ca16c-466e-4d66-8a59-5fac2868398b\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") "
Jul 24 18:29:23.281351 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.281265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2jts\" (UniqueName: \"kubernetes.io/projected/8a1ca16c-466e-4d66-8a59-5fac2868398b-kube-api-access-p2jts\") pod \"8a1ca16c-466e-4d66-8a59-5fac2868398b\" (UID: \"8a1ca16c-466e-4d66-8a59-5fac2868398b\") "
Jul 24 18:29:23.281588 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.281556    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1ca16c-466e-4d66-8a59-5fac2868398b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a1ca16c-466e-4d66-8a59-5fac2868398b" (UID: "8a1ca16c-466e-4d66-8a59-5fac2868398b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:29:23.283284 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.283261    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a1ca16c-466e-4d66-8a59-5fac2868398b" (UID: "8a1ca16c-466e-4d66-8a59-5fac2868398b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:29:23.283349 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.283313    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1ca16c-466e-4d66-8a59-5fac2868398b-kube-api-access-p2jts" (OuterVolumeSpecName: "kube-api-access-p2jts") pod "8a1ca16c-466e-4d66-8a59-5fac2868398b" (UID: "8a1ca16c-466e-4d66-8a59-5fac2868398b"). InnerVolumeSpecName "kube-api-access-p2jts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:29:23.382905 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.382823    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a1ca16c-466e-4d66-8a59-5fac2868398b-maas-api-tls\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:29:23.382905 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.382853    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1ca16c-466e-4d66-8a59-5fac2868398b-openshift-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:29:23.382905 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.382867    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2jts\" (UniqueName: \"kubernetes.io/projected/8a1ca16c-466e-4d66-8a59-5fac2868398b-kube-api-access-p2jts\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:29:23.597349 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.597317    2564 generic.go:356] "Generic (PLEG): container finished" podID="8a1ca16c-466e-4d66-8a59-5fac2868398b" containerID="9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907" exitCode=0
Jul 24 18:29:23.597513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.597371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" event={"ID":"8a1ca16c-466e-4d66-8a59-5fac2868398b","Type":"ContainerDied","Data":"9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907"}
Jul 24 18:29:23.597513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.597388    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"
Jul 24 18:29:23.597513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.597420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q" event={"ID":"8a1ca16c-466e-4d66-8a59-5fac2868398b","Type":"ContainerDied","Data":"51596aa8ceeafc6c61d007b33a319b214bf131a0ccc2d44e4885a9d99453d6be"}
Jul 24 18:29:23.597513 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.597444    2564 scope.go:117] "RemoveContainer" containerID="9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907"
Jul 24 18:29:23.608146 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.608121    2564 scope.go:117] "RemoveContainer" containerID="9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907"
Jul 24 18:29:23.608420 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:29:23.608401    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907\": container with ID starting with 9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907 not found: ID does not exist" containerID="9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907"
Jul 24 18:29:23.608475 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.608427    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907"} err="failed to get container status \"9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907\": rpc error: code = NotFound desc = could not find container \"9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907\": container with ID starting with 9da1cf554b4e3fc226c451eb5a179fc088029b2f8f678b3abaf48e4dd7ffb907 not found: ID does not exist"
Jul 24 18:29:23.617901 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.617876    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"]
Jul 24 18:29:23.623756 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:23.623722    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7ee2e6-65bf55f6c9-pht8q"]
Jul 24 18:29:25.460730 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:25.460695    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1ca16c-466e-4d66-8a59-5fac2868398b" path="/var/lib/kubelet/pods/8a1ca16c-466e-4d66-8a59-5fac2868398b/volumes"
Jul 24 18:29:27.492140 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:27.492101    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"]
Jul 24 18:29:27.495375 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:27.495354    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7ee2e6-4wmr9"]
Jul 24 18:29:29.460697 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:29:29.460666    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea15cdcd-1b67-40fd-8c30-390d9b5edc05" path="/var/lib/kubelet/pods/ea15cdcd-1b67-40fd-8c30-390d9b5edc05/volumes"
Jul 24 18:30:00.162172 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162136    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"]
Jul 24 18:30:00.162623 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162608    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea15cdcd-1b67-40fd-8c30-390d9b5edc05" containerName="revoke-keys"
Jul 24 18:30:00.162623 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162624    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea15cdcd-1b67-40fd-8c30-390d9b5edc05" containerName="revoke-keys"
Jul 24 18:30:00.162705 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162641    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1ca16c-466e-4d66-8a59-5fac2868398b" containerName="maas-api"
Jul 24 18:30:00.162705 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162647    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1ca16c-466e-4d66-8a59-5fac2868398b" containerName="maas-api"
Jul 24 18:30:00.162768 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162719    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea15cdcd-1b67-40fd-8c30-390d9b5edc05" containerName="revoke-keys"
Jul 24 18:30:00.162768 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.162730    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1ca16c-466e-4d66-8a59-5fac2868398b" containerName="maas-api"
Jul 24 18:30:00.165908 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.165888    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"]
Jul 24 18:30:00.166068 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.166007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"
Jul 24 18:30:00.169449 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.169432    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"]
Jul 24 18:30:00.169564 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.169548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"
Jul 24 18:30:00.172824 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.172803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"
Jul 24 18:30:00.173891 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.173628    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"]
Jul 24 18:30:00.177274 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.177256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"
Jul 24 18:30:00.177944 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.177891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:30:00.182104 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.182087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"]
Jul 24 18:30:00.186103 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.186081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"]
Jul 24 18:30:00.188019 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.187998    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"
Jul 24 18:30:00.188835 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.188816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"
Jul 24 18:30:00.195462 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.195438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"]
Jul 24 18:30:00.198464 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.198447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"
Jul 24 18:30:00.206688 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.206462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"]
Jul 24 18:30:00.246587 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.246562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"
Jul 24 18:30:00.474298 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.474269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"]
Jul 24 18:30:00.475206 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:30:00.475178    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d190841_e53b_4e48_bb03_43d78f7b3310.slice/crio-cbeb27b1199133442cb847678cba23dad44cc997094de38e05793b776ea69dad WatchSource:0}: Error finding container cbeb27b1199133442cb847678cba23dad44cc997094de38e05793b776ea69dad: Status 404 returned error can't find the container with id cbeb27b1199133442cb847678cba23dad44cc997094de38e05793b776ea69dad
Jul 24 18:30:00.596441 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.596417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"]
Jul 24 18:30:00.597748 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:30:00.597723    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b669a70_ddeb_41b8_9bf1_c119a7efdffd.slice/crio-3cdd3217aa2de490132f779075f97328343a59f86533065c0f8d212792571a75 WatchSource:0}: Error finding container 3cdd3217aa2de490132f779075f97328343a59f86533065c0f8d212792571a75: Status 404 returned error can't find the container with id 3cdd3217aa2de490132f779075f97328343a59f86533065c0f8d212792571a75
Jul 24 18:30:00.633414 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.633391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"]
Jul 24 18:30:00.633534 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:30:00.633394    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2066408d_50c5_4950_b93e_af77a0836b01.slice/crio-7eab35455531ed58ea80e5bb285f9966965ad4aa9dc41cfd70dd0e70b0d85a8e WatchSource:0}: Error finding container 7eab35455531ed58ea80e5bb285f9966965ad4aa9dc41cfd70dd0e70b0d85a8e: Status 404 returned error can't find the container with id 7eab35455531ed58ea80e5bb285f9966965ad4aa9dc41cfd70dd0e70b0d85a8e
Jul 24 18:30:00.635850 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:30:00.635826    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76841d2_0c4e_4b1f_aaf3_5dfa3032aa83.slice/crio-17c0add4629d035c48963ad2c938a0cbf5b52e22474dd4b93f20bddcaddae5b1 WatchSource:0}: Error finding container 17c0add4629d035c48963ad2c938a0cbf5b52e22474dd4b93f20bddcaddae5b1: Status 404 returned error can't find the container with id 17c0add4629d035c48963ad2c938a0cbf5b52e22474dd4b93f20bddcaddae5b1
Jul 24 18:30:00.637567 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.637546    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"]
Jul 24 18:30:00.833660 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.833633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4" event={"ID":"6b669a70-ddeb-41b8-9bf1-c119a7efdffd","Type":"ContainerStarted","Data":"3cdd3217aa2de490132f779075f97328343a59f86533065c0f8d212792571a75"}
Jul 24 18:30:00.834879 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.834855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l" event={"ID":"d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83","Type":"ContainerStarted","Data":"17c0add4629d035c48963ad2c938a0cbf5b52e22474dd4b93f20bddcaddae5b1"}
Jul 24 18:30:00.836076 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.836053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679" event={"ID":"2066408d-50c5-4950-b93e-af77a0836b01","Type":"ContainerStarted","Data":"7eab35455531ed58ea80e5bb285f9966965ad4aa9dc41cfd70dd0e70b0d85a8e"}
Jul 24 18:30:00.837492 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.837474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv" event={"ID":"1d190841-e53b-4e48-bb03-43d78f7b3310","Type":"ContainerStarted","Data":"8a8a1d2876d18d2e4054e0e3f47c7898b879d25f1f53d2f5f1b4d0beefdd6fea"}
Jul 24 18:30:00.837550 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.837509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv" event={"ID":"1d190841-e53b-4e48-bb03-43d78f7b3310","Type":"ContainerStarted","Data":"cbeb27b1199133442cb847678cba23dad44cc997094de38e05793b776ea69dad"}
Jul 24 18:30:00.853770 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:00.853730    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv" podStartSLOduration=0.853717781 podStartE2EDuration="853.717781ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:30:00.853136801 +0000 UTC m=+3199.885517162" watchObservedRunningTime="2026-07-24 18:30:00.853717781 +0000 UTC m=+3199.886098139"
Jul 24 18:30:01.848799 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.848766    2564 generic.go:356] "Generic (PLEG): container finished" podID="d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83" containerID="0e265a7b7867192a2b59032bf81d116f1fc9398d8c02f211ed781305508f686d" exitCode=0
Jul 24 18:30:01.849193 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.848851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l" event={"ID":"d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83","Type":"ContainerDied","Data":"0e265a7b7867192a2b59032bf81d116f1fc9398d8c02f211ed781305508f686d"}
Jul 24 18:30:01.850369 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.850345    2564 generic.go:356] "Generic (PLEG): container finished" podID="2066408d-50c5-4950-b93e-af77a0836b01" containerID="57968af34907e951407701d385e03ea75d6a44a7e42532f0828aa7c947199c4e" exitCode=0
Jul 24 18:30:01.850484 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.850425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679" event={"ID":"2066408d-50c5-4950-b93e-af77a0836b01","Type":"ContainerDied","Data":"57968af34907e951407701d385e03ea75d6a44a7e42532f0828aa7c947199c4e"}
Jul 24 18:30:01.851795 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.851773    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d190841-e53b-4e48-bb03-43d78f7b3310" containerID="8a8a1d2876d18d2e4054e0e3f47c7898b879d25f1f53d2f5f1b4d0beefdd6fea" exitCode=0
Jul 24 18:30:01.851869 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.851850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv" event={"ID":"1d190841-e53b-4e48-bb03-43d78f7b3310","Type":"ContainerDied","Data":"8a8a1d2876d18d2e4054e0e3f47c7898b879d25f1f53d2f5f1b4d0beefdd6fea"}
Jul 24 18:30:01.853331 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.853313    2564 generic.go:356] "Generic (PLEG): container finished" podID="6b669a70-ddeb-41b8-9bf1-c119a7efdffd" containerID="01b1df6501ce6a8247715897bcc67cd42fe8d517f5af6ecf67ee68c627104243" exitCode=0
Jul 24 18:30:01.853427 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:01.853370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4" event={"ID":"6b669a70-ddeb-41b8-9bf1-c119a7efdffd","Type":"ContainerDied","Data":"01b1df6501ce6a8247715897bcc67cd42fe8d517f5af6ecf67ee68c627104243"}
Jul 24 18:30:03.034856 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.034825    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"
Jul 24 18:30:03.069938 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.069790    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"
Jul 24 18:30:03.117910 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.117841    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"
Jul 24 18:30:03.121493 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.121473    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"
Jul 24 18:30:03.867467 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.867383    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4"
Jul 24 18:30:03.867467 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.867409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748630-qzpt4" event={"ID":"6b669a70-ddeb-41b8-9bf1-c119a7efdffd","Type":"ContainerDied","Data":"3cdd3217aa2de490132f779075f97328343a59f86533065c0f8d212792571a75"}
Jul 24 18:30:03.867467 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.867458    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cdd3217aa2de490132f779075f97328343a59f86533065c0f8d212792571a75"
Jul 24 18:30:03.868751 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.868733    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"
Jul 24 18:30:03.868866 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.868771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l" event={"ID":"d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83","Type":"ContainerDied","Data":"17c0add4629d035c48963ad2c938a0cbf5b52e22474dd4b93f20bddcaddae5b1"}
Jul 24 18:30:03.868866 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.868817    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17c0add4629d035c48963ad2c938a0cbf5b52e22474dd4b93f20bddcaddae5b1"
Jul 24 18:30:03.870155 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.870138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"
Jul 24 18:30:03.870267 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.870159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679" event={"ID":"2066408d-50c5-4950-b93e-af77a0836b01","Type":"ContainerDied","Data":"7eab35455531ed58ea80e5bb285f9966965ad4aa9dc41cfd70dd0e70b0d85a8e"}
Jul 24 18:30:03.870267 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.870198    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eab35455531ed58ea80e5bb285f9966965ad4aa9dc41cfd70dd0e70b0d85a8e"
Jul 24 18:30:03.871649 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.871635    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"
Jul 24 18:30:03.871759 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.871680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv" event={"ID":"1d190841-e53b-4e48-bb03-43d78f7b3310","Type":"ContainerDied","Data":"cbeb27b1199133442cb847678cba23dad44cc997094de38e05793b776ea69dad"}
Jul 24 18:30:03.871759 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:03.871713    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbeb27b1199133442cb847678cba23dad44cc997094de38e05793b776ea69dad"
Jul 24 18:30:22.117684 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.117648    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"]
Jul 24 18:30:22.118146 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118133    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118147    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118157    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2066408d-50c5-4950-b93e-af77a0836b01" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118163    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2066408d-50c5-4950-b93e-af77a0836b01" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118175    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d190841-e53b-4e48-bb03-43d78f7b3310" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118180    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d190841-e53b-4e48-bb03-43d78f7b3310" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118200    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b669a70-ddeb-41b8-9bf1-c119a7efdffd" containerName="cleanup"
Jul 24 18:30:22.118202 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118205    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b669a70-ddeb-41b8-9bf1-c119a7efdffd" containerName="cleanup"
Jul 24 18:30:22.118432 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118271    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d190841-e53b-4e48-bb03-43d78f7b3310" containerName="cleanup"
Jul 24 18:30:22.118432 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118278    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83" containerName="cleanup"
Jul 24 18:30:22.118432 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118287    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b669a70-ddeb-41b8-9bf1-c119a7efdffd" containerName="cleanup"
Jul 24 18:30:22.118432 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.118293    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2066408d-50c5-4950-b93e-af77a0836b01" containerName="cleanup"
Jul 24 18:30:22.121593 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.121573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:22.124595 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.124574    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:30:22.129498 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.129472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"]
Jul 24 18:30:22.175922 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.175892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40733a1f-f100-4020-b535-6f81eea5c5aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf\" (UID: \"40733a1f-f100-4020-b535-6f81eea5c5aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:22.277121 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.277084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40733a1f-f100-4020-b535-6f81eea5c5aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf\" (UID: \"40733a1f-f100-4020-b535-6f81eea5c5aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:22.277749 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.277727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40733a1f-f100-4020-b535-6f81eea5c5aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf\" (UID: \"40733a1f-f100-4020-b535-6f81eea5c5aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:22.435045 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.435003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:22.585075 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.585045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"]
Jul 24 18:30:22.586157 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:30:22.586129    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40733a1f_f100_4020_b535_6f81eea5c5aa.slice/crio-897d6f7315ddc16b79ddd2da5398b11d50bedc6cd32f2c09309160f31db6f89e WatchSource:0}: Error finding container 897d6f7315ddc16b79ddd2da5398b11d50bedc6cd32f2c09309160f31db6f89e: Status 404 returned error can't find the container with id 897d6f7315ddc16b79ddd2da5398b11d50bedc6cd32f2c09309160f31db6f89e
Jul 24 18:30:22.993239 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.993199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf" event={"ID":"40733a1f-f100-4020-b535-6f81eea5c5aa","Type":"ContainerStarted","Data":"8d38563971754cf5b9de90577fe7406f020ae61b5ae84273318695981c79c252"}
Jul 24 18:30:22.993414 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:22.993249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf" event={"ID":"40733a1f-f100-4020-b535-6f81eea5c5aa","Type":"ContainerStarted","Data":"897d6f7315ddc16b79ddd2da5398b11d50bedc6cd32f2c09309160f31db6f89e"}
Jul 24 18:30:23.018832 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:23.018776    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf" podStartSLOduration=1.018760709 podStartE2EDuration="1.018760709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:30:23.018062707 +0000 UTC m=+3222.050443059" watchObservedRunningTime="2026-07-24 18:30:23.018760709 +0000 UTC m=+3222.051141067"
Jul 24 18:30:24.003308 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:24.003271    2564 generic.go:356] "Generic (PLEG): container finished" podID="40733a1f-f100-4020-b535-6f81eea5c5aa" containerID="8d38563971754cf5b9de90577fe7406f020ae61b5ae84273318695981c79c252" exitCode=0
Jul 24 18:30:24.003713 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:24.003362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf" event={"ID":"40733a1f-f100-4020-b535-6f81eea5c5aa","Type":"ContainerDied","Data":"8d38563971754cf5b9de90577fe7406f020ae61b5ae84273318695981c79c252"}
Jul 24 18:30:25.149684 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:25.149656    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:25.311095 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:25.310990    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40733a1f-f100-4020-b535-6f81eea5c5aa-maas-api-service-ca\") pod \"40733a1f-f100-4020-b535-6f81eea5c5aa\" (UID: \"40733a1f-f100-4020-b535-6f81eea5c5aa\") "
Jul 24 18:30:25.311349 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:25.311324    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40733a1f-f100-4020-b535-6f81eea5c5aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40733a1f-f100-4020-b535-6f81eea5c5aa" (UID: "40733a1f-f100-4020-b535-6f81eea5c5aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:30:25.412126 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:25.412083    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40733a1f-f100-4020-b535-6f81eea5c5aa-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:26.016829 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:26.016801    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"
Jul 24 18:30:26.016978 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:26.016847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf" event={"ID":"40733a1f-f100-4020-b535-6f81eea5c5aa","Type":"ContainerDied","Data":"897d6f7315ddc16b79ddd2da5398b11d50bedc6cd32f2c09309160f31db6f89e"}
Jul 24 18:30:26.016978 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:26.016897    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="897d6f7315ddc16b79ddd2da5398b11d50bedc6cd32f2c09309160f31db6f89e"
Jul 24 18:30:32.771727 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:32.771692    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"]
Jul 24 18:30:32.776345 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:32.776319    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e18e67-29748630-jlx7l"]
Jul 24 18:30:33.461305 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:33.461271    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83" path="/var/lib/kubelet/pods/d76841d2-0c4e-4b1f-aaf3-5dfa3032aa83/volumes"
Jul 24 18:30:37.202170 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:37.202127    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"]
Jul 24 18:30:37.205087 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:37.205062    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e18e67-4k2gf"]
Jul 24 18:30:37.461429 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:37.461341    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40733a1f-f100-4020-b535-6f81eea5c5aa" path="/var/lib/kubelet/pods/40733a1f-f100-4020-b535-6f81eea5c5aa/volumes"
Jul 24 18:30:43.515446 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:43.515406    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"]
Jul 24 18:30:43.515818 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:43.515611    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy" containerID="cri-o://11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6" gracePeriod=30
Jul 24 18:30:48.785776 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.785721    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:30:48.833145 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-credential-socket\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833145 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833144    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ddfee28-df5c-44d6-a800-106f3f73d00d-istiod-ca-cert\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833404 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833206    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrpqk\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-kube-api-access-xrpqk\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833404 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-certs\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833404 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-token\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833404 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833336    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-socket\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833404 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833381    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-envoy\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833404 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833399    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:30:48.833752 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-podinfo\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833752 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-data\") pod \"0ddfee28-df5c-44d6-a800-106f3f73d00d\" (UID: \"0ddfee28-df5c-44d6-a800-106f3f73d00d\") "
Jul 24 18:30:48.833752 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:30:48.833752 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ddfee28-df5c-44d6-a800-106f3f73d00d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:30:48.833973 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833901    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:30:48.833973 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833952    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-socket\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.834126 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833973    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-credential-socket\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.834126 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.833988    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ddfee28-df5c-44d6-a800-106f3f73d00d-istiod-ca-cert\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.834616 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.834589    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:30:48.835779 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.835736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:30:48.835944 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.835904    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-kube-api-access-xrpqk" (OuterVolumeSpecName: "kube-api-access-xrpqk") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "kube-api-access-xrpqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:30:48.841640 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.841611    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:30:48.841729 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.841646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ddfee28-df5c-44d6-a800-106f3f73d00d" (UID: "0ddfee28-df5c-44d6-a800-106f3f73d00d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 18:30:48.935336 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.935305    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrpqk\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-kube-api-access-xrpqk\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.935336 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.935330    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-workload-certs\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.935336 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.935339    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-token\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.935336 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.935348    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-envoy\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.935637 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.935356    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-podinfo\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:48.935637 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:48.935364    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ddfee28-df5c-44d6-a800-106f3f73d00d-istio-data\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:30:49.168963 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.168928    2564 generic.go:356] "Generic (PLEG): container finished" podID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerID="11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6" exitCode=0
Jul 24 18:30:49.169187 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.168984    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"
Jul 24 18:30:49.169187 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.169015    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" event={"ID":"0ddfee28-df5c-44d6-a800-106f3f73d00d","Type":"ContainerDied","Data":"11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6"}
Jul 24 18:30:49.169187 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.169093    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc" event={"ID":"0ddfee28-df5c-44d6-a800-106f3f73d00d","Type":"ContainerDied","Data":"0a57159ec24fc04fca1234b0cf01abedca2b2b2a739c5e0bdb73c3415864bb02"}
Jul 24 18:30:49.169187 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.169116    2564 scope.go:117] "RemoveContainer" containerID="11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6"
Jul 24 18:30:49.179605 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.179589    2564 scope.go:117] "RemoveContainer" containerID="b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"
Jul 24 18:30:49.188446 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.188428    2564 scope.go:117] "RemoveContainer" containerID="11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6"
Jul 24 18:30:49.188697 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:30:49.188679    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6\": container with ID starting with 11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6 not found: ID does not exist" containerID="11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6"
Jul 24 18:30:49.188746 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.188705    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6"} err="failed to get container status \"11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6\": rpc error: code = NotFound desc = could not find container \"11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6\": container with ID starting with 11eed8a3077b0ee08ea91c1f8d605d8604284ffdcdce975751b06ca7220920c6 not found: ID does not exist"
Jul 24 18:30:49.188746 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.188722    2564 scope.go:117] "RemoveContainer" containerID="b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"
Jul 24 18:30:49.188943 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:30:49.188922    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46\": container with ID starting with b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46 not found: ID does not exist" containerID="b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"
Jul 24 18:30:49.189005 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.188953    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46"} err="failed to get container status \"b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46\": rpc error: code = NotFound desc = could not find container \"b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46\": container with ID starting with b45173e549d6d9bf8effa76e81e9c15e75b46492ce1aca4547e02be8c67a8f46 not found: ID does not exist"
Jul 24 18:30:49.194734 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.194712    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"]
Jul 24 18:30:49.199413 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.199393    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-e18e67-openshift-default-5c8c575cb8-wmqsc"]
Jul 24 18:30:49.461346 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:49.461273    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" path="/var/lib/kubelet/pods/0ddfee28-df5c-44d6-a800-106f3f73d00d/volumes"
Jul 24 18:30:54.384177 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:54.384147    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"]
Jul 24 18:30:54.387152 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:54.387130    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-100cff-29748630-29679"]
Jul 24 18:30:55.460506 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:30:55.460470    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2066408d-50c5-4950-b93e-af77a0836b01" path="/var/lib/kubelet/pods/2066408d-50c5-4950-b93e-af77a0836b01/volumes"
Jul 24 18:31:06.285731 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.285696    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"]
Jul 24 18:31:06.286392 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286375    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy"
Jul 24 18:31:06.286442 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286395    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy"
Jul 24 18:31:06.286442 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286417    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40733a1f-f100-4020-b535-6f81eea5c5aa" containerName="revoke-keys"
Jul 24 18:31:06.286442 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286425    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="40733a1f-f100-4020-b535-6f81eea5c5aa" containerName="revoke-keys"
Jul 24 18:31:06.286555 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286543    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy"
Jul 24 18:31:06.286593 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286560    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy"
Jul 24 18:31:06.286593 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.286568    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="40733a1f-f100-4020-b535-6f81eea5c5aa" containerName="revoke-keys"
Jul 24 18:31:06.290293 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.290268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:06.294139 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.294118    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v7cm8\""
Jul 24 18:31:06.300691 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.300667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"]
Jul 24 18:31:06.417322 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.417288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5afd867-5181-4650-9f0f-809b86939a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk\" (UID: \"a5afd867-5181-4650-9f0f-809b86939a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:06.518004 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.517969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5afd867-5181-4650-9f0f-809b86939a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk\" (UID: \"a5afd867-5181-4650-9f0f-809b86939a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:06.518605 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.518586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5afd867-5181-4650-9f0f-809b86939a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk\" (UID: \"a5afd867-5181-4650-9f0f-809b86939a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:06.605264 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.605176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:06.763660 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:06.763621    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"]
Jul 24 18:31:06.764814 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:31:06.764785    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5afd867_5181_4650_9f0f_809b86939a25.slice/crio-1db8f25dffc6e13666f5a41d731c91fefee1a760551c536e8958d1934d2a9b99 WatchSource:0}: Error finding container 1db8f25dffc6e13666f5a41d731c91fefee1a760551c536e8958d1934d2a9b99: Status 404 returned error can't find the container with id 1db8f25dffc6e13666f5a41d731c91fefee1a760551c536e8958d1934d2a9b99
Jul 24 18:31:07.284838 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:07.284758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk" event={"ID":"a5afd867-5181-4650-9f0f-809b86939a25","Type":"ContainerStarted","Data":"f1f796750aa4e6138fcf1ced3d9c73ebe25198915fe923d0785e379fac8c0206"}
Jul 24 18:31:07.284838 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:07.284806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk" event={"ID":"a5afd867-5181-4650-9f0f-809b86939a25","Type":"ContainerStarted","Data":"1db8f25dffc6e13666f5a41d731c91fefee1a760551c536e8958d1934d2a9b99"}
Jul 24 18:31:07.306510 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:07.306434    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk" podStartSLOduration=1.306413863 podStartE2EDuration="1.306413863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:31:07.300702297 +0000 UTC m=+3266.333082656" watchObservedRunningTime="2026-07-24 18:31:07.306413863 +0000 UTC m=+3266.338794222"
Jul 24 18:31:08.293002 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:08.292970    2564 generic.go:356] "Generic (PLEG): container finished" podID="a5afd867-5181-4650-9f0f-809b86939a25" containerID="f1f796750aa4e6138fcf1ced3d9c73ebe25198915fe923d0785e379fac8c0206" exitCode=0
Jul 24 18:31:08.293205 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:08.293060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk" event={"ID":"a5afd867-5181-4650-9f0f-809b86939a25","Type":"ContainerDied","Data":"f1f796750aa4e6138fcf1ced3d9c73ebe25198915fe923d0785e379fac8c0206"}
Jul 24 18:31:09.445892 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:09.445864    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:09.545841 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:09.545805    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5afd867-5181-4650-9f0f-809b86939a25-maas-api-service-ca\") pod \"a5afd867-5181-4650-9f0f-809b86939a25\" (UID: \"a5afd867-5181-4650-9f0f-809b86939a25\") "
Jul 24 18:31:09.546174 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:09.546151    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5afd867-5181-4650-9f0f-809b86939a25-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5afd867-5181-4650-9f0f-809b86939a25" (UID: "a5afd867-5181-4650-9f0f-809b86939a25"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:31:09.647271 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:09.647241    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5afd867-5181-4650-9f0f-809b86939a25-maas-api-service-ca\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:31:10.307647 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:10.307620    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"
Jul 24 18:31:10.307647 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:10.307646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk" event={"ID":"a5afd867-5181-4650-9f0f-809b86939a25","Type":"ContainerDied","Data":"1db8f25dffc6e13666f5a41d731c91fefee1a760551c536e8958d1934d2a9b99"}
Jul 24 18:31:10.307871 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:10.307688    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1db8f25dffc6e13666f5a41d731c91fefee1a760551c536e8958d1934d2a9b99"
Jul 24 18:31:16.859240 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:16.859202    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"]
Jul 24 18:31:16.863546 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:16.863517    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c4d732-29748630-zxrsv"]
Jul 24 18:31:16.892637 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:16.892595    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"]
Jul 24 18:31:16.893712 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:16.892942    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl" podUID="6e77e3f4-5784-4869-9f7f-5d2d285d9add" containerName="payload-processing" containerID="cri-o://47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827" gracePeriod=30
Jul 24 18:31:17.178919 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.178894    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:31:17.322251 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.322215    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e77e3f4-5784-4869-9f7f-5d2d285d9add-plugins-config-volume\") pod \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") "
Jul 24 18:31:17.322422 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.322275    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4bt9\" (UniqueName: \"kubernetes.io/projected/6e77e3f4-5784-4869-9f7f-5d2d285d9add-kube-api-access-d4bt9\") pod \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\" (UID: \"6e77e3f4-5784-4869-9f7f-5d2d285d9add\") "
Jul 24 18:31:17.322583 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.322548    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e77e3f4-5784-4869-9f7f-5d2d285d9add-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e77e3f4-5784-4869-9f7f-5d2d285d9add" (UID: "6e77e3f4-5784-4869-9f7f-5d2d285d9add"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:31:17.324328 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.324304    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e77e3f4-5784-4869-9f7f-5d2d285d9add-kube-api-access-d4bt9" (OuterVolumeSpecName: "kube-api-access-d4bt9") pod "6e77e3f4-5784-4869-9f7f-5d2d285d9add" (UID: "6e77e3f4-5784-4869-9f7f-5d2d285d9add"). InnerVolumeSpecName "kube-api-access-d4bt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:31:17.352303 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.352272    2564 generic.go:356] "Generic (PLEG): container finished" podID="6e77e3f4-5784-4869-9f7f-5d2d285d9add" containerID="47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827" exitCode=0
Jul 24 18:31:17.352422 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.352344    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"
Jul 24 18:31:17.352422 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.352357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl" event={"ID":"6e77e3f4-5784-4869-9f7f-5d2d285d9add","Type":"ContainerDied","Data":"47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827"}
Jul 24 18:31:17.352422 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.352409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl" event={"ID":"6e77e3f4-5784-4869-9f7f-5d2d285d9add","Type":"ContainerDied","Data":"c7ae77a21b841edcaaf0e8bd4c61bf858915e7deef6d62d5dcbe660e1af5d4e3"}
Jul 24 18:31:17.352594 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.352431    2564 scope.go:117] "RemoveContainer" containerID="47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827"
Jul 24 18:31:17.362648 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.362631    2564 scope.go:117] "RemoveContainer" containerID="47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827"
Jul 24 18:31:17.362894 ip-10-0-139-114 kubenswrapper[2564]: E0724 18:31:17.362876    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827\": container with ID starting with 47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827 not found: ID does not exist" containerID="47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827"
Jul 24 18:31:17.362938 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.362902    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827"} err="failed to get container status \"47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827\": rpc error: code = NotFound desc = could not find container \"47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827\": container with ID starting with 47c1bcb9c197ac8784f325680398139a16d55ab9ea9a1f1232103cab40449827 not found: ID does not exist"
Jul 24 18:31:17.375229 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.375209    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"]
Jul 24 18:31:17.380839 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.380822    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c4d732-6ddb877fdb-xxqsl"]
Jul 24 18:31:17.423472 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.423394    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e77e3f4-5784-4869-9f7f-5d2d285d9add-plugins-config-volume\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:31:17.423472 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.423422    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4bt9\" (UniqueName: \"kubernetes.io/projected/6e77e3f4-5784-4869-9f7f-5d2d285d9add-kube-api-access-d4bt9\") on node \"ip-10-0-139-114.ec2.internal\" DevicePath \"\""
Jul 24 18:31:17.460599 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.460569    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d190841-e53b-4e48-bb03-43d78f7b3310" path="/var/lib/kubelet/pods/1d190841-e53b-4e48-bb03-43d78f7b3310/volumes"
Jul 24 18:31:17.460917 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:17.460904    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e77e3f4-5784-4869-9f7f-5d2d285d9add" path="/var/lib/kubelet/pods/6e77e3f4-5784-4869-9f7f-5d2d285d9add/volumes"
Jul 24 18:31:21.355871 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:21.355834    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"]
Jul 24 18:31:21.361648 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:21.361622    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c4d732-rkjpk"]
Jul 24 18:31:21.460316 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:21.460283    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5afd867-5181-4650-9f0f-809b86939a25" path="/var/lib/kubelet/pods/a5afd867-5181-4650-9f0f-809b86939a25/volumes"
Jul 24 18:31:28.849896 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:28.849843    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5f7469c7-gvwhw_9abb7344-74f5-4a68-adfd-d636158a2652/authorino/0.log"
Jul 24 18:31:34.292789 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:34.292749    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-24vw8_c219d2db-c24f-4253-a89e-112b4aaf7a41/manager/0.log"
Jul 24 18:31:34.416454 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:34.416421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jxm77_5faf1cde-9b05-4a5c-be20-c4d60dad3e22/manager/0.log"
Jul 24 18:31:34.652922 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:34.652895    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zn9sf_472d3051-3545-4ff4-8e5b-d9c499350abb/server/0.log"
Jul 24 18:31:34.777349 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:34.777319    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9t2x4_22acf81d-ab18-4dce-8209-6f4385a5bce0/manager/0.log"
Jul 24 18:31:35.181756 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:35.181729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b794f588d-t28z2_9d80a36b-b389-4f2a-85fc-cc4102b91f3c/copy-manifests/0.log"
Jul 24 18:31:35.201247 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:35.201220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b794f588d-t28z2_9d80a36b-b389-4f2a-85fc-cc4102b91f3c/manager/0.log"
Jul 24 18:31:35.564109 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:35.564006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-756b8948fc-mtnqr_0ae7bded-cba7-467a-873d-f5a7020479ec/maas-api/0.log"
Jul 24 18:31:35.673088 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:35.673050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748600-4bgnq_830bdcb7-8153-42d1-949f-c52919631d77/cleanup/0.log"
Jul 24 18:31:35.895863 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:35.895834    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748630-qzpt4_6b669a70-ddeb-41b8-9bf1-c119a7efdffd/cleanup/0.log"
Jul 24 18:31:36.009009 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.008976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dpwb2_628cb114-28c2-4978-a4df-e009a471ea0d/postgres/0.log"
Jul 24 18:31:36.786824 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.786792    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4_a203e3b0-b718-4dd2-899c-fe03c0fa56fa/util/0.log"
Jul 24 18:31:36.794344 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.794318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4_a203e3b0-b718-4dd2-899c-fe03c0fa56fa/pull/0.log"
Jul 24 18:31:36.800780 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.800763    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4_a203e3b0-b718-4dd2-899c-fe03c0fa56fa/extract/0.log"
Jul 24 18:31:36.918658 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.918630    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd_7209ce0b-7bbc-4613-88ed-3270bd4a159b/util/0.log"
Jul 24 18:31:36.925986 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.925959    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd_7209ce0b-7bbc-4613-88ed-3270bd4a159b/pull/0.log"
Jul 24 18:31:36.932728 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:36.932700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd_7209ce0b-7bbc-4613-88ed-3270bd4a159b/extract/0.log"
Jul 24 18:31:37.041339 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.041256    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9_7a0f3f4d-bf78-40e7-b787-8b8028693880/util/0.log"
Jul 24 18:31:37.048405 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.048351    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9_7a0f3f4d-bf78-40e7-b787-8b8028693880/pull/0.log"
Jul 24 18:31:37.055302 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.055281    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9_7a0f3f4d-bf78-40e7-b787-8b8028693880/extract/0.log"
Jul 24 18:31:37.167295 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.167262    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8_070a0a4e-c277-4871-96b7-ddf83a8d9e91/extract/0.log"
Jul 24 18:31:37.173375 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.173357    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8_070a0a4e-c277-4871-96b7-ddf83a8d9e91/util/0.log"
Jul 24 18:31:37.180004 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.179982    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8_070a0a4e-c277-4871-96b7-ddf83a8d9e91/pull/0.log"
Jul 24 18:31:37.302724 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.302637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5f7469c7-gvwhw_9abb7344-74f5-4a68-adfd-d636158a2652/authorino/0.log"
Jul 24 18:31:37.420212 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.420185    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rq2lm_d3ead26a-5893-4742-909d-7dbe33c7e92d/manager/0.log"
Jul 24 18:31:37.781043 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.781005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rmtx7_a511a828-41d2-4c21-83ab-5994f8790f06/registry-server/0.log"
Jul 24 18:31:37.903537 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:37.903504    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n8cbw_cd7fa903-f272-4d77-96ee-6088a62bdc3a/manager/0.log"
Jul 24 18:31:38.480673 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:38.480636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq_47b9f2b9-dfbc-44ae-a996-088874667126/istio-proxy/0.log"
Jul 24 18:31:38.710574 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:38.710547    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546fb58d4c-4qbp9_f809a7ec-db72-4140-87c4-79cfc05ab3de/kube-auth-proxy/0.log"
Jul 24 18:31:38.969942 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:38.969908    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/1.log"
Jul 24 18:31:39.102435 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:39.102406    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qk6zc_5208b6f8-05dd-4972-8cf1-06ce5324b172/payload-pre-processing/0.log"
Jul 24 18:31:39.228567 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:39.228481    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mnflf_64676a42-5be0-44c3-8939-b30c9095dcf0/payload-processing/0.log"
Jul 24 18:31:39.802219 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:39.802194    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gwbtt_198fa25e-acdc-424d-94ef-e17c8c7ffdad/main/0.log"
Jul 24 18:31:40.035090 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:40.035063    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvzhrb_2801175c-13c8-46b2-b3d4-cd0f17089d87/main/0.log"
Jul 24 18:31:40.145096 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:40.145070    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5xfd8_75acfc55-b0fd-4c67-8a12-ada41a355e44/main/0.log"
Jul 24 18:31:48.565443 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:48.565406    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wx8pj_bc5014fb-4c2f-4b12-b725-4e614956d342/global-pull-secret-syncer/0.log"
Jul 24 18:31:48.719220 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:48.719191    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fbfsh_42e19666-20c4-42a5-bec9-37a0c8b3aa6e/konnectivity-agent/0.log"
Jul 24 18:31:48.785391 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:48.785363    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-114.ec2.internal_e324f28c574bcb525044f52d56737e58/haproxy/0.log"
Jul 24 18:31:53.843732 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:53.843686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4_a203e3b0-b718-4dd2-899c-fe03c0fa56fa/extract/0.log"
Jul 24 18:31:53.873453 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:53.873431    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4_a203e3b0-b718-4dd2-899c-fe03c0fa56fa/util/0.log"
Jul 24 18:31:53.902670 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:53.902648    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759766f4_a203e3b0-b718-4dd2-899c-fe03c0fa56fa/pull/0.log"
Jul 24 18:31:53.938374 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:53.938346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd_7209ce0b-7bbc-4613-88ed-3270bd4a159b/extract/0.log"
Jul 24 18:31:53.961906 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:53.961879    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd_7209ce0b-7bbc-4613-88ed-3270bd4a159b/util/0.log"
Jul 24 18:31:53.991111 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:53.991087    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e078vmd_7209ce0b-7bbc-4613-88ed-3270bd4a159b/pull/0.log"
Jul 24 18:31:54.026675 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.026652    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9_7a0f3f4d-bf78-40e7-b787-8b8028693880/extract/0.log"
Jul 24 18:31:54.073588 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.073547    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9_7a0f3f4d-bf78-40e7-b787-8b8028693880/util/0.log"
Jul 24 18:31:54.099446 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.099360    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738l6s9_7a0f3f4d-bf78-40e7-b787-8b8028693880/pull/0.log"
Jul 24 18:31:54.134614 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.134582    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8_070a0a4e-c277-4871-96b7-ddf83a8d9e91/extract/0.log"
Jul 24 18:31:54.164661 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.164634    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8_070a0a4e-c277-4871-96b7-ddf83a8d9e91/util/0.log"
Jul 24 18:31:54.189976 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.189951    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zwmn8_070a0a4e-c277-4871-96b7-ddf83a8d9e91/pull/0.log"
Jul 24 18:31:54.739633 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.739602    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5f7469c7-gvwhw_9abb7344-74f5-4a68-adfd-d636158a2652/authorino/0.log"
Jul 24 18:31:54.830532 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.830487    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rq2lm_d3ead26a-5893-4742-909d-7dbe33c7e92d/manager/0.log"
Jul 24 18:31:54.945950 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:54.945914    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rmtx7_a511a828-41d2-4c21-83ab-5994f8790f06/registry-server/0.log"
Jul 24 18:31:55.121127 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:55.121017    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n8cbw_cd7fa903-f272-4d77-96ee-6088a62bdc3a/manager/0.log"
Jul 24 18:31:56.974971 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:56.974938    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/alertmanager/0.log"
Jul 24 18:31:57.001781 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.001748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/config-reloader/0.log"
Jul 24 18:31:57.027375 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.027353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/kube-rbac-proxy-web/0.log"
Jul 24 18:31:57.053144 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.053120    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/kube-rbac-proxy/0.log"
Jul 24 18:31:57.078473 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.078449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/kube-rbac-proxy-metric/0.log"
Jul 24 18:31:57.102690 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.102665    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/prom-label-proxy/0.log"
Jul 24 18:31:57.128737 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.128717    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08e80d25-eba6-4c28-b2a1-f74a35ed1e5d/init-config-reloader/0.log"
Jul 24 18:31:57.184275 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.184244    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-scdpk_2380aec2-248c-4671-8f4c-672f7a2198b7/cluster-monitoring-operator/0.log"
Jul 24 18:31:57.430048 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.430000    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k5txh_fdbd20aa-2f48-4da4-a3f2-1c5abf69e351/node-exporter/0.log"
Jul 24 18:31:57.450494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.450458    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k5txh_fdbd20aa-2f48-4da4-a3f2-1c5abf69e351/kube-rbac-proxy/0.log"
Jul 24 18:31:57.472183 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.472162    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k5txh_fdbd20aa-2f48-4da4-a3f2-1c5abf69e351/init-textfile/0.log"
Jul 24 18:31:57.592294 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.592263    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nwlhr_9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94/kube-rbac-proxy-main/0.log"
Jul 24 18:31:57.620157 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.620081    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nwlhr_9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94/kube-rbac-proxy-self/0.log"
Jul 24 18:31:57.644420 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.644387    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nwlhr_9bd7cbe3-9cf7-4a5b-84cd-61f60cdbbf94/openshift-state-metrics/0.log"
Jul 24 18:31:57.896609 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.896577    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-lqv94_9d20e58b-d359-4aec-b243-e5023341eeec/prometheus-operator-admission-webhook/0.log"
Jul 24 18:31:57.923829 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.923800    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dbbd877fc-smkdq_ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10/telemeter-client/0.log"
Jul 24 18:31:57.944829 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.944803    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dbbd877fc-smkdq_ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10/reload/0.log"
Jul 24 18:31:57.969909 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:57.969886    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dbbd877fc-smkdq_ae0a33a8-3ea5-490f-afc0-9cfcf1eb0d10/kube-rbac-proxy/0.log"
Jul 24 18:31:58.780167 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780133    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"]
Jul 24 18:31:58.780607 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780594    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5afd867-5181-4650-9f0f-809b86939a25" containerName="revoke-keys"
Jul 24 18:31:58.780654 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780609    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5afd867-5181-4650-9f0f-809b86939a25" containerName="revoke-keys"
Jul 24 18:31:58.780654 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780628    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e77e3f4-5784-4869-9f7f-5d2d285d9add" containerName="payload-processing"
Jul 24 18:31:58.780654 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780633    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e77e3f4-5784-4869-9f7f-5d2d285d9add" containerName="payload-processing"
Jul 24 18:31:58.780654 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780641    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy"
Jul 24 18:31:58.780654 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780647    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddfee28-df5c-44d6-a800-106f3f73d00d" containerName="istio-proxy"
Jul 24 18:31:58.780812 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780722    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5afd867-5181-4650-9f0f-809b86939a25" containerName="revoke-keys"
Jul 24 18:31:58.780812 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.780732    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e77e3f4-5784-4869-9f7f-5d2d285d9add" containerName="payload-processing"
Jul 24 18:31:58.784231 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.784208    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:58.786840 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.786814    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwr8f\"/\"kube-root-ca.crt\""
Jul 24 18:31:58.787932 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.787908    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwr8f\"/\"openshift-service-ca.crt\""
Jul 24 18:31:58.788072 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.787908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dwr8f\"/\"default-dockercfg-85vn6\""
Jul 24 18:31:58.794046 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.794010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"]
Jul 24 18:31:58.928699 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.928660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-proc\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:58.928699 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.928702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-podres\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:58.928965 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.928782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-sys\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:58.928965 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.928815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6qgx\" (UniqueName: \"kubernetes.io/projected/2fe80353-4f60-4ba0-b524-3c915d43c30d-kube-api-access-d6qgx\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:58.928965 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:58.928913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-lib-modules\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030279 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-proc\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030279 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-podres\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-sys\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6qgx\" (UniqueName: \"kubernetes.io/projected/2fe80353-4f60-4ba0-b524-3c915d43c30d-kube-api-access-d6qgx\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-proc\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-podres\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-sys\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030494 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-lib-modules\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.030714 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.030584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fe80353-4f60-4ba0-b524-3c915d43c30d-lib-modules\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.039095 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.039069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6qgx\" (UniqueName: \"kubernetes.io/projected/2fe80353-4f60-4ba0-b524-3c915d43c30d-kube-api-access-d6qgx\") pod \"perf-node-gather-daemonset-v7mh2\" (UID: \"2fe80353-4f60-4ba0-b524-3c915d43c30d\") " pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.096066 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.096003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.238281 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.238251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"]
Jul 24 18:31:59.239194 ip-10-0-139-114 kubenswrapper[2564]: W0724 18:31:59.239166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2fe80353_4f60_4ba0_b524_3c915d43c30d.slice/crio-1b240e5fea2429d7fe9b33bde462ebb3de6efa585a5aef7d618d2ab891279800 WatchSource:0}: Error finding container 1b240e5fea2429d7fe9b33bde462ebb3de6efa585a5aef7d618d2ab891279800: Status 404 returned error can't find the container with id 1b240e5fea2429d7fe9b33bde462ebb3de6efa585a5aef7d618d2ab891279800
Jul 24 18:31:59.627782 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.627667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2" event={"ID":"2fe80353-4f60-4ba0-b524-3c915d43c30d","Type":"ContainerStarted","Data":"b13350b4b0954fec311590661fe5bc818266863d4828f2ea650c9da474e4d693"}
Jul 24 18:31:59.627782 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.627733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2" event={"ID":"2fe80353-4f60-4ba0-b524-3c915d43c30d","Type":"ContainerStarted","Data":"1b240e5fea2429d7fe9b33bde462ebb3de6efa585a5aef7d618d2ab891279800"}
Jul 24 18:31:59.627782 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.627757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:31:59.644818 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:31:59.644761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2" podStartSLOduration=1.6447478009999998 podStartE2EDuration="1.644747801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:31:59.642525604 +0000 UTC m=+3318.674905960" watchObservedRunningTime="2026-07-24 18:31:59.644747801 +0000 UTC m=+3318.677128192"
Jul 24 18:32:00.518167 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:00.518137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58b8c994-vqg99_ca98dde1-5ffc-4636-9578-e7098dc7ae56/console/0.log"
Jul 24 18:32:00.569632 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:00.569604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-57tss_6cbc6b95-4a39-4c37-a7d0-bad18f2df270/download-server/0.log"
Jul 24 18:32:01.193872 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:01.193844    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-jnbzv_e29515f8-612d-4e33-b345-4f27f5926780/volume-data-source-validator/0.log"
Jul 24 18:32:02.419470 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:02.419437    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqp28_95601a7f-b046-4c9e-9745-5386d0a1f7bc/dns/0.log"
Jul 24 18:32:02.444762 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:02.444731    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqp28_95601a7f-b046-4c9e-9745-5386d0a1f7bc/kube-rbac-proxy/0.log"
Jul 24 18:32:02.554247 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:02.554210    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-npt2z_5ab61a84-5482-4cb5-8241-a7cb3d83d326/dns-node-resolver/0.log"
Jul 24 18:32:03.161687 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:03.161649    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c5b4c757f-cp6v6_23df5762-a60b-41a9-89f3-6457b5c77f2e/registry/0.log"
Jul 24 18:32:03.186913 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:03.186887    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xwrq_36c1d58b-4ae3-4185-8609-a30eb99d7c39/node-ca/0.log"
Jul 24 18:32:04.209801 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:04.209771    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq_47b9f2b9-dfbc-44ae-a996-088874667126/istio-proxy/0.log"
Jul 24 18:32:04.373441 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:04.373415    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546fb58d4c-4qbp9_f809a7ec-db72-4140-87c4-79cfc05ab3de/kube-auth-proxy/0.log"
Jul 24 18:32:04.432263 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:04.432220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/0.log"
Jul 24 18:32:04.482797 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:04.482720    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/1.log"
Jul 24 18:32:04.524736 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:04.524703    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qk6zc_5208b6f8-05dd-4972-8cf1-06ce5324b172/payload-pre-processing/0.log"
Jul 24 18:32:04.561547 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:04.561509    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mnflf_64676a42-5be0-44c3-8939-b30c9095dcf0/payload-processing/0.log"
Jul 24 18:32:05.433391 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:05.433366    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d2gv8_bb1dcc7f-5409-4604-9a1a-f4e0c8095872/serve-healthcheck-canary/0.log"
Jul 24 18:32:05.644534 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:05.644506    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dwr8f/perf-node-gather-daemonset-v7mh2"
Jul 24 18:32:06.146003 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:06.145977    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v2rt5_d29e7a52-5574-462a-a713-2a0149ea20c3/kube-rbac-proxy/0.log"
Jul 24 18:32:06.167013 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:06.166980    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v2rt5_d29e7a52-5574-462a-a713-2a0149ea20c3/exporter/0.log"
Jul 24 18:32:06.191699 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:06.191674    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v2rt5_d29e7a52-5574-462a-a713-2a0149ea20c3/extractor/0.log"
Jul 24 18:32:08.706563 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:08.706533    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-24vw8_c219d2db-c24f-4253-a89e-112b4aaf7a41/manager/0.log"
Jul 24 18:32:09.056602 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:09.056522    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jxm77_5faf1cde-9b05-4a5c-be20-c4d60dad3e22/manager/0.log"
Jul 24 18:32:09.238000 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:09.237971    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zn9sf_472d3051-3545-4ff4-8e5b-d9c499350abb/server/0.log"
Jul 24 18:32:09.355949 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:09.355856    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9t2x4_22acf81d-ab18-4dce-8209-6f4385a5bce0/manager/0.log"
Jul 24 18:32:09.593817 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:09.593781    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b794f588d-t28z2_9d80a36b-b389-4f2a-85fc-cc4102b91f3c/manager/0.log"
Jul 24 18:32:09.630688 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:09.630611    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b794f588d-t28z2_9d80a36b-b389-4f2a-85fc-cc4102b91f3c/copy-manifests/0.log"
Jul 24 18:32:10.235973 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:10.235939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq_47b9f2b9-dfbc-44ae-a996-088874667126/istio-proxy/0.log"
Jul 24 18:32:10.402987 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:10.402961    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546fb58d4c-4qbp9_f809a7ec-db72-4140-87c4-79cfc05ab3de/kube-auth-proxy/0.log"
Jul 24 18:32:10.482530 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:10.482501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/0.log"
Jul 24 18:32:10.534935 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:10.534904    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/1.log"
Jul 24 18:32:10.572508 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:10.572482    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qk6zc_5208b6f8-05dd-4972-8cf1-06ce5324b172/payload-pre-processing/0.log"
Jul 24 18:32:10.607610 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:10.607583    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mnflf_64676a42-5be0-44c3-8939-b30c9095dcf0/payload-processing/0.log"
Jul 24 18:32:12.170150 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:12.170109    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fdzq_47b9f2b9-dfbc-44ae-a996-088874667126/istio-proxy/0.log"
Jul 24 18:32:12.340358 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:12.340329    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546fb58d4c-4qbp9_f809a7ec-db72-4140-87c4-79cfc05ab3de/kube-auth-proxy/0.log"
Jul 24 18:32:12.392330 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:12.392302    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/0.log"
Jul 24 18:32:12.447340 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:12.447260    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nc7ns_861bb1fa-7cd8-4006-9a87-0351a1806588/istio-proxy/1.log"
Jul 24 18:32:12.505585 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:12.505554    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qk6zc_5208b6f8-05dd-4972-8cf1-06ce5324b172/payload-pre-processing/0.log"
Jul 24 18:32:12.538721 ip-10-0-139-114 kubenswrapper[2564]: I0724 18:32:12.538687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-mnflf_64676a42-5be0-44c3-8939-b30c9095dcf0/payload-processing/0.log"